You want to block crwlers from accessing your entire website. What robots.txt entry would you use?

  • User-agent: Allbots Disallow: * “` ““
  • User-agent: / Disallow: * “` ““
  • User-agent: * Disallow: “` ““
  • User-agent: * Disallow: / “` ““
Join our list

Subscribe to our mailing list and get interesting stuff and updates to your email inbox.

Thank you for subscribing.

Something went wrong.

Leave a Comment

Join our list

Subscribe to our mailing list and get interesting stuff and updates to your email inbox.

Thank you for subscribing.

Something went wrong.

Send this to a friend