You want to block crawlers from accessing your entire website. What robots.txt entry would you use?

  • markdown User-agent: Allbots Disallow: \* “` ““
  • markdown User-agent: / Disallow: \* “` ““
  • markdown User-agent: / Disallow: “` ““
  • markdown User-agent: \* Disallow: / “` ““
Join our list

Subscribe to our mailing list and get interesting stuff and updates to your email inbox.

Thank you for subscribing.

Something went wrong.

Leave a Comment

Join our list

Subscribe to our mailing list and get interesting stuff and updates to your email inbox.

Thank you for subscribing.

Something went wrong.

Send this to a friend