What effect will this line in robots.txt have on Google’s crawling behavior? # Disallow: /

Advertisement

Here is the answer of the question: What effect will this line in robots.txt have on Google’s crawling behavior? # Disallow: /

  • It will disallow crawling of every page and resource on the site
  • It will disallow crawling of the home page only
  • It will allow crawling of the home page only
  • It will not have any effect on crawling

The above question is related to “HubSpot CMS for Developers II: Best Practices“. You can find all the updated questions and answers related to to “HubSpot CMS for Developers II: Best Practices” on the “HubSpot CMS for Developers II: Best Practices” page. If you find the update in question or answers, do comment on this page and let us know. We will update the answers as soon as possible.

Join our list

Subscribe to our mailing list and get interesting stuff and updates to your email inbox.

Thank you for subscribing.

Something went wrong.

Leave a Comment


Share via
Join our list

Subscribe to our mailing list and get interesting stuff and updates to your email inbox.

Thank you for subscribing.

Something went wrong.

Send this to a friend