Robots.txt is:

  • A file to give instructions to Google about how high to rank a certain site
  • A file used to associate the Search console account with a domain
  • A file that lists all of your web pages along with details of how often they are updated
  • A text file that instructs robots how to crawl and index web pages
Join our list

Subscribe to our mailing list and get interesting stuff and updates to your email inbox.

Thank you for subscribing.

Something went wrong.

Leave a Comment

Join our list

Subscribe to our mailing list and get interesting stuff and updates to your email inbox.

Thank you for subscribing.

Something went wrong.

Send this to a friend