Robots.txt Generator

Search Engine Optimization

Robots.txt Generator

Default - All Robots are:  
Sitemap: (leave blank if you don't have) 
Search Robots: Google
  Google Image
  Google Mobile
  MSN Search
  Yahoo MM
  Yahoo Blogs
  DMOZ Checker
  MSN PicSearch
Restricted Directories: The path is relative to root and must contain a trailing slash "/"

Now, Create 'robots.txt' file at your root directory. Copy above text and paste into the text file.

About Robots.txt Generator

Robots.Txt is a file that may be located within the root folder of your internet site to help serps index your website online extra accurately. Search engines like google and yahoo including Google use website crawlers, or robots that assessment all of the content material in your internet site. There can be parts of your internet site which you do not want them to crawl to encompass in person search results, along with admin page. You can add these pages to the report to be explicitly overlooked. Robots.Txt files use something called the Robots Exclusion Protocol. This website will easily generate the file for you with inputs of pages to be excluded.