Robots.txt Generator

Search Engine Optimization

Robots.txt Generator


Default - All Robots are:  
    
Crawl-Delay:
    
Sitemap: (leave blank if you don't have) 
     
Search Robots: Google
  Google Image
  Google Mobile
  MSN Search
  Yahoo
  Yahoo MM
  Yahoo Blogs
  Ask/Teoma
  GigaBlast
  DMOZ Checker
  Nutch
  Alexa/Wayback
  Baidu
  Naver
  MSN PicSearch
   
Restricted Directories: The path is relative to root and must contain a trailing slash "/"
 
 
 
 
 
 
   



Now, Create 'robots.txt' file at your root directory. Copy above text and paste into the text file.


About Robots.txt Generator

Robots.txt Generator Tool is a powerful tool that is used to generate your sites Googlebot friendly. It is very useful for webmasters. This tool is totally free which provide you easy way to making robot.txt files. We offer this tool which you can use simply without any cost. It works quickly in just few mouse clicks.
As we know very well web parameters has been changed day by day before some years website authority are also change constantly due to these reasons webmasters also have to need change their strategy. Only good content are not efficient it is very important needs to be get found in the gamut of competition and gain authority- through pagerank and otherwise.

Robots.txt Generator Tool is an outstanding tool that make easy any difficult task to the webmasters in very short time only on one click.

How to use Robots.txt Generator Tool

Use of this tool is not very difficult it is very easy following some points can help you to use this.

 

  •  First of all select what you want all robots or some robots to give access to files of your sites, all robots has been allowed automatically
  • Now select what quantity has been delay there should be in the crawls. You can select your preferred option from 5 seconds to 120 seconds
  • In that case if  your site have sitemap, then paste it otherwise, you can proceed
  • Select which bots can crawl your web and choose any bot which you don't want to crawl your site's files.
    The last step is to restrict directories. The path is relative to root and must contain a trailing slash "/".
  • After you have generated Googlebot friendly robots.txt file using our Robots.txt Generator Tool, it's the time to upload it to the root directory of your site.

 

So friends now you can use this outstanding tool very easily and totally free which s available on s4seo toools.

 
 


Top Tools