FREE Robots.txt Generator

FREE Robots.txt Generator instantly create and download a custom robots.txt file. Enter that which you don't want search engines to index, our free robots.txt generator will correctly format the file. Enter the files or directories into the boxes putting in one per line and push the button. On the result page you can download your custom robots.txt file created in the proper format. Search engines will ignore the files and directories you enter into the free robots.txt generator boxes. Be careful not to put a / (forward slash) by itself into any of the fields as that will tell the search engines not to index any of your pages. Unless that is what you want the search engines to do, some people don't want their site in the search engine index.

Search engines will check for it first when they come to index your site. The robots.txt file must follow the correct format and syntax so the search engines will properly parse the file. Upload the file to the top level of your public directory such as http://somesite.com/robots.txt. Please feel free to use our free robots.txt generator anytime you need a robots.txt file in the correct format to help design and build your website.