Robots.txt Generator
Builds a robots.txt file.
Reading the result
Test it before deployment: a mistake can block a whole site.
Limitations
Runs in your browser; your input is not sent to us.
Example
Enter sitemap URL on line one, then one disallowed path per line in the box. The result updates as you type.
Questions
What does the Robots.txt Generator do?
Builds a robots.txt file.
How should I read the result?
Test it before deployment: a mistake can block a whole site.
What can it not tell me?
Runs in your browser; your input is not sent to us.