When to use it
Build a small robots.txt file without memorising the syntax.
Crawl & indexing
Robots.txt Generator
Create a simple robots.txt file from explicit allow, disallow, and sitemap rules.
Runs in your browser
Run the tool
This tool processes the entered content in your browser.
What this check means
Your input is processed in the browser for this tool.