🤖 Robots.txt Generator
Build a valid robots.txt with per-user-agent allow/disallow rules and a sitemap line.
About this tool
A robots.txt file tells search engine crawlers which parts of your site they may or may not request. Add user-agent groups, give each one Allow / Disallow rules and an optional crawl-delay, point crawlers to your sitemap, and copy or download the result to your site root.
Use the presets to start from allow-all or block-all. Everything is generated locally — nothing is uploaded.