Robots.txt Generator
Build a correct robots.txt file with allow/disallow rules, crawl-delay and a sitemap reference — then download it.
How to use this tool
- 1Paste or type your input above.
- 2The result updates instantly.
- 3Copy the output with one click.
Frequently asked questions
Where does robots.txt go?+
It must live at the root of your domain (example.com/robots.txt). This tool generates the file; upload it to your site root.
Is my data private?+
Yes. The tool runs entirely in your browser — nothing you paste or type is uploaded to a server.
Guides & deep dives
robots.txt: What to Block, What Never to Block
Learn robots.txt syntax, the right patterns to block crawlers, what you must never disallow, and how to avoid the noindex vs robots.txt mistake.
Meta Tags That Matter in 2026: Title, Description and Beyond
Learn which meta tags still drive SEO in 2026 — title and description limits, OG tags, robots directives, and which tags to stop wasting time on.
Schema Markup for Beginners: Types That Win Rich Results
Learn how to add schema markup to your site with real JSON-LD examples for FAQ, Article, Product, and LocalBusiness — and avoid the errors that kill rich results.
UTM Parameters: Naming Conventions That Keep Analytics Clean
Stop fragmenting your campaign data. Learn the UTM naming conventions that keep Google Analytics consistent, reportable, and free of duplicate sources.