Robots.txt Generator
Robots.txt Generator builds a robots.txt file from your allow, disallow and sitemap rules. Add directives per user-agent, set a crawl delay, and download or copy the file — all in your browser.
Última atualização: July 2026
A robots.txt generator creates a robots.txt file that tells search engine crawlers which parts of your site they may or may not access. Add allow/disallow rules for specific user-agents, a sitemap URL and an optional crawl delay. The generated file is built in your browser and ready to paste — nothing is uploaded.
Como usar Robots.txt Generator
- Add a rule: choose a user-agent, then add paths to allow or disallow.
- Optionally add your sitemap URL and crawl delay.
- Copy the generated robots.txt or download it.
Perguntas frequentes
Where do I put my robots.txt file?
Upload it to the root of your website (example.com/robots.txt). Most CMS and hosting platforms let you add it via file manager or settings.
Can I block specific crawlers?
Yes — each rule is applied to a specific user-agent. You can block Googlebot while allowing Bingbot, for example.
Is my data uploaded?
No — the robots.txt is generated entirely in your browser.
ferramentas para desenvolvedores relacionadas
SERP Preview Tool
Preview how your page appears in Google search results. Test title tags, meta descriptions and URLs — see exactly what users see. Free, in-browser.
Slug Generator
Convert any title or text into a clean, URL-friendly slug. Lowercase, hyphenated and stripped of special characters. Free and instant.
UUID Generator
Generate random v4 UUIDs (GUIDs) in bulk and copy them with one click. Free, instant and fully in-browser using the secure crypto API.
Base64 Encode / Decode
Encode text to Base64 or decode Base64 back to text instantly. Free, private, in-browser — supports full Unicode (UTF-8).