Granular Bot & Path Control
Define separate allow and disallow rules for all robots or specific bots like Googlebot, Bingbot, and AI scrapers (GPTBot, CCBot).
Robots.txt Generator
Generate customized robots.txt files with crawler allow/disallow rules, multiple sitemaps, AI bot blocking, and crawl-delay settings in real time.
User-agent: *.Appends a dedicated Disallow block for LLM crawlers without affecting search engines.
Add full URL(s) including https://. You can add multiple sitemaps separated by line breaks.
Used by Bingbot, YandexBot, etc., to control request frequency. (Googlebot ignores Crawl-delay).
# robots.txt generated by Tool 200 (https://tool200.com)
# 100% Client-Side Free Robots.txt Generator
User-agent: *
Disallow: /admin/
Disallow: /api/
Disallow: /private/
Allow: /
# Sitemap location(s)
Sitemap: https://example.com/sitemap.xmlInstruct web search crawlers and AI bots accurately, protect sensitive routes, and optimize SEO crawling efficiency directly in your browser.
Define separate allow and disallow rules for all robots or specific bots like Googlebot, Bingbot, and AI scrapers (GPTBot, CCBot).
Embed XML sitemap locations and configure crawl rates to prevent bot traffic from overloading server resources.
All rule parsing and file creation run directly in your local browser memory with zero tracking or remote uploads.
A refreshing collection of free classic browser games to recharge your brain during work.