Compose User-agent, Allow/Disallow, Crawl-delay and Sitemap, with presets for common cases — preview, copy or download.
Pick a preset, or build manually: set a User-agent (use * for all bots, or a specific name like Googlebot), then add Allow / Disallow rules with URL paths (e.g. /private/). Crawl-delay is optional (seconds). Add one or more Sitemap URLs at the bottom. The preview on the right updates live; Copy or Download to grab the final robots.txt. “Allow search, block AI bots” adds Disallow / for common AI crawlers (GPTBot, CCBot, anthropic-ai, etc.) while leaving search engines free.