Build and validate robots.txt without guessing — edit crawl rules visually and see what major bots would follow.

Open the tool

Go to /tools/robots/.

Add rules

Each row is a user-agent, allow/disallow type, and path. Use presets for common patterns like blocking GPTBot while allowing Google.

Preview bots

Enter a path (or pick a sample) to see whether Googlebot and GPTBot would be allowed. The preview uses longest-match rule logic — always verify on your live site.

Export

Copy the generated file or download robots.txt. Upload it to your site root. Add an optional Sitemap: line pointing at your XML sitemap.

Privacy

Rules are stored in sessionStorage in your browser tab only. Nothing is sent to our servers.