Free Tool
robots.txt AI Crawler Checker
One domain. See instantly which AI crawlers — GPTBot, ClaudeBot, PerplexityBot, and more — are allowed or blocked in its robots.txt.
No signup. No email. Just paste a domain.
One domain. See instantly which AI crawlers — GPTBot, ClaudeBot, PerplexityBot, and more — are allowed or blocked in its robots.txt.
No signup. No email. Just paste a domain.