See which AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended and more) your robots.txt allows or blocks - and whether that helps or hurts your AI visibility.
Enter your URL and we fetch your live robots.txt, then check it against the AI crawlers that matter - GPTBot, ClaudeBot, PerplexityBot, Google-Extended, CCBot and more.
You instantly see which AI bots you're allowing and which you're blocking, so you know whether you're visible in AI answers or accidentally shut out.
On WordPress, the free wptaskify plugin logs every AI bot that actually visits and gives you one-click controls to keep the citing bots and block the training-only scrapers.
Some AI bots (like GPTBot) train models; others (like OAI-SearchBot and PerplexityBot) can cite you and send traffic. Blocking the wrong ones makes you invisible in AI answers; blocking none lets training crawlers take everything.
You add rules to robots.txt (or use a plugin). The free wptaskify plugin writes the correct robots.txt rules for you and lets you block or allow each AI bot with one click - no code.
It depends. GPTBot is mostly training. If you want ChatGPT to cite you and send traffic, keep OAI-SearchBot and ChatGPT-User allowed; you can block GPTBot alone if you don't want your content used for training.
Yes - the free wptaskify plugin keeps a live log of every AI crawler hit (which bot, when, which page), which this one-time checker can't show. That's the real signal for tuning access.
Blocking AI-specific bots (GPTBot, Google-Extended) does not affect normal Google Search crawling by Googlebot - they're separate. But blocking AI-search bots can remove you from AI answers.
This free tool shows you one result. Connect your own Claude or ChatGPT to wptaskify and it applies these fixes across your entire WordPress, WooCommerce or Shopify site - you approve, it works.
More free tools: AI SEO Score · AI Visibility · Product descriptions · AI Bot Checker · Meta Preview