AEOscoreFree AEO score

Glossary / AI engines and crawlers

GPTBot

What is GPTBot?

GPTBot is OpenAI's training crawler. It collects public web content that may be used to train OpenAI's foundation models, and identifies itself with the user agent token GPTBot. OpenAI states that disallowing GPTBot in robots.txt signals your content should not be used for training. It does not control ChatGPT search visibility.

Last updated

In practice

Why it matters for AI visibility

GPTBot is the bot most often blocked in anger, and the block is frequently a mistake in slow motion. Disallowing it keeps your future content out of OpenAI's training data, a legitimate choice for a publisher protecting its archive, but for a business that wants AI engines to know it exists, training data is the long game: what GPTBot reads today shapes what future models say by default. Blocking it also does nothing to remove you from ChatGPT's live search answers, which flow through OAI-SearchBot and ChatGPT-User instead; plenty of sites block GPTBot for policy reasons while staying fully visible in search. Check your robots.txt now: some CMS plugins and CDN bot-protection rules block GPTBot silently. OpenAI publishes its IP ranges, so genuine GPTBot traffic can be verified in your logs.

Keep reading

Related terms

Sources

What's your AEO score?

Send your domain and a named expert will run it through all six engines, score the results and email your report within 1 to 2 working days. Free, no card, no signup.

  • ChatGPT
  • Claude
  • Gemini
  • Perplexity
  • Google AI Overviews
  • Google AI Mode