OpenAI · AI search crawlers · json
User-agent: OAI-SearchBot Disallow: /
| robots.txt token | OAI-SearchBot |
| User-agent contains | OAI-SearchBot |
| Operator | OpenAI |
| Category | AI search crawlers |
| robots.txt | obeys robots.txt (documented) |
| Verify by | published IP ranges |
| Published ranges | 35 IPv4 + 0 IPv6 · json · source |
Builds the index ChatGPT search answers from. Content it collects is used for retrieval and citation, not for model training.
High. Blocking this removes you from ChatGPT search results and from the source links ChatGPT shows. This is the single most expensive block on this list for anyone who wants to be cited by an assistant.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; OAI-SearchBot/1.0; +https://openai.com/searchbot
User-agent: OAI-SearchBot Allow: /
Operator documentation: https://platform.openai.com/docs/bots
Machine copies: json ·
markdown
Policies that name this crawler:
allow-all · block-all-ai · allow-ai-search-only · maximum-ai-visibility