Exa · AI search crawlers · json
User-agent: ExaSearchBot Disallow: /
| robots.txt token | ExaSearchBot |
| User-agent contains | ExaSearchBot |
| Operator | Exa |
| Category | AI search crawlers |
| robots.txt | operator publishes no robots.txt statement |
| Verify by | no published verification method |
Exa's crawler. It discovers and indexes public pages so they can be retrieved and cited through Exa's search API, which is one of the common retrieval backends behind agent frameworks.
Agents built on Exa's API stop finding you. Exa publishes no statement about robots.txt compliance, so treat the rule as a request.
ExaSearchBot
User-agent: ExaSearchBot Allow: /
Operator documentation: https://exa.ai
Machine copies: json ·
markdown
Policies that name this crawler:
allow-all · block-all-ai · allow-ai-search-only · maximum-ai-visibility