Yandex · Search engines · json
User-agent: YandexBot Disallow: /
| robots.txt token | YandexBot |
| User-agent contains | YandexBot |
| Operator | Yandex |
| Category | Search engines |
| robots.txt | obeys robots.txt (documented) |
| Verify by | reverse DNS |
Yandex's search crawler, which also feeds Alice and Yandex's generative answers.
Removal from Yandex Search. Verify with reverse DNS to a yandex.ru, yandex.net or yandex.com host — YandexBot is among the most-spoofed user-agents there is.
Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
User-agent: YandexBot Allow: /
Operator documentation: https://yandex.com/support/webmaster/robot-workings/check-yandex-robots.html
Machine copies: json ·
markdown
Policies that name this crawler:
allow-all · allow-ai-search-only · maximum-ai-visibility