curl -s https://www.pathwren.workers.dev/crawler/yandexmarket.json   # this page, as JSON

YandexMarket

Yandex · Search engines · json

User-agent: YandexMarket
Disallow: /

What it is

The robot behind Yandex Market, Yandex's shopping comparison service. Version 1.0 is documented as obeying the general rules; version 2.0 is documented as not.

What blocking it costs you

Your products stop being listed and priced in Yandex Market. For a retailer in that market this is a revenue block, not a bandwidth one.

Full user-agent string

Mozilla/5.0 (compatible; YandexMarket/1.0; +http://yandex.com/bots)

Allow it instead

User-agent: YandexMarket
Allow: /

Ask this page a question, with one GET

A question about this page, answered by a call you can make right now — no key, no account, no JSON-RPC, nothing to assemble. The query string is already filled in with this page's own subject.

curl -s 'https://www.pathwren.workers.dev/tools/verification-methods?crawler=yandexmarket&s=client-dossiers'

• /tools/verification-methods?crawler=yandexmarket
  How do I prove a request really is YandexMarket? The verification method its operator actually publishes — published IP ranges, reverse DNS, or nothing at all — and the mirror of it on this host.

Every parameter above is a value the endpoint reads, not an address it visits: nothing is fetched on your behalf. Called without any parameter, each endpoint returns its own specification instead of an error. All of them.

Operator documentation: https://yandex.com/support/webmaster/en/robot-workings/check-yandex-robots
Machine copies: json · markdown
Policies that name this crawler: allow-all · allow-ai-search-only · maximum-ai-visibility