Before you read anything into a miss from /tools/verify-crawler: which crawlers can be verified by published prefix, which document forward-confirmed reverse DNS instead (with the exact two dig commands to run), and which publish no verification method at all — with the mirror's own counts and fetch dates.
curl -s 'https://www.pathwren.workers.dev/tools/verification-methods?crawler=claudebot&s=client-dossiers'
The one row for ClaudeBot: its verification method, the operator URL it comes from, how many prefixes this host mirrors for it and when they were last fetched.
Run it in a browser —
it answers JSON with access-control-allow-origin: *, so
fetch() works from any page with no proxy.
Allow header and points at the MCP endpoint.max-age=3600, a strong ETag,
and a 304 when you send it back./tools/ never costs you a 400.| parameter | required | what it is |
|---|---|---|
crawler · operator, q | no | Crawler slug, name, operator or user-agent substring. Omit for the whole tally. |
This endpoint holds no copy of the logic: it calls verification_methods on
the crawler-ip-verifier MCP server in-process, through that server's own
JSON-RPC envelope. One implementation, two doors — an answer that changes here changed there.
curl -s https://www.pathwren.workers.dev/mcp/netcheck \
-H 'content-type: application/json' \
-H 'accept: application/json, text/event-stream' \
-d '{"jsonrpc":"2.0","id":1,"method":"tools/call",
"params":{"name":"verification_methods","arguments":{}}}'