# archive.org_bot

What this client asked https://www.pathwren.workers.dev for, from that host's own request log.
Window: 2026-08-31 20:58:34Z to 2026-09-09 01:41:24Z UTC. Generated 2026-09-14.

## User-agent strings, exactly as they arrived

- `Mozilla/5.0 (compatible; archive.org_bot +http://archive.org/details/archive.org_bot) Zeno/d3712ae warc/v0.8.99` — 1028 request(s), 15 address(es), 2026-08-31 20:58:34Z to 2026-09-09 01:41:24Z

- Requests: 1028
- Distinct addresses (salted hashes, never published): 15
- Distinct paths: 921
- Visits (30-minute gap rule): 16
- Status codes: 200×510, not recorded×309, 404×125, 307×84
- Accept headers: none sent
- Our classifier called it: crawler×1028 (ours, from the user-agent)

## What it asked for, in order

1. `/category/dataset.html` — 2026-08-31 20:58:34Z — not recorded
2. `/category/archive.html` — 2026-08-31 20:58:34Z — not recorded
3. `/robots/block-disputed.txt` — 2026-08-31 20:58:34Z — not recorded
4. `/crawler/oai-searchbot.html` — 2026-08-31 20:58:34Z — not recorded
5. `/status.html` — 2026-08-31 20:58:34Z — not recorded
6. `/robots/allow-ai-search-only.txt` — 2026-08-31 20:58:34Z — not recorded
7. `/category/user-fetch.html` — 2026-08-31 20:58:34Z — not recorded
8. `/data/` — 2026-08-31 20:58:34Z — not recorded
9. `/robots/maximum-ai-visibility.txt` — 2026-08-31 20:58:34Z — not recorded
10. `/crawler/ccbot.html` — 2026-08-31 20:58:34Z — not recorded
11. `/category/seo.html` — 2026-08-31 20:58:34Z — not recorded
12. `/policy/block-disputed.html` — 2026-08-31 20:58:34Z — not recorded
13. `/category/tool.html` — 2026-08-31 20:58:34Z — not recorded
14. `/crawler/gptbot.html` — 2026-08-31 20:58:34Z — not recorded
15. `/crawler/perplexitybot.html` — 2026-08-31 20:58:34Z — not recorded
16. `/snippet/` — 2026-08-31 20:58:34Z — not recorded
17. `/ip-ranges/` — 2026-08-31 20:58:34Z — not recorded
18. `/policy/allow-ai-search-only.html` — 2026-08-31 20:58:34Z — not recorded
19. `/crawler/claude-searchbot.html` — 2026-08-31 20:58:34Z — not recorded
20. `/policy/block-all-ai.html` — 2026-08-31 20:58:34Z — not recorded
21. `/ip-ranges/index.html` — 2026-08-31 20:58:34Z — not recorded
22. `/px.gif` — 2026-08-31 20:58:35Z — not recorded
23. `/data/agents.json` — 2026-08-31 20:58:35Z — 200
24. `/data/index.html` — 2026-08-31 20:58:39Z — not recorded
25. `/ip-ranges/openai-chatgpt-user.json` — 2026-08-31 20:58:41Z — not recorded
26. `/crawler/chatgpt-user.html` — 2026-08-31 20:58:41Z — not recorded
27. `/crawler/gptbot.json` — 2026-08-31 20:58:41Z — not recorded
28. `/crawler/oai-searchbot.json` — 2026-08-31 20:58:41Z — not recorded
29. `/ip-ranges/openai-gptbot.json` — 2026-08-31 20:58:41Z — not recorded
30. `/ip-ranges/openai-searchbot.json` — 2026-08-31 20:58:41Z — not recorded
31. `/crawler/chatgpt-user.json` — 2026-08-31 20:58:41Z — not recorded
32. `/crawler/claudebot.html` — 2026-08-31 20:58:41Z — not recorded
33. `/data/Mozilla/5.0%20(compatible;%20ClaudeBot/1.0;%20+claudebot@anthropic.com)` — 2026-08-31 20:58:43Z — not recorded
34. `/crawler/claudebot.json` — 2026-08-31 20:58:43Z — not recorded
35. `/crawler/claude-searchbot.json` — 2026-08-31 20:58:43Z — not recorded
36. `/data/Mozilla/5.0%20(compatible;%20Claude-SearchBot/1.0;%20+Claude-SearchBot@anthropic.com)` — 2026-08-31 20:58:43Z — not recorded
37. `/data/Mozilla/5.0%20(compatible;%20Claude-User/1.0;%20+Claude-User@anthropic.com)` — 2026-08-31 20:58:43Z — not recorded
38. `/crawler/claude-user.html` — 2026-08-31 20:58:43Z — not recorded
39. `/crawler/claude-user.json` — 2026-08-31 20:58:43Z — not recorded
40. `/crawler/anthropic-ai.html` — 2026-08-31 20:58:43Z — not recorded

## What it asked for that did not exist

- `/data/A2A-Registry-HealthCheck/1.0` — 404×1 — first asked 2026-09-01 07:02:17Z; still absent
- `/data/bingbot/2.0` — 404×1 — first asked 2026-09-01 07:02:17Z; still absent
- `/data/ClaudeBot/1.0` — 404×1 — first asked 2026-09-01 07:02:17Z; still absent
- `/data/exaforce-mcprep/0.1%20(MCP%20server%20reputation%20scanner)` — 404×1 — first asked 2026-09-01 07:02:17Z; still absent
- `/data/python-httpx2/2.12.0` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/YandexBot/3.0` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/Orbit-MCP-Registry-IconResolver/1.0` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/Mozilla/5.0` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/Go-http-client/2.0` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/mcp-registry/1.0` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/GPTBot/1.4` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/measure-mcp-schema/0.1.0` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/mcp-checker/1.0` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/GF-Agent-Toll-Outbound/1.6.0` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/utopian-foundry-probe/1.0` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/MCPCatalogSync/1.0` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/GF-Agent-Toll-Remediation/1.0` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/AetherLink-Public-Discovery-Evidence/1.0` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/python-httpx/0.28.1` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/ReactorNetty/1.0.32` — 404×1 — first asked 2026-09-01 07:02:18Z; still absent
- `/data/ReactorNetty/1.2.1` — 404×1 — first asked 2026-09-01 07:02:19Z; still absent
- `/data/A2A-Registry/1.0` — 404×1 — first asked 2026-09-01 07:02:19Z; still absent
- `/data/AetherLink-Public-Agent-Card-Policy-Check/1.0` — 404×1 — first asked 2026-09-01 07:02:19Z; still absent
- `/data/AgentSure-MCPScan/0.1` — 404×1 — first asked 2026-09-01 07:02:19Z; still absent
- `/data/curl/7.88.0` — 404×1 — first asked 2026-09-01 07:02:19Z; still absent
- `/data/PackageHound/1.0` — 404×1 — first asked 2026-09-01 07:02:19Z; still absent
- `/data/SaSame-Census-Era-Probe/1.0` — 404×1 — first asked 2026-09-01 07:02:19Z; still absent
- `/data/SaSame-MCP-Audit/0.1` — 404×1 — first asked 2026-09-01 07:02:19Z; still absent
- `/data/TAR-Discovery/1.0` — 404×1 — first asked 2026-09-01 07:02:19Z; still absent
- `/data/TAR-Directory-Indexer/1.0` — 404×1 — first asked 2026-09-01 07:02:19Z; still absent
- `/data/TAR-Health/1.0` — 404×1 — first asked 2026-09-01 07:02:19Z; still absent
- `/bot/YandexBot/3.0` — 404×1 — first asked 2026-09-01 07:02:22Z; still absent
- `/bot/text/html%2Capplication/xhtml%2Bxml%2Capplication/xml%3Bq%3D0.9%2C*/*%3Bq%3D0.8` — 404×1 — first asked 2026-09-01 07:02:22Z; still absent
- `/data/APIEvangelist-AddAPI-Control/1.0%20(%2Bhttps%3A/apis.io)` — 404×1 — first asked 2026-09-01 07:02:48Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20archive.org_bot%20%2Bhttp%3A/archive.org/details/archive.org_bot)%20Zeno/d3712ae%20warc/v0.8.99` — 404×1 — first asked 2026-09-01 07:02:48Z; still absent
- `/data/Mozilla/5.0%20AppleWebKit/537.36%20(KHTML%2C%20like%20Gecko%3B%20compatible%3B%20ClaudeBot/1.0%3B%20%2Bclaudebot%40anthropic.com)` — 404×1 — first asked 2026-09-01 07:02:48Z; still absent
- `/data/text/html%2Capplication/xhtml%2Bxml%2Capplication/xml%3Bq%3D0.9%2C*/*%3Bq%3D0.8` — 404×1 — first asked 2026-09-01 07:02:48Z; still absent
- `/data/apis.io-submit/1.0%20(%2Bhttps%3A/apis.io)` — 404×1 — first asked 2026-09-01 07:02:48Z; still absent
- `/data/Mozilla/5.0%20AppleWebKit/537.36%20(KHTML%2C%20like%20Gecko%3B%20compatible%3B%20bingbot/2.0%3B%20%2Bhttp%3A/www.bing.com/bingbot.htm)%20Chrome/116.0.1938.76%20Safari/537.36` — 404×1 — first asked 2026-09-01 07:02:48Z; still absent
- `/data/AgentGrade/1.0%20(security%20research%3B%20agentgrade.net)` — 404×1 — first asked 2026-09-01 07:02:48Z; still absent
- `/data/agent-tools.cloud-crawler/0.1%20(%2Bhttps%3A/agent-tools.cloud)` — 404×1 — first asked 2026-09-01 07:02:48Z; still absent
- `/data/Deno/2.1.4%20(variant%3B%20SupabaseEdgeRuntime/1.74.3)` — 404×1 — first asked 2026-09-01 07:02:48Z; still absent
- `/data/lastseen-schema-probe/1.0%20(%2Bhttps%3A/lastseen.dev%3B%20introspection-only)` — 404×1 — first asked 2026-09-01 07:02:48Z; still absent
- `/data/hultra-link/1.0%20(%2Bhttps%3A/donnees.hultra.link/sondes.md)` — 404×1 — first asked 2026-09-01 07:02:48Z; still absent
- `/data/agent-tools.cloud-a2a/0.1%20(%2Bhttps%3A/agent-tools.cloud)` — 404×1 — first asked 2026-09-01 07:02:48Z; still absent
- `/data/application/json%2C%20text/event-stream%3Bq%3D0.9%2C%20*/*%3Bq%3D0.1` — 404×1 — first asked 2026-09-01 07:02:48Z; still absent
- `/data/MCPWatch/0.1.0%20(%2Bmcpwatch%40iyre.com)%20longitudinal%20MCP%20security%20research` — 404×1 — first asked 2026-09-01 07:02:48Z; still absent
- `/data/AgentReputationBot/1.0%20(%2Bhttps%3A/agentreputation.dev)` — 404×1 — first asked 2026-09-01 07:02:49Z; still absent
- `/data/mcp-schema-archive/1.0%20(%2Bhttps%3A/mcp-schema-archive.delfrost42.workers.dev)` — 404×1 — first asked 2026-09-01 07:02:49Z; still absent
- `/data/AgentIndexBot/0.1%20(%2Bhttps%3A/agents.traderszone.net%3B%20polite%20ARD%20crawler)` — 404×1 — first asked 2026-09-01 07:02:49Z; still absent
- `/data/x402-observatory/0.2%20(%2Bresearch%20collector%3B%20contact%3A%20300tsb%40gmail.com)` — 404×1 — first asked 2026-09-01 07:02:49Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20MCPCatalogSync/1.0)` — 404×1 — first asked 2026-09-01 07:02:49Z; still absent
- `/data/agent-guild-scout/1%20(%2Bhttps%3A/agent-guild-5d5r.onrender.com/.well-known/agent-guild.json)` — 404×1 — first asked 2026-09-01 07:02:49Z; still absent
- `/data/A2A-Registry-Smoke/1.0%20(%2Bhttps%3A/a2aregistry.org)` — 404×1 — first asked 2026-09-01 07:02:49Z; still absent
- `/data/mcp-observatory/0.1.0%20(%2Bhttps%3A/github.com/yhouta/mcp-observatory%3B%20public%20transparency%20log%3B%20contact%3A%20yassine.houta%40outlook.fr)` — 404×1 — first asked 2026-09-01 07:02:49Z; still absent
- `/data/SaSameAgentAudit/0.1%20(%2Bhttps%3A/live-vps.sasame.online/.well-known/agent-card.json)` — 404×1 — first asked 2026-09-01 07:02:49Z; still absent
- `/data/pip/24.3.1%20%7B%22ci%22%3Anull%2C%22cpu%22%3A%22x86_64%22%2C%22implementation%22%3A%7B%22name%22%3A%22CPython%22%2C%22version%22%3A%223.11.9%22%7D%2C%22installer%22%3A%7B%22name%22%3A%22pip%22%2C%22version%22%3A%2224.3.1%22%7D%2C%22openssl_version%22%3A%22OpenSSL%203.0.13%2030%20Jan%202024%22%2C%22python%22%3A%223.11.9%22%2C%22setuptools_version%22%3A%2275.6.0%22%2C%22system%22%3A%7B%22name%22%3A%22Linux%22%2C%22release%22%3A%226.8.0%22%7D%7D` — 404×1 — first asked 2026-09-01 07:02:49Z; still absent
- `/data/truespar-mcp-registry/0.1%20(%2Bhttps%3A/registry.truespar.com)` — 404×1 — first asked 2026-09-01 07:02:49Z; still absent
- `/data/application/json%2C%20application/a2a%2Bjson%3Bq%3D0.9` — 404×1 — first asked 2026-09-01 07:02:49Z; still absent
- `/data/AetherLinkDiscoveryEvidence/1.0%20(%2Bhttps%3A/aetherlink.47-85-186-77.sslip.io/llms.txt)` — 404×1 — first asked 2026-09-01 07:02:50Z; still absent
- `/data/api-forge-mcp-index/1.0%20(%2Bhttps%3A/api.temsor.com/mcp/index%3B%20iletisim%3A%20altyapi%40temsor.com)` — 404×1 — first asked 2026-09-01 07:02:50Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20AgentSure-MCPScan/0.1%3B%20%2Bhttps%3A/agentsure.tech)` — 404×1 — first asked 2026-09-01 07:02:50Z; still absent
- `/data/application/json%2Ctext/html%3Bq%3D0.9%2C*/*%3Bq%3D0.7` — 404×1 — first asked 2026-09-01 07:02:50Z; still absent
- `/data/Mozilla/5.0%20(Windows%20NT%2010.0%3B%20Win64%3B%20x64)%20AppleWebKit/537.36%20(KHTML%2C%20like%20Gecko)%20Chrome/151.0.0.0%20Safari/537.36` — 404×1 — first asked 2026-09-01 07:02:50Z; still absent
- `/data/Mozilla/5.0%20(iPhone%3B%20CPU%20iPhone%20OS%2013_2_3%20like%20Mac%20OS%20X)%20AppleWebKit/605.1.15%20(KHTML%2C%20like%20Gecko)%20Version/13.0.3%20Mobile/15E148%20Safari/604.1` — 404×1 — first asked 2026-09-01 07:02:50Z; still absent
- `/data/Mozilla/5.0%20(X11%3B%20Linux%20x86_64)%20AppleWebKit/537.36%20(KHTML%2C%20like%20Gecko)%20Chrome/148.0.0.0%20Safari/537.36` — 404×1 — first asked 2026-09-01 07:02:50Z; still absent
- `/data/Mozilla/5.0%20(Macintosh%3B%20Intel%20Mac%20OS%20X%2010_15_7)%20AppleWebKit/537.36%20(KHTML%2C%20like%20Gecko)%20Chrome/124.0.0.0%20Safari/537.36` — 404×1 — first asked 2026-09-01 07:02:50Z; still absent
- `/data/Mozilla/5.0%20(Linux%3B%20Android%2010%3B%20K)%20AppleWebKit/537.36%20(KHTML%2C%20like%20Gecko)%20Chrome/151.0.0.0%20Mobile%20Safari/537.36` — 404×1 — first asked 2026-09-01 07:02:50Z; still absent
- `/data/Mozilla/5.0%20(Windows%20NT%2010.0%3B%20Win64%3B%20x64)%20AppleWebKit/537.36%20(KHTML%2C%20like%20Gecko)%20Chrome/125.0.0.0%20Safari/537.36%20Edg/125.0.0.0` — 404×1 — first asked 2026-09-01 07:02:51Z; still absent
- `/data/Mozilla/5.0%20(Windows%20NT%2010.0%3B%20Win64%3B%20x64)%20AppleWebKit/537.36%20(KHTML%2C%20like%20Gecko)%20Chrome/144.0.0.0%20Safari/537.36` — 404×1 — first asked 2026-09-01 07:02:51Z; still absent
- `/data/Mozilla/5.0%20(Windows%20NT%2010.0)%20AppleWebKit/537.36%20(KHTML%2C%20like%20Gecko)%20Chrome/106.0.0.0%20Safari/537.36` — 404×1 — first asked 2026-09-01 07:02:51Z; still absent
- `/data/Mozilla/5.0%20(Macintosh%3B%20Intel%20Mac%20OS%20X%2010_10_1)%20AppleWebKit/600.2.5%20(KHTML%2C%20like%20Gecko)%20Version/8.0.2%20Safari/600.2.5%20(Gort)` — 404×1 — first asked 2026-09-01 07:02:51Z; still absent
- `/bot/AgentGrade/1.0%20(security%20research%3B%20agentgrade.net)` — 404×1 — first asked 2026-09-01 09:00:15Z; still absent
- `/bot/GPTBot/1.4` — 404×1 — first asked 2026-09-01 15:00:55Z; still absent
- `/data/Googlebot-Video/1.0` — 404×1 — first asked 2026-09-02 09:03:16Z; still absent
- `/data/GoogleOther-Image/1.0` — 404×1 — first asked 2026-09-02 09:03:18Z; still absent
- `/data/GoogleOther-Video/1.0` — 404×1 — first asked 2026-09-02 09:03:20Z; still absent
- `/crawler/Googlebot-Video/1.0` — 404×1 — first asked 2026-09-02 09:04:26Z; still absent
- `/crawler/GoogleOther-Image/1.0` — 404×1 — first asked 2026-09-02 09:04:26Z; still absent
- `/crawler/GoogleOther-Video/1.0` — 404×1 — first asked 2026-09-02 09:04:27Z; still absent
- `/data/Mozilla/5.0%20(Linux%3B%20Android%205.0%3B%20SM-G920A)%20AppleWebKit%20(KHTML%2C%20like%20Gecko)%20Chrome%20Mobile%20Safari%20(compatible%3B%20AdsBot-Google-Mobile%3B%20%2Bhttp%3A/www.google.com/mobile/adsbot.html)` — 404×1 — first asked 2026-09-02 09:04:29Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20Google-Site-Verification/1.0)` — 404×1 — first asked 2026-09-02 09:04:31Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20Google-CWS)` — 404×1 — first asked 2026-09-02 09:04:32Z; still absent
- `/data/Mozilla/5.0%20(X11%3B%20Linux%20x86_64)%20AppleWebKit/537.36%20(KHTML%2C%20like%20Gecko%3B%20compatible%3B%20Google-Agent%3B%20%2Bhttps%3A/developers.google.com/crawling/docs/crawlers-fetchers/google-agent)%20Chrome/W.X.Y.Z%20Safari/537.36` — 404×1 — first asked 2026-09-02 09:04:33Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20SiteAuditBot/0.97%3B%20%2Bhttp%3A/www.semrush.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:37Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20SemrushBot-BA%3B%20%2Bhttp%3A/www.semrush.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:37Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20SemrushBot-SI%3B%20%2Bhttp%3A/www.semrush.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:37Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20SemrushBot-SWA%3B%20%2Bhttp%3A/www.semrush.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:37Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20SplitSignalBot%3B%20%2Bhttp%3A/www.semrush.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:38Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20SemrushBot-FT%3B%20%2Bhttp%3A/www.semrush.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:38Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20SemrushBot-ESI%3B%20%2Bhttp%3A/www.semrush.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:38Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20DotBot/1.2%3B%20%2Bhttps%3A/opensiteexplorer.org/dotbot%3B%20help%40moz.com)` — 404×1 — first asked 2026-09-02 09:04:40Z; still absent
- `/data/rogerbot/1.2%20(http%3A/moz.com/help/pro/what-is-rogerbot-%2C%20rogerbot-crawler%40moz.com)` — 404×1 — first asked 2026-09-02 09:04:40Z; still absent
- `/data/serpstatbot/2.1%20(advanced%20backlink%20tracking%20bot%3B%20https%3A/serpstatbot.com/%3B%20abuse%40serpstatbot.com)` — 404×1 — first asked 2026-09-02 09:04:41Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20SEOkicks%3B%20%2Bhttps%3A/www.seokicks.de/robot.html)` — 404×1 — first asked 2026-09-02 09:04:41Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20MojeekBot/0.11%3B%20%2Bhttps%3A/www.mojeek.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:41Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20Pinterestbot/1.0%3B%20%2Bhttps%3A/www.pinterest.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:43Z; still absent
- `/data/Mozilla/5.0%20(compatible%3B%20panscient.com)` — 404×1 — first asked 2026-09-02 09:04:44Z; still absent
- `/data/AwarioSmartBot/1.0%20(%2Bhttps%3A/awario.com/bots.html%3B%20bots%40awario.com)` — 404×1 — first asked 2026-09-02 09:04:50Z; still absent
- `/data/AwarioRssBot/1.0%20(%2Bhttps%3A/awario.com/bots.html%3B%20bots%40awario.com)` — 404×1 — first asked 2026-09-02 09:04:51Z; still absent
- `/crawler/Mozilla/5.0%20(Linux%3B%20Android%205.0%3B%20SM-G920A)%20AppleWebKit%20(KHTML%2C%20like%20Gecko)%20Chrome%20Mobile%20Safari%20(compatible%3B%20AdsBot-Google-Mobile%3B%20%2Bhttp%3A/www.google.com/mobile/adsbot.html)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/Mozilla/5.0%20(compatible%3B%20Google-Site-Verification/1.0)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/Mozilla/5.0%20(X11%3B%20Linux%20x86_64)%20AppleWebKit/537.36%20(KHTML%2C%20like%20Gecko%3B%20compatible%3B%20Google-Agent%3B%20%2Bhttps%3A/developers.google.com/crawling/docs/crawlers-fetchers/google-agent)%20Chrome/W.X.Y.Z%20Safari/537.36` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/Mozilla/5.0%20(compatible%3B%20Google-CWS)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/Mozilla/5.0%20(compatible%3B%20SiteAuditBot/0.97%3B%20%2Bhttp%3A/www.semrush.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/Mozilla/5.0%20(compatible%3B%20SemrushBot-SWA%3B%20%2Bhttp%3A/www.semrush.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/Mozilla/5.0%20(compatible%3B%20SemrushBot-BA%3B%20%2Bhttp%3A/www.semrush.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/Mozilla/5.0%20(compatible%3B%20SemrushBot-SI%3B%20%2Bhttp%3A/www.semrush.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/Mozilla/5.0%20(compatible%3B%20SplitSignalBot%3B%20%2Bhttp%3A/www.semrush.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/Mozilla/5.0%20(compatible%3B%20SemrushBot-ESI%3B%20%2Bhttp%3A/www.semrush.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/Mozilla/5.0%20(compatible%3B%20DotBot/1.2%3B%20%2Bhttps%3A/opensiteexplorer.org/dotbot%3B%20help%40moz.com)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/Mozilla/5.0%20(compatible%3B%20SemrushBot-FT%3B%20%2Bhttp%3A/www.semrush.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/rogerbot/1.2%20(http%3A/moz.com/help/pro/what-is-rogerbot-%2C%20rogerbot-crawler%40moz.com)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/serpstatbot/2.1%20(advanced%20backlink%20tracking%20bot%3B%20https%3A/serpstatbot.com/%3B%20abuse%40serpstatbot.com)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/Mozilla/5.0%20(compatible%3B%20SEOkicks%3B%20%2Bhttps%3A/www.seokicks.de/robot.html)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/Mozilla/5.0%20(compatible%3B%20MojeekBot/0.11%3B%20%2Bhttps%3A/www.mojeek.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/Mozilla/5.0%20(compatible%3B%20Pinterestbot/1.0%3B%20%2Bhttps%3A/www.pinterest.com/bot.html)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/AwarioRssBot/1.0%20(%2Bhttps%3A/awario.com/bots.html%3B%20bots%40awario.com)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/AwarioSmartBot/1.0%20(%2Bhttps%3A/awario.com/bots.html%3B%20bots%40awario.com)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/crawler/Mozilla/5.0%20(compatible%3B%20panscient.com)` — 404×1 — first asked 2026-09-02 09:04:58Z; still absent
- `/message/send%20(the%20v1.0%20name%20SendMessage%20is%20accepted%20too)` — 404×1 — first asked 2026-09-04 21:31:17Z; still absent
- `/bot/image/avif%2Cimage/webp%2Cimage/apng%2Cimage/svg%2Bxml%2Cimage/*%2C*/*%3Bq%3D0.8` — 404×1 — first asked 2026-09-05 21:15:38Z; still absent
- `/bot/text/html%2Capplication/xhtml%2Bxml%2Capplication/xml%3Bq%3D0.9%2Cimage/avif%2Cimage/webp%2Cimage/apng%2C*/*%3Bq%3D0.8%2Capplication/signed-exchange%3Bv%3Db3%3Bq%3D0.7` — 404×1 — first asked 2026-09-05 21:15:38Z; still absent
- `/bot/Amazonbot/0.1` — 404×1 — first asked 2026-09-09 00:09:01Z; still absent
- `/bot/Mozilla/5.0%20AppleWebKit/537.36%20(KHTML%2C%20like%20Gecko%3B%20compatible%3B%20Amazonbot/0.1%3B%20%2Bhttps%3A/developer.amazon.com/support/amazonbot)%20Chrome/119.0.6045.214%20Safari/537.36` — 404×1 — first asked 2026-09-09 00:09:06Z; still absent

## Verification

no published verification methodFrom the crawler record at /crawler/archive-org-bot.html, which cites https://archive.org/details/archive.org_bot — one source for both pages.

## Ask this page a question, with one GET

A question about this page, answered by a call you can make right now — no key, no account, no JSON-RPC, nothing to assemble. The query string is already filled in with this page's own subject.

- **What is Mozilla/5.0 (compatible; archive.org_bot +htt…?**  
  `curl -s 'https://www.pathwren.workers.dev/tools/classify-ua?ua=Mozilla%2F5.0%20%28compatible%3B%20archive.org_bot%20%2Bhttp%3A%2F%2Farchive.org%2Fdetails%2Farchive.org_bot%29%20Zeno%2Fd3712ae%20warc%2Fv0.8.99&s=client-dossiers'`  
  This exact user-agent run through the catalogue: which crawler it is, who operates it, what the crawl is for, what blocking it costs — or an honest "not recognised" if it is nobody we know.

Every parameter above is a value the endpoint reads, not an address it visits: nothing is fetched on your behalf. Called without any parameter, each endpoint returns its own specification instead of an error.


## What it publishes about you

Not observed. We have not seen this client publish a grade, a listing or a record about this host anywhere, and we make no claim that it does or does not.

## Documentation it names

http://archive.org/details/archive.org_bot

JSON: https://www.pathwren.workers.dev/bot/archive-org-bot.json · all clients: https://www.pathwren.workers.dev/data/observed-clients.json