# Who crawls a small AI-agent site

> 72 named clients, 1541 external requests, 2026-08-31 20:58:11Z to 2026-09-01 06:16:32Z UTC. Generated 2026-09-01 from one host's own log.

| client | requests | addresses | paths | 404s | first seen | last seen |
|---|---|---|---|---|---|---|
| [ClaudeBot](/bot/claudebot.md) | 504 | 2 | 368 | 0 | 2026-09-01 00:46:32Z | 2026-09-01 06:15:19Z |
| [archive.org_bot](/bot/archive-org-bot.md) | 327 | 2 | 270 | 0 | 2026-08-31 20:58:34Z | 2026-09-01 03:00:09Z |
| [YandexBot](/bot/yandexbot.md) | 71 | 65 | 66 | 0 | 2026-08-31 20:58:12Z | 2026-09-01 06:16:32Z |
| [AgentGrade](/bot/agentgrade.md) | 67 | 1 | 18 | 14 | 2026-09-01 02:53:17Z | 2026-09-01 02:53:29Z |
| [SentinelOracle](/bot/sentineloracle.md) | 45 | 1 | 1 | 0 | 2026-09-01 01:24:24Z | 2026-09-01 06:13:32Z |
| [node](/bot/node.md) | 37 | 13 | 9 | 3 | 2026-08-31 22:49:52Z | 2026-09-01 06:16:12Z |
| [AgentDisco](/bot/agentdisco.md) | 30 | 1 | 29 | 18 | 2026-09-01 02:28:30Z | 2026-09-01 02:28:41Z |
| [mcpbeat](/bot/mcpbeat.md) | 22 | 1 | 4 | 2 | 2026-09-01 01:43:38Z | 2026-09-01 06:12:16Z |
| [Orbit-MCP-Registry-IconResolver](/bot/orbit-mcp-registry-iconresolver.md) | 18 | 4 | 4 | 0 | 2026-08-31 22:09:49Z | 2026-09-01 00:38:25Z |
| [apis.io-submit](/bot/apis-io-submit.md) | 13 | 2 | 13 | 0 | 2026-08-31 21:21:01Z | 2026-08-31 21:23:53Z |
| [python-httpx2](/bot/python-httpx2.md) | 12 | 2 | 4 | 0 | 2026-08-31 22:15:20Z | 2026-09-01 02:49:04Z |
| [GuzzleHttp](/bot/guzzlehttp.md) | 10 | 4 | 4 | 3 | 2026-08-31 22:09:48Z | 2026-09-01 05:04:08Z |
| [GolemreachTrustBot](/bot/golemreachtrustbot.md) | 9 | 1 | 3 | 2 | 2026-09-01 00:48:12Z | 2026-09-01 05:49:08Z |
| [402explorer](/bot/402explorer.md) | 8 | 1 | 4 | 0 | 2026-09-01 04:08:29Z | 2026-09-01 05:18:37Z |
| [A2A-Registry-HealthCheck](/bot/a2a-registry-healthcheck.md) | 8 | 2 | 1 | 0 | 2026-09-01 02:52:12Z | 2026-09-01 06:01:36Z |
| [bingbot](/bot/bingbot.md) | 8 | 6 | 8 | 0 | 2026-08-31 20:58:11Z | 2026-09-01 01:55:09Z |
| [Mozilla](/bot/mozilla.md) | 8 | 3 | 8 | 7 | 2026-09-01 02:49:36Z | 2026-09-01 02:56:57Z |
| [undici](/bot/undici.md) | 8 | 3 | 4 | 3 | 2026-09-01 00:36:09Z | 2026-09-01 03:21:12Z |
| [AgentTrust-Monitor](/bot/agenttrust-monitor.md) | 7 | 1 | 1 | 1 | 2026-09-01 03:08:31Z | 2026-09-01 06:14:31Z |
| [Deno](/bot/deno.md) | 7 | 6 | 4 | 0 | 2026-08-31 22:30:06Z | 2026-09-01 02:34:00Z |
| [AgenstryBot](/bot/agenstrybot.md) | 6 | 1 | 6 | 3 | 2026-09-01 04:28:51Z | 2026-09-01 04:28:51Z |
| [exaforce-mcprep](/bot/exaforce-mcprep.md) | 6 | 2 | 3 | 2 | 2026-08-31 22:32:28Z | 2026-09-01 03:23:58Z |
| [hultra-link](/bot/hultra-link.md) | 6 | 2 | 6 | 0 | 2026-08-31 22:10:04Z | 2026-09-01 03:10:04Z |
| [MCPWatch](/bot/mcpwatch.md) | 6 | 1 | 3 | 0 | 2026-09-01 03:49:49Z | 2026-09-01 03:50:30Z |
| [movanas-registry-snapshot](/bot/movanas-registry-snapshot.md) | 6 | 1 | 3 | 0 | 2026-08-31 22:43:36Z | 2026-08-31 23:06:09Z |
| [ProofBench](/bot/proofbench.md) | 6 | 1 | 4 | 0 | 2026-08-31 22:17:01Z | 2026-09-01 05:48:07Z |
| [Go-http-client](/bot/go-http-client.md) | 5 | 1 | 4 | 0 | 2026-08-31 23:00:06Z | 2026-09-01 04:11:39Z |
| [io.verifymcp](/bot/io-verifymcp.md) | 5 | 1 | 4 | 0 | 2026-08-31 23:00:06Z | 2026-09-01 04:11:39Z |
| [lastseen-schema-probe](/bot/lastseen-schema-probe.md) | 5 | 1 | 4 | 0 | 2026-09-01 06:12:51Z | 2026-09-01 06:12:52Z |
| [mcp-registry](/bot/mcp-registry.md) | 5 | 2 | 1 | 0 | 2026-08-31 22:02:23Z | 2026-09-01 02:29:08Z |
| [VerifyMCP-OwnersBot](/bot/verifymcp-ownersbot.md) | 5 | 1 | 5 | 4 | 2026-08-31 23:12:20Z | 2026-09-01 04:12:18Z |
| [agent-tools.cloud-crawler](/bot/agent-tools-cloud-crawler.md) | 4 | 1 | 4 | 0 | 2026-09-01 03:55:53Z | 2026-09-01 04:10:46Z |
| [AgentIndexBot](/bot/agentindexbot.md) | 4 | 1 | 3 | 0 | 2026-09-01 04:07:21Z | 2026-09-01 04:26:51Z |
| [AgentReputationBot](/bot/agentreputationbot.md) | 3 | 1 | 3 | 0 | 2026-09-01 03:47:16Z | 2026-09-01 03:47:36Z |
| [Enerlio](/bot/enerlio.md) | 3 | 1 | 1 | 0 | 2026-09-01 01:07:45Z | 2026-09-01 01:07:47Z |
| [GPTBot](/bot/gptbot.md) | 3 | 2 | 3 | 0 | 2026-09-01 05:23:47Z | 2026-09-01 05:28:35Z |
| [mcp-checker](/bot/mcp-checker.md) | 3 | 1 | 3 | 0 | 2026-09-01 05:31:12Z | 2026-09-01 05:31:19Z |
| [mcp-observatory](/bot/mcp-observatory.md) | 3 | 1 | 3 | 0 | 2026-09-01 03:08:29Z | 2026-09-01 03:08:30Z |
| [mcp-schema-archive](/bot/mcp-schema-archive.md) | 3 | 1 | 3 | 0 | 2026-09-01 03:37:27Z | 2026-09-01 03:37:27Z |
| [MCPCatalogSync](/bot/mcpcatalogsync.md) | 3 | 3 | 1 | 0 | 2026-09-01 01:36:35Z | 2026-09-01 01:54:15Z |
| [measure-mcp-schema](/bot/measure-mcp-schema.md) | 3 | 1 | 3 | 0 | 2026-09-01 03:33:48Z | 2026-09-01 03:33:48Z |
| [utopian-foundry-probe](/bot/utopian-foundry-probe.md) | 3 | 1 | 3 | 0 | 2026-09-01 06:12:38Z | 2026-09-01 06:12:39Z |
| [x402-observatory](/bot/x402-observatory.md) | 3 | 1 | 3 | 0 | 2026-09-01 06:13:13Z | 2026-09-01 06:13:13Z |
| [a2a-directory-liveness](/bot/a2a-directory-liveness.md) | 2 | 1 | 2 | 0 | 2026-09-01 02:27:27Z | 2026-09-01 02:27:27Z |
| [A2A-Registry-Smoke](/bot/a2a-registry-smoke.md) | 2 | 1 | 2 | 0 | 2026-09-01 02:25:59Z | 2026-09-01 02:25:59Z |
| [AetherLink-Public-Discovery-Evidence](/bot/aetherlink-public-discovery-evidence.md) | 2 | 1 | 2 | 0 | 2026-09-01 04:00:04Z | 2026-09-01 04:01:16Z |
| [agent-guild-scout](/bot/agent-guild-scout.md) | 2 | 1 | 1 | 0 | 2026-09-01 04:15:17Z | 2026-09-01 04:29:21Z |
| [EndpointAudit](/bot/endpointaudit.md) | 2 | 1 | 2 | 0 | 2026-09-01 01:54:55Z | 2026-09-01 01:54:55Z |
| [GF-Agent-Toll-Outbound](/bot/gf-agent-toll-outbound.md) | 2 | 1 | 2 | 0 | 2026-09-01 02:56:53Z | 2026-09-01 02:56:53Z |
| [GF-Agent-Toll-Remediation](/bot/gf-agent-toll-remediation.md) | 2 | 1 | 2 | 0 | 2026-09-01 03:03:03Z | 2026-09-01 03:03:03Z |
| [mcpscan](/bot/mcpscan.md) | 2 | 1 | 2 | 0 | 2026-09-01 02:28:50Z | 2026-09-01 02:28:50Z |
| [pip](/bot/pip.md) | 2 | 1 | 2 | 0 | 2026-09-01 06:13:45Z | 2026-09-01 06:13:45Z |
| [python-httpx](/bot/python-httpx.md) | 2 | 2 | 2 | 0 | 2026-08-31 22:44:55Z | 2026-09-01 02:53:55Z |
| [ReactorNetty](/bot/reactornetty.md) | 2 | 2 | 2 | 0 | 2026-08-31 20:58:14Z | 2026-09-01 05:00:10Z |
| [SaSameAgentAudit](/bot/sasameagentaudit.md) | 2 | 1 | 2 | 1 | 2026-09-01 01:06:44Z | 2026-09-01 01:06:44Z |
| [TelegramBot](/bot/telegrambot.md) | 2 | 2 | 2 | 0 | 2026-09-01 05:44:24Z | 2026-09-01 05:44:25Z |
| [truespar-mcp-registry](/bot/truespar-mcp-registry.md) | 2 | 1 | 2 | 0 | 2026-09-01 02:28:06Z | 2026-09-01 02:28:29Z |
| [a2a-directory-discovery](/bot/a2a-directory-discovery.md) | 1 | 1 | 1 | 0 | 2026-09-01 02:27:27Z | 2026-09-01 02:27:27Z |
| [A2A-Registry](/bot/a2a-registry.md) | 1 | 1 | 1 | 0 | 2026-09-01 02:25:59Z | 2026-09-01 02:25:59Z |
| [AetherLink-Public-Agent-Card-Policy-Check](/bot/aetherlink-public-agent-card-policy-check.md) | 1 | 1 | 1 | 0 | 2026-09-01 03:13:23Z | 2026-09-01 03:13:23Z |
| [AetherLinkDiscoveryEvidence](/bot/aetherlinkdiscoveryevidence.md) | 1 | 1 | 1 | 0 | 2026-09-01 03:30:37Z | 2026-09-01 03:30:37Z |
| [AgentSure-MCPScan](/bot/agentsure-mcpscan.md) | 1 | 1 | 1 | 0 | 2026-09-01 00:24:23Z | 2026-09-01 00:24:23Z |
| [api-forge-mcp-index](/bot/api-forge-mcp-index.md) | 1 | 1 | 1 | 0 | 2026-09-01 01:29:04Z | 2026-09-01 01:29:04Z |
| [Conway-Replicatio-r91-strict-a2a-probe](/bot/conway-replicatio-r91-strict-a2a-probe.md) | 1 | 1 | 1 | 0 | 2026-09-01 04:56:01Z | 2026-09-01 04:56:01Z |
| [curl](/bot/curl.md) | 1 | 1 | 1 | 0 | 2026-09-01 02:28:30Z | 2026-09-01 02:28:30Z |
| [MCPMeter](/bot/mcpmeter.md) | 1 | 1 | 1 | 0 | 2026-08-31 23:48:38Z | 2026-08-31 23:48:38Z |
| [PackageHound](/bot/packagehound.md) | 1 | 1 | 1 | 0 | 2026-09-01 06:13:51Z | 2026-09-01 06:13:51Z |
| [SaSame-Census-Era-Probe](/bot/sasame-census-era-probe.md) | 1 | 1 | 1 | 0 | 2026-09-01 01:07:30Z | 2026-09-01 01:07:30Z |
| [SaSame-MCP-Audit](/bot/sasame-mcp-audit.md) | 1 | 1 | 1 | 0 | 2026-09-01 01:07:30Z | 2026-09-01 01:07:30Z |
| [TAR-Directory-Indexer](/bot/tar-directory-indexer.md) | 1 | 1 | 1 | 0 | 2026-09-01 03:27:40Z | 2026-09-01 03:27:40Z |
| [TAR-Discovery](/bot/tar-discovery.md) | 1 | 1 | 1 | 0 | 2026-09-01 03:41:21Z | 2026-09-01 03:41:21Z |
| [TAR-Health](/bot/tar-health.md) | 1 | 1 | 1 | 0 | 2026-09-01 03:41:21Z | 2026-09-01 03:41:21Z |

Whole set: https://www.pathwren.workers.dev/data/observed-clients.json
Our own traffic is excluded: 1554 rows self-marked, 6 flagged as our own model-fetch tool.