What this client asked www.pathwren.workers.dev for, when, and what it got.
Every number below is from this host's own server-side request log, 2026-09-02 02:31:06Z to 2026-09-02 02:34:43Z UTC.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ShapBot/0.1.0
346 request(s) from 7 distinct address(es), 314 distinct path(s), first seen 2026-09-02 02:31:06Z, last seen 2026-09-02 02:34:43Z UTC. 1 separate visit(s), counting a gap of more than 30 minutes as a new one.
The crawler catalogue on this site has a record for it: /crawler/shapbot.html — what it is for, and what blocking it costs. This page is only what it did here.
| user-agent | requests | addresses | first seen | last seen |
|---|---|---|---|---|
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ShapBot/0.1.0 | 346 | 7 | 2026-09-02 02:31:06Z | 2026-09-02 02:34:43Z |
First request to each path, oldest first, first 40 shown.
| # | path | at (UTC) | status |
|---|---|---|---|
| 1 | /mcp-doctor.html | 2026-09-02 02:31:06Z | 200 |
| 2 | /mcp-triage.html | 2026-09-02 02:31:07Z | 200 |
| 3 | / | 2026-09-02 02:31:07Z | 200 |
| 4 | /data | 2026-09-02 02:31:07Z | 404 |
| 5 | /mcp-robots.html | 2026-09-02 02:31:07Z | 200 |
| 6 | /bot | 2026-09-02 02:31:07Z | 404 |
| 7 | /mcp-netcheck.html | 2026-09-02 02:31:10Z | 200 |
| 8 | /operator | 2026-09-02 02:31:12Z | 404 |
| 9 | /crawler | 2026-09-02 02:31:12Z | 404 |
| 10 | /px.gif | 2026-09-02 02:31:12Z | 200 |
| 11 | /favicon.ico | 2026-09-02 02:31:14Z | 200 |
| 12 | /policy | 2026-09-02 02:31:46Z | 404 |
| 13 | /status.html | 2026-09-02 02:32:16Z | 200 |
| 14 | /api.html | 2026-09-02 02:32:18Z | 200 |
| 15 | /mcp.html | 2026-09-02 02:32:19Z | 200 |
| 16 | /about.html | 2026-09-02 02:32:19Z | 200 |
| 17 | /register | 2026-09-02 02:32:19Z | 200 |
| 18 | /reference | 2026-09-02 02:32:20Z | 200 |
| 19 | /security.html | 2026-09-02 02:32:20Z | 200 |
| 20 | /privacy.html | 2026-09-02 02:32:20Z | 200 |
| 21 | /ip-ranges | 2026-09-02 02:32:21Z | 404 |
| 22 | /terms.html | 2026-09-02 02:32:21Z | 200 |
| 23 | /crawler/gptbot.html | 2026-09-02 02:32:21Z | 200 |
| 24 | /crawler/oai-searchbot.html | 2026-09-02 02:32:21Z | 200 |
| 25 | /crawler/claudebot.html | 2026-09-02 02:32:22Z | 200 |
| 26 | /crawler/claude-searchbot.html | 2026-09-02 02:32:22Z | 200 |
| 27 | /crawler/google-extended.html | 2026-09-02 02:32:22Z | 200 |
| 28 | /crawler/perplexitybot.html | 2026-09-02 02:32:23Z | 200 |
| 29 | /crawler/ccbot.html | 2026-09-02 02:32:23Z | 200 |
| 30 | /crawler/bytespider.html | 2026-09-02 02:32:23Z | 200 |
| 31 | /category/search.html | 2026-09-02 02:32:24Z | 200 |
| 32 | /category/ai-training.html | 2026-09-02 02:32:24Z | 200 |
| 33 | /crawler/index.html | 2026-09-02 02:32:24Z | 200 |
| 34 | /category/tool.html | 2026-09-02 02:32:25Z | 200 |
| 35 | /category/ai-search.html | 2026-09-02 02:32:25Z | 200 |
| 36 | /category/dataset.html | 2026-09-02 02:32:27Z | 200 |
| 37 | /category/seo.html | 2026-09-02 02:32:27Z | 200 |
| 38 | /category/user-fetch.html | 2026-09-02 02:32:27Z | 200 |
| 39 | /category/preview.html | 2026-09-02 02:32:28Z | 200 |
| 40 | /category/archive.html | 2026-09-02 02:32:28Z | 200 |
| path | requests | status codes | first | last |
|---|---|---|---|---|
/favicon.ico | 7 | 200×7 | 2026-09-02 02:31:14Z | 2026-09-02 02:34:43Z |
/px.gif | 6 | 200×6 | 2026-09-02 02:31:12Z | 2026-09-02 02:33:19Z |
/.well-known/oauth-authorization-server | 2 | 404×2 | 2026-09-02 02:33:30Z | 2026-09-02 02:34:35Z |
/bot | 2 | 404×2 | 2026-09-02 02:31:07Z | 2026-09-02 02:32:19Z |
/crawler | 2 | 404×2 | 2026-09-02 02:31:12Z | 2026-09-02 02:31:30Z |
/crawler/anomura.html | 2 | 200×2 | 2026-09-02 02:33:13Z | 2026-09-02 02:33:14Z |
/crawler/ccbot.md | 2 | 200×2 | 2026-09-02 02:33:32Z | 2026-09-02 02:33:33Z |
/crawler/googleother-image.html | 2 | 200×2 | 2026-09-02 02:32:50Z | 2026-09-02 02:32:51Z |
/crawler/isscyberriskcrawler.html | 2 | 200×2 | 2026-09-02 02:33:11Z | 2026-09-02 02:33:12Z |
/crawler/quillbot.html | 2 | 200×2 | 2026-09-02 02:33:12Z | 2026-09-02 02:33:13Z |
/crawler/serpstatbot.html | 2 | 200×2 | 2026-09-02 02:33:05Z | 2026-09-02 02:33:06Z |
/crawler/slackbot-linkexpanding.html | 2 | 200×2 | 2026-09-02 02:33:07Z | 2026-09-02 02:33:08Z |
/data | 2 | 404×2 | 2026-09-02 02:31:07Z | 2026-09-02 02:31:11Z |
/ip-ranges | 2 | 404×2 | 2026-09-02 02:32:21Z | 2026-09-02 02:33:17Z |
/ip-ranges/all.txt | 2 | 200×2 | 2026-09-02 02:33:31Z | 2026-09-02 02:33:32Z |
/ip-ranges/bing-bingbot.txt | 2 | 200×2 | 2026-09-02 02:33:32Z | 2026-09-02 02:33:33Z |
/operator | 2 | 404×2 | 2026-09-02 02:31:12Z | 2026-09-02 02:32:01Z |
/operator/anthropic.html | 2 | 200×2 | 2026-09-02 02:33:17Z | 2026-09-02 02:33:18Z |
/operator/ceramic.html | 2 | 200×2 | 2026-09-02 02:33:21Z | 2026-09-02 02:33:22Z |
/operator/commoncrawl.html | 2 | 200×2 | 2026-09-02 02:33:20Z | 2026-09-02 02:33:21Z |
/operator/internetarchive.html | 2 | 200×2 | 2026-09-02 02:33:23Z | 2026-09-02 02:33:24Z |
/operator/webz.html | 2 | 200×2 | 2026-09-02 02:33:28Z | 2026-09-02 02:33:29Z |
/policy | 2 | 404×2 | 2026-09-02 02:31:46Z | 2026-09-02 02:33:11Z |
/ | 1 | 200×1 | 2026-09-02 02:31:07Z | 2026-09-02 02:31:07Z |
/.well-known/api-catalog | 1 | 200×1 | 2026-09-02 02:32:35Z | 2026-09-02 02:32:35Z |
/.well-known/api-onboarding | 1 | 200×1 | 2026-09-02 02:32:35Z | 2026-09-02 02:32:35Z |
/.well-known/security.txt | 1 | 200×1 | 2026-09-02 02:33:30Z | 2026-09-02 02:33:30Z |
/a2a.html | 1 | 200×1 | 2026-09-02 02:33:31Z | 2026-09-02 02:33:31Z |
/about.html | 1 | 200×1 | 2026-09-02 02:32:19Z | 2026-09-02 02:32:19Z |
/api.html | 1 | 200×1 | 2026-09-02 02:32:18Z | 2026-09-02 02:32:18Z |
/bot/apievangelist.html | 1 | 200×1 | 2026-09-02 02:33:16Z | 2026-09-02 02:33:16Z |
/bot/archive-org-bot.html | 1 | 200×1 | 2026-09-02 02:32:29Z | 2026-09-02 02:32:29Z |
/bot/claudebot.html | 1 | 200×1 | 2026-09-02 02:32:29Z | 2026-09-02 02:32:29Z |
/bot/claudebot.md | 1 | 200×1 | 2026-09-02 02:33:33Z | 2026-09-02 02:33:33Z |
/bot/gptbot.html | 1 | 200×1 | 2026-09-02 02:32:29Z | 2026-09-02 02:32:29Z |
/bot/node.html | 1 | 200×1 | 2026-09-02 02:32:30Z | 2026-09-02 02:32:30Z |
/bot/sentineloracle.html | 1 | 200×1 | 2026-09-02 02:32:30Z | 2026-09-02 02:32:30Z |
/bot/yandexbot.html | 1 | 200×1 | 2026-09-02 02:32:30Z | 2026-09-02 02:32:30Z |
/bot/yandexbot.md | 1 | 200×1 | 2026-09-02 02:33:33Z | 2026-09-02 02:33:33Z |
/category/ai-search.html | 1 | 200×1 | 2026-09-02 02:32:25Z | 2026-09-02 02:32:25Z |
/category/ai-training.html | 1 | 200×1 | 2026-09-02 02:32:24Z | 2026-09-02 02:32:24Z |
/category/archive.html | 1 | 200×1 | 2026-09-02 02:32:28Z | 2026-09-02 02:32:28Z |
/category/dataset.html | 1 | 200×1 | 2026-09-02 02:32:27Z | 2026-09-02 02:32:27Z |
/category/preview.html | 1 | 200×1 | 2026-09-02 02:32:28Z | 2026-09-02 02:32:28Z |
/category/search.html | 1 | 200×1 | 2026-09-02 02:32:24Z | 2026-09-02 02:32:24Z |
/category/seo.html | 1 | 200×1 | 2026-09-02 02:32:27Z | 2026-09-02 02:32:27Z |
/category/tool.html | 1 | 200×1 | 2026-09-02 02:32:25Z | 2026-09-02 02:32:25Z |
/category/user-fetch.html | 1 | 200×1 | 2026-09-02 02:32:27Z | 2026-09-02 02:32:27Z |
/crawler/adsbot-google-mobile-apps.html | 1 | 200×1 | 2026-09-02 02:32:52Z | 2026-09-02 02:32:52Z |
/crawler/adsbot-google-mobile.html | 1 | 200×1 | 2026-09-02 02:32:52Z | 2026-09-02 02:32:52Z |
/crawler/adsbot-google.html | 1 | 200×1 | 2026-09-02 02:32:51Z | 2026-09-02 02:32:51Z |
/crawler/ahrefsbot.html | 1 | 200×1 | 2026-09-02 02:32:47Z | 2026-09-02 02:32:47Z |
/crawler/ahrefssiteaudit.html | 1 | 200×1 | 2026-09-02 02:33:04Z | 2026-09-02 02:33:04Z |
/crawler/ai2bot-dolma.html | 1 | 200×1 | 2026-09-02 02:33:31Z | 2026-09-02 02:33:31Z |
/crawler/ai2bot.html | 1 | 200×1 | 2026-09-02 02:32:43Z | 2026-09-02 02:32:43Z |
/crawler/aihitbot.html | 1 | 200×1 | 2026-09-02 02:33:14Z | 2026-09-02 02:33:14Z |
/crawler/aiwebindex.html | 1 | 200×1 | 2026-09-02 02:33:13Z | 2026-09-02 02:33:13Z |
/crawler/amazonbot.html | 1 | 200×1 | 2026-09-02 02:32:42Z | 2026-09-02 02:32:42Z |
/crawler/andibot.html | 1 | 200×1 | 2026-09-02 02:33:13Z | 2026-09-02 02:33:13Z |
/crawler/anthropic-ai.html | 1 | 200×1 | 2026-09-02 02:32:36Z | 2026-09-02 02:32:36Z |
254 further paths are in the JSON.
| path it asked for | what it got | first asked | since then |
|---|---|---|---|
/data | 404×2 | 2026-09-02 02:31:07Z | answers 200 since 2026-09-02 03:05:05Z |
/bot | 404×2 | 2026-09-02 02:31:07Z | answers 200 since 2026-09-02 03:05:05Z |
/operator | 404×2 | 2026-09-02 02:31:12Z | answers 200 since 2026-09-02 03:05:05Z |
/crawler | 404×2 | 2026-09-02 02:31:12Z | answers 200 since 2026-09-02 03:05:06Z |
/policy | 404×2 | 2026-09-02 02:31:46Z | answers 200 since 2026-09-02 03:05:55Z |
/ip-ranges | 404×2 | 2026-09-02 02:32:21Z | answers 200 since 2026-09-02 03:05:06Z |
/.well-known/oauth-authorization-server | 404×2 | 2026-09-02 02:33:30Z | still absent — on purpose: No |
no published verification method
From the crawler record at /crawler/shapbot.html, which cites https://docs.parallel.ai/features/crawler — one source for both pages.
Not observed. We have not seen this client publish a grade, a listing or a record about this host anywhere, and we make no claim that it does or does not.
Not observed. It carries no URL and no contact address in its user-agent, so there is nowhere documented to ask what it is.
curl -s https://www.pathwren.workers.dev/bot/shapbot.json curl -s https://www.pathwren.workers.dev/data/observed-clients.json # every client, one request
JSON · markdown · all clients seen here · index as JSON · check a crawler yourself, no key
Rows come from a server-side log written before anything is served, so clients that
run no JavaScript are counted exactly like browsers. The window is the whole life of the log,
2026-09-02 02:31:06Z to 2026-09-02 02:34:43Z UTC, and it is stated on every number because a count without a window is
not a fact. Addresses are stored as salted hashes and counted, never printed. Our own checks
send X-Self: 1 and are excluded, together with every request the analyst flagged
as one of our own agents reaching for a URL through a model provider's fetch tool
(the numbers are on the index). Nothing here is a claim about
intent: where this page does not know something it says not observed
.