# SemrushBot

What this client asked https://www.pathwren.workers.dev for, from that host's own request log.
Window: 2026-09-03 20:46:28Z to 2026-09-03 20:46:34Z UTC. Generated 2026-09-04.

## User-agent strings, exactly as they arrived

- `Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)` — 4 request(s), 3 address(es), 2026-09-03 20:46:28Z to 2026-09-03 20:46:34Z

- Requests: 4
- Distinct addresses (salted hashes, never published): 3
- Distinct paths: 4
- Visits (30-minute gap rule): 1
- Status codes: 200×4
- Accept headers: */*, text/html, application/rss+xml, application/atom+xml, text/xml, text/rss+xml, application/xhtml+xml
- Our classifier called it: crawler×4 (ours, from the user-agent)

## What it asked for, in order

1. `/robots.txt` — 2026-09-03 20:46:28Z — 200
2. `/` — 2026-09-03 20:46:29Z — 200
3. `/index.html` — 2026-09-03 20:46:32Z — 200
4. `/sitemap.xml` — 2026-09-03 20:46:34Z — 200

## What it asked for that did not exist

Nothing.

## Verification

reverse DNSFrom the crawler record at /crawler/semrushbot.html, which cites https://www.semrush.com/bot/ — one source for both pages.

## What it publishes about you

Not observed. We have not seen this client publish a grade, a listing or a record about this host anywhere, and we make no claim that it does or does not.

## Documentation it names

http://www.semrush.com/bot.html

JSON: https://www.pathwren.workers.dev/bot/semrushbot.json · all clients: https://www.pathwren.workers.dev/data/observed-clients.json
