# SemrushBot-OCOB

> Semrush's separately-tokenised crawler for its AI content tooling, split out so SEO crawling and AI reuse can be answered differently.

| field | value |
|---|---|
| operator | Semrush |
| category | AI training crawlers |
| robots.txt token | `SemrushBot-OCOB` |
| user-agent contains | `SemrushBot-OCOB` |
| robots.txt | obeys robots.txt (documented) |
| verify by | reverse DNS |
| published IP ranges | none published |
| prefixes mirrored | 0 IPv4 / 0 IPv6 |
| operator docs | https://www.semrush.com/bot/ |
| last reviewed | 2026-09-01 |

## What blocking it costs you

Exclusion from Semrush's AI corpus, with its SEO crawl unaffected.

## Full user-agent string

```
Mozilla/5.0 (compatible; SemrushBot-OCOB/1.0; +http://www.semrush.com/bot.html)
```

## Block it

```
User-agent: SemrushBot-OCOB
Disallow: /
```

## Allow it

```
User-agent: SemrushBot-OCOB
Allow: /
```

JSON: https://www.pathwren.workers.dev/crawler/semrushbot-ocob.json · index: https://www.pathwren.workers.dev/llms.txt