# Googlebot

> The classic search crawler. It is also the crawler behind AI Overviews: Google does not run a separate bot for them, which is why the only AI opt-out is the Google-Extended token and not a Googlebot block.

| field | value |
|---|---|
| operator | Google |
| category | Search engines |
| robots.txt token | `Googlebot` |
| user-agent contains | `Googlebot` |
| robots.txt | obeys robots.txt (documented) |
| verify by | published IP ranges |
| published IP ranges | https://developers.google.com/static/search/apis/ipranges/googlebot.json |
| prefixes mirrored | 169 IPv4 / 146 IPv6 |
| operator docs | https://developers.google.com/search/docs/crawling-indexing/overview-google-crawlers |
| last reviewed | 2026-09-01 |

## What blocking it costs you

Total. You leave Google Search. Never block this to avoid AI use; use Google-Extended instead.

## Full user-agent string

```
Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
```

## Block it

```
User-agent: Googlebot
Disallow: /
```

## Allow it

```
User-agent: Googlebot
Allow: /
```

JSON: https://www.pathwren.workers.dev/crawler/googlebot.json · index: https://www.pathwren.workers.dev/llms.txt