Google · Tools and frameworks · json
User-agent: Google-CWS Disallow: /
| robots.txt token | Google-CWS |
| User-agent contains | Google-CWS |
| Operator | |
| Category | Tools and frameworks |
| robots.txt | not governed by robots.txt (user-initiated, by operator policy) |
| Verify by | published IP ranges |
| Published ranges | 529 IPv4 + 529 IPv6 · json · source |
The Chrome Web Store fetcher. It requests the URLs a developer put in the metadata of a Chrome extension or theme. Google publishes fetcher addresses in two files — user-triggered-fetchers.json and user-triggered-fetchers-google.json — and does not say per fetcher which one applies, so verification means checking both; this index mirrors both.
Chrome Web Store listings that point at your pages cannot fetch them. Relevant only if you publish extensions.
Mozilla/5.0 (compatible; Google-CWS)
User-agent: Google-CWS Allow: /
Operator documentation: https://developers.google.com/search/docs/crawling-indexing/google-user-triggered-fetchers
Machine copies: json ·
markdown
Policies that name this crawler:
allow-all · block-disputed · maximum-ai-visibility