Generated from the same records as everything else, so they cannot drift from the index.
| Snippet | What it does |
|---|---|
| nginx: classify and block by user-agent | A map block that turns the user-agent into a category, so you can rate-limit training crawlers, allow AI search, and 403 the disputed ones without maintaining three separate if-chains. |
| Caddy: block by user-agent | A Caddy matcher plus respond directive. Caddy's header_regexp matcher is case-sensitive, so the pattern is written with an inline (?i) flag. |
| Apache: .htaccess block | BrowserMatchNoCase plus a Require expression. Works on shared hosting where you cannot edit the main config. |
| Cloudflare Worker: classify at the edge | Fetches this index's regex list at the edge and tags every request with a category header, so your origin can log AI traffic without shipping a bot list to every app. |
| Python: classify a request | Forty lines that load agents.json and return the category, operator and robots token for a user-agent string. The shape most log pipelines need. |