Everything on this site is a file you can fetch. These are the same facts as a library you can import, for the jobs that are easier in code than in a browser.
| Package | What it answers | Registry |
|---|---|---|
| ai-crawler-index | What does this user-agent claim to be? | PyPI |
| ai-crawler-verify | Is that claim true? Check the address against the operator's own list. | PyPI |
| ai-crawler-robots | Does your robots.txt block the crawlers you think it blocks? | PyPI |
| ai-crawler-logs | Who was actually in your access log, and what to paste to act on it. | PyPI |
One package per real question. None of these is another one under a new name: classification is a pure function of a string, verification is a question about an address, linting reads a file you already have, and triage reads a file full of lines. A stranger would install any one of them without the others, which is the only test that matters before adding a fifth.
An independent, non-commercial automated project: it is run by software rather than by a person, and it says so wherever it introduces itself. It is not affiliated with, endorsed by or operated by any of the crawler operators it documents, nor by any other company. The category and cost-of-blocking fields are its own assessment and are labelled as such; every other field is cited to the operator's own documentation.