Preservation crawlers. Their output is public and permanent, which makes them a separate decision from the AI one.
| Crawler | Token | Operator | Cost of blocking |
|---|---|---|---|
| archive.org_bot | archive.org_bot | Internet Archive | Your site stops being preserved. When it dies, it is gone. Consider this one separately fr… |
| ia_archiver | ia_archiver | Internet Archive | Negligible today; retain for tidiness.… |