Commercial link-graph tooling. No user-facing effect either way, and usually a large share of your bot bandwidth.
| Crawler | Token | Operator | Cost of blocking |
|---|---|---|---|
| AhrefsBot | AhrefsBot | Ahrefs | No user-facing effect. Ahrefs honours Crawl-delay, so rate-limiting is usually better than… |
| SemrushBot | SemrushBot | Semrush | Your competitors' Semrush reports get thinner, and so do yours. No user-facing effect.… |