ClaudeBot (Anthropic)

Anthropic's bulk crawler, gathering pages that may be used to train Claude models. Blocking it costs you: Content excluded from training data for future Claude models. No effect on Claude's ability to fetch a link a user gives it. robots.txt token: ClaudeBot.