Moz

2 crawler(s) · json

CrawlerTokenCategoryrobots.txt
DotBotdotbotSEO and backlink crawlersobeys robots.txt (documented)
rogerbotrogerbotSEO and backlink crawlersobeys robots.txt (documented)

Documentation: https://moz.com/help/moz-procedures/crawlers/dotbot