Majestic · SEO and backlink crawlers · json
User-agent: MJ12bot Disallow: /
| robots.txt token | MJ12bot |
| User-agent contains | MJ12bot |
| Operator | Majestic |
| Category | SEO and backlink crawlers |
| robots.txt | obeys robots.txt (documented) |
| Verify by | no published verification method |
Majestic's link-graph crawler, run as a distributed community project. Majestic states plainly that it cannot restrict the bot to a fixed set of addresses, and offers a pre-arranged ident string in the request headers instead.
You leave the Majestic backlink index. No search or AI effect. It supports Crawl-delay, which is usually the better answer than a block.
Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/)
User-agent: MJ12bot Allow: /
Operator documentation: https://mj12bot.com/
Machine copies: json ·
markdown
Policies that name this crawler:
allow-all · block-seo-tools