ShapBot

Parallel · AI search crawlers · json

User-agent: ShapBot
Disallow: /


robots.txt token	`ShapBot`
User-agent contains	`ShapBot`
Operator	Parallel
Category	AI search crawlers
robots.txt	obeys robots.txt (documented)
Verify by	no published verification method

What it is

Parallel's crawler. It collects and structures web content to power the search, extraction and deep-research APIs that Parallel sells to agent builders.

What blocking it costs you

Agents using Parallel's research API lose you as a source. Parallel documents robots.txt compliance, so a rule works.

Full user-agent string

ShapBot

Allow it instead

User-agent: ShapBot
Allow: /

Operator documentation: https://docs.parallel.ai/features/crawler
Machine copies: json · markdown
Policies that name this crawler: allow-all · block-all-ai · allow-ai-search-only · maximum-ai-visibility