Linguee Bot

Linguee · AI training crawlers · json

User-agent: Linguee Bot
Disallow: /


robots.txt token	`Linguee Bot`
User-agent contains	`Linguee Bot`
Operator	Linguee
Category	AI training crawlers
robots.txt	compliance disputed
Verify by	no published verification method

What it is

Gathers bilingual text for Linguee's translation corpus and the machine translation trained on it. Recorded in the ai.robots.txt dataset as not respecting robots.txt.

What blocking it costs you

Multilingual pages stop feeding a translation corpus. If your site is translated, being in it is usually a benefit.

Full user-agent string

Linguee Bot

Allow it instead

User-agent: Linguee Bot
Allow: /

Operator documentation: https://www.linguee.com
Machine copies: json · markdown
Policies that name this crawler: allow-all · block-ai-training · block-all-ai · block-disputed · maximum-ai-visibility