LAION / img2dataset · Corpus and dataset builders · json
User-agent: LAIONDownloader Disallow: /
| robots.txt token | LAIONDownloader |
| User-agent contains | LAIONDownloader |
| Operator | LAION / img2dataset |
| Category | Corpus and dataset builders |
| robots.txt | not governed by robots.txt (user-initiated, by operator policy) |
| Verify by | no published verification method |
LAION's downloader, used to materialise the image and text datasets the non-profit publishes for machine-learning research. LAION's own FAQ is the source for its robots.txt position.
Your media is skipped when an open research dataset is built from URL lists. Once a dataset is published, a later block does not remove you from it.
LAIONDownloader
User-agent: LAIONDownloader Allow: /
Operator documentation: https://laion.ai/faq/
Machine copies: json ·
markdown
Policies that name this crawler:
allow-all · block-all-ai · block-datasets · block-disputed · maximum-ai-visibility