2 crawler(s) · json
| Crawler | Token | Category | robots.txt |
|---|---|---|---|
| AwarioRssBot | AwarioRssBot | Corpus and dataset builders | obeys robots.txt (documented) |
| AwarioSmartBot | AwarioSmartBot | Corpus and dataset builders | obeys robots.txt (documented) |
Documentation: https://awario.com/bots.html