.shop websites and AI crawlers
Of 504 readable .shop sites in the census, 7.3% disallow GPTBot and 7.1% disallow ClaudeBot.
| Site | Popularity | robots.txt | Read on |
|---|---|---|---|
| gastromedix.shop | Top 10,000 | none disallowed | 2026-10-10 |
| bupropion150mg.shop | Top 10,000 | none disallowed | 2026-10-10 |
| seolinkagency.shop | Top 100,000 | none disallowed | 2026-10-10 |
| wandering.shop | Top 100,000 | 1 disallowed | 2026-10-10 |