.info websites and AI crawlers

Of 219 readable .info sites in the census, 10.0% disallow GPTBot and 8.2% disallow ClaudeBot.

SitePopularityrobots.txtRead on
worldometers.infoTop 10,000none disallowed2026-10-10
keepass.infoTop 10,000no robots.txt rules2026-10-10
spain.infoTop 10,000none disallowed2026-10-10
mta.infoTop 10,000none disallowed2026-10-10
mobirise.infoTop 10,000none disallowed2026-10-10
patient.infoTop 10,000none disallowed2026-10-10
steamdb.infoTop 10,000none disallowed2026-10-10
texy.infoTop 10,000none disallowed2026-10-10
d-nb.infoTop 10,000none disallowed2026-10-10
austria.infoTop 10,000none disallowed2026-10-10
wien.infoTop 10,0001 disallowed2026-10-10
ajol.infoTop 10,0001 disallowed2026-10-10
blockchain.infoTop 10,000none disallowed2026-10-10
marc.infoTop 50,00021 disallowed2026-10-10
ddai.infoTop 50,00010 disallowed2026-10-10
korben.infoTop 50,00011 disallowed2026-10-10
worlddata.infoTop 50,0009 disallowed2026-10-10
selectra.infoTop 50,0003 disallowed2026-10-10
innsbruck.infoTop 50,000none disallowed2026-10-10
jota.infoTop 50,000none disallowed2026-10-10
unian.infoTop 50,000none disallowed2026-10-10
glavred.infoTop 50,000none disallowed2026-10-10
i-programmer.infoTop 50,0005 disallowed2026-10-10
doska.infoTop 50,000none disallowed2026-10-10
boss.infoTop 50,0002 disallowed2026-10-10
energy-charts.infoTop 50,000none disallowed2026-10-10
asiaplustj.infoTop 100,00011 disallowed2026-10-10
skiresort.infoTop 100,0007 disallowed2026-10-10
notre-planete.infoTop 100,00014 disallowed2026-10-10
biolink.infoTop 100,0002 disallowed2026-10-10
smplayer.infoTop 100,000none disallowed2026-10-10
prohoster.infoTop 100,000none disallowed2026-10-10
firstonline.infoTop 100,00011 disallowed2026-10-10
rspec.infoTop 100,0001 disallowed2026-10-10
policecontrol.infoTop 100,0003 disallowed2026-10-10
ansamed.infoTop 100,00012 disallowed2026-10-10
codecheck.infoTop 100,000none disallowed2026-10-10