.es websites and AI crawlers

Of 385 readable .es sites in the census, 18.7% disallow GPTBot and 17.4% disallow ClaudeBot.

SitePopularityrobots.txtRead on
google.esTop 1,000none disallowed2026-10-10
aepd.esTop 1,000none disallowed2026-10-10
amazon.esTop 10,00018 disallowed2026-10-10
elmundo.esTop 10,0006 disallowed2026-10-10
boe.esTop 10,000none disallowed2026-10-10
rtve.esTop 10,000none disallowed2026-10-10
abc.esTop 10,00016 disallowed2026-10-10
blogspot.com.esTop 10,000no robots.txt rules2026-10-10
csic.esTop 10,000none disallowed2026-10-10
ucm.esTop 10,000no robots.txt rules2026-10-10
20minutos.esTop 10,00011 disallowed2026-10-10
eldiario.esTop 10,000none disallowed2026-10-10
europapress.esTop 10,000none disallowed2026-10-10
upm.esTop 10,000none disallowed2026-10-10
rae.esTop 10,000none disallowed2026-10-10
ugr.esTop 10,000none disallowed2026-10-10
juntadeandalucia.esTop 10,000none disallowed2026-10-10
upv.esTop 10,000none disallowed2026-10-10
pinterest.esTop 10,00018 disallowed2026-10-10
cervantes.esTop 10,00020 disallowed2026-10-10
larazon.esTop 10,0009 disallowed2026-10-10
tripadvisor.esTop 10,0009 disallowed2026-10-10
arsys.esTop 10,000none disallowed2026-10-10
usal.esTop 10,0001 disallowed2026-10-10
ine.esTop 10,000none disallowed2026-10-10
unizar.esTop 10,000none disallowed2026-10-10
publico.esTop 10,000none disallowed2026-10-10
uam.esTop 10,000none disallowed2026-10-10
um.esTop 10,000none disallowed2026-10-10
ifema.esTop 10,000none disallowed2026-10-10
museodelprado.esTop 10,0001 disallowed2026-10-10
lavozdegalicia.esTop 10,000none disallowed2026-10-10
isciii.esTop 10,000none disallowed2026-10-10
uva.esTop 10,000none disallowed2026-10-10
cope.esTop 10,0009 disallowed2026-10-10
telecinco.esTop 10,000none disallowed2026-10-10
jcyl.esTop 10,000none disallowed2026-10-10
ehu.esTop 10,000none disallowed2026-10-10
dgt.esTop 10,000none disallowed2026-10-10
bde.esTop 10,000none disallowed2026-10-10
elsevier.esTop 10,0007 disallowed2026-10-10
huffingtonpost.esTop 10,000none disallowed2026-10-10
bne.esTop 10,000none disallowed2026-10-10
uclm.esTop 10,000no robots.txt rules2026-10-10
eventbrite.esTop 10,0001 disallowed2026-10-10
uniovi.esTop 10,000none disallowed2026-10-10
heraldo.esTop 10,00011 disallowed2026-10-10
webnode.esTop 10,000no robots.txt rules2026-10-10
museoreinasofia.esTop 10,000none disallowed2026-10-10
ondacero.esTop 50,000none disallowed2026-10-10
uco.esTop 50,00020 disallowed2026-10-10
ebay.esTop 50,0008 disallowed2026-10-10
ulpgc.esTop 50,0003 disallowed2026-10-10
uvigo.esTop 50,0005 disallowed2026-10-10
lasprovincias.esTop 50,00016 disallowed2026-10-10
diariosur.esTop 50,00016 disallowed2026-10-10
udc.esTop 50,0001 disallowed2026-10-10
diariodesevilla.esTop 50,00015 disallowed2026-10-10
ideal.esTop 50,00016 disallowed2026-10-10
sepe.esTop 50,00012 disallowed2026-10-10
laverdad.esTop 50,00016 disallowed2026-10-10
orange.esTop 50,000none disallowed2026-10-10
cnmc.esTop 50,0008 disallowed2026-10-10
businessinsider.esTop 50,00011 disallowed2026-10-10
vogue.esTop 50,00016 disallowed2026-10-10
crea-tuweb.esTop 50,00012 disallowed2026-10-10
elcomercio.esTop 50,00016 disallowed2026-10-10
umh.esTop 50,0008 disallowed2026-10-10
carrefour.esTop 50,000none disallowed2026-10-10
diariodenavarra.esTop 50,0006 disallowed2026-10-10
ultimahora.esTop 50,00011 disallowed2026-10-10
elnortedecastilla.esTop 50,00013 disallowed2026-10-10
icex.esTop 50,000none disallowed2026-10-10
movistar.esTop 50,000none disallowed2026-10-10
hoy.esTop 50,00016 disallowed2026-10-10
aecid.esTop 50,000none disallowed2026-10-10
upc.esTop 50,000none disallowed2026-10-10
thelocal.esTop 50,0008 disallowed2026-10-10
canarias7.esTop 50,00013 disallowed2026-10-10
canalsur.esTop 50,0003 disallowed2026-10-10
elpais.esTop 50,0009 disallowed2026-10-10
airbnb.esTop 50,0003 disallowed2026-10-10
casabatllo.esTop 50,000none disallowed2026-10-10
unavarra.esTop 50,00015 disallowed2026-10-10
eldiariomontanes.esTop 50,00016 disallowed2026-10-10
doctoralia.esTop 50,000none disallowed2026-10-10
lavanguardia.esTop 50,0004 disallowed2026-10-10
ticketmaster.esTop 50,0001 disallowed2026-10-10
oepm.esTop 50,000none disallowed2026-10-10
diariodeleon.esTop 50,0006 disallowed2026-10-10
newtral.esTop 50,0002 disallowed2026-10-10
sevillafc.esTop 50,0009 disallowed2026-10-10
infolibre.esTop 50,0007 disallowed2026-10-10
decathlon.esTop 50,000none disallowed2026-10-10
traveler.esTop 50,00016 disallowed2026-10-10
diariodecadiz.esTop 50,00011 disallowed2026-10-10
once.esTop 50,000none disallowed2026-10-10
leroymerlin.esTop 50,000none disallowed2026-10-10
revistavanityfair.esTop 50,00016 disallowed2026-10-10
fotogramas.esTop 50,0003 disallowed2026-10-10
lavuelta.esTop 50,0001 disallowed2026-10-10
dri.esTop 50,000none disallowed2026-10-10
malagahoy.esTop 50,00011 disallowed2026-10-10
movistarplus.esTop 50,000none disallowed2026-10-10
mediamarkt.esTop 50,000none disallowed2026-10-10
realbetisbalompie.esTop 50,000none disallowed2026-10-10
lavozdigital.esTop 50,00016 disallowed2026-10-10
abogacia.esTop 50,0003 disallowed2026-10-10
lavozdeasturias.esTop 50,000none disallowed2026-10-10
topdoctors.esTop 50,0001 disallowed2026-10-10
randstad.esTop 50,0002 disallowed2026-10-10
gettyimages.esTop 50,000none disallowed2026-10-10
igme.esTop 50,000none disallowed2026-10-10
consalud.esTop 50,00010 disallowed2026-10-10
merca2.esTop 100,000none disallowed2026-10-10
revistaad.esTop 100,00016 disallowed2026-10-10
puntadas.esTop 100,0001 disallowed2026-10-10
elprogreso.esTop 100,00012 disallowed2026-10-10
iagua.esTop 100,00011 disallowed2026-10-10
diariodeburgos.esTop 100,00018 disallowed2026-10-10
ceu.esTop 100,000none disallowed2026-10-10
iberley.esTop 100,0002 disallowed2026-10-10
motor.esTop 100,000none disallowed2026-10-10
blogspot.esTop 100,00020 disallowed2026-10-10
billionairespin.esTop 100,0001 disallowed2026-10-10
tourspain.esTop 100,000none disallowed2026-10-10
skyscanner.esTop 100,0001 disallowed2026-10-10
kayak.esTop 100,000none disallowed2026-10-10
yorokobu.esTop 100,000none disallowed2026-10-10
ucv.esTop 100,000none disallowed2026-10-10
technologyreview.esTop 100,000none disallowed2026-10-10
diariodealmeria.esTop 100,00010 disallowed2026-10-10
vlex.esTop 100,0004 disallowed2026-10-10
rtvc.esTop 100,000none disallowed2026-10-10
europasur.esTop 100,00011 disallowed2026-10-10
eurosport.esTop 100,000none disallowed2026-10-10
bet365.esTop 100,000none disallowed2026-10-10
axa.esTop 100,000none disallowed2026-10-10
eldiadecordoba.esTop 100,00011 disallowed2026-10-10
uchceu.esTop 100,0004 disallowed2026-10-10
huelvainformacion.esTop 100,00011 disallowed2026-10-10