.nl websites and AI crawlers

Of 1,203 readable .nl sites in the census, 45.5% disallow GPTBot and 43.4% disallow ClaudeBot.

SitePopularityrobots.txtRead on
google.nlTop 1,000none disallowed2026-10-10
cwi.nlTop 10,000none disallowed2026-10-10
uu.nlTop 10,000none disallowed2026-10-10
hostnet.nlTop 10,000none disallowed2026-10-10
uva.nlTop 10,000no robots.txt rules2026-10-10
tudelft.nlTop 10,000none disallowed2026-10-10
rug.nlTop 10,000none disallowed2026-10-10
rijksoverheid.nlTop 10,000none disallowed2026-10-10
autoriteitpersoonsgegevens.nlTop 10,0001 disallowed2026-10-10
utwente.nlTop 10,000none disallowed2026-10-10
transip.nlTop 10,000none disallowed2026-10-10
nos.nlTop 10,00015 disallowed2026-10-10
tue.nlTop 10,000none disallowed2026-10-10
vu.nlTop 10,000none disallowed2026-10-10
wur.nlTop 10,000none disallowed2026-10-10
ad.nlTop 10,00015 disallowed2026-10-10
ru.nlTop 10,000no robots.txt rules2026-10-10
nrc.nlTop 10,00019 disallowed2026-10-10
telegraaf.nlTop 10,00018 disallowed2026-10-10
blogspot.nlTop 10,000none disallowed2026-10-10
volkskrant.nlTop 10,00017 disallowed2026-10-10
nu.nlTop 10,00015 disallowed2026-10-10
rijksmuseum.nlTop 10,000none disallowed2026-10-10
cbs.nlTop 10,000none disallowed2026-10-10
government.nlTop 10,000none disallowed2026-10-10
belastingdienst.nlTop 10,000none disallowed2026-10-10
eur.nlTop 10,000none disallowed2026-10-10
jwwb.nlTop 10,000no robots.txt rules2026-10-10
primary.jwwb.nlTop 10,000no robots.txt rules2026-10-10
rtl.nlTop 10,00020 disallowed2026-10-10
rivm.nlTop 10,0005 disallowed2026-10-10
maps.google.nlTop 10,000none disallowed2026-10-10
amsterdam.nlTop 10,00021 disallowed2026-10-10
nltimes.nlTop 10,0005 disallowed2026-10-10
trouw.nlTop 10,00017 disallowed2026-10-10
amazon.nlTop 10,00018 disallowed2026-10-10
maastrichtuniversity.nlTop 10,000none disallowed2026-10-10
jouwweb.nlTop 10,000none disallowed2026-10-10
rvo.nlTop 10,000none disallowed2026-10-10
vangoghmuseum.nlTop 10,000none disallowed2026-10-10
dutchnews.nlTop 10,0001 disallowed2026-10-10
tno.nlTop 10,000none disallowed2026-10-10
npo.nlTop 10,000none disallowed2026-10-10
ns.nlTop 10,000none disallowed2026-10-10
kvk.nlTop 10,000none disallowed2026-10-10
marktplaats.nlTop 10,000none disallowed2026-10-10
doxygen.nlTop 10,000none disallowed2026-10-10
parool.nlTop 10,00017 disallowed2026-10-10
anwb.nlTop 10,000none disallowed2026-10-10
consumentenbond.nlTop 10,000none disallowed2026-10-10
rtlnieuws.nlTop 10,00020 disallowed2026-10-10
vpro.nlTop 10,0005 disallowed2026-10-10
politie.nlTop 10,000none disallowed2026-10-10
startpagina.nlTop 10,000none disallowed2026-10-10
bnnvara.nlTop 10,000none disallowed2026-10-10
schiphol.nlTop 10,000none disallowed2026-10-10
knmi.nlTop 10,000none disallowed2026-10-10
avrotros.nlTop 10,000no robots.txt rules2026-10-10
fd.nlTop 50,00019 disallowed2026-10-10
nporadio1.nlTop 50,0001 disallowed2026-10-10
bnr.nlTop 50,0005 disallowed2026-10-10
gelderlander.nlTop 50,00015 disallowed2026-10-10
eventbrite.nlTop 50,0001 disallowed2026-10-10
veiliginternetten.nlTop 50,000none disallowed2026-10-10
omroepbrabant.nlTop 50,000none disallowed2026-10-10
tripadvisor.nlTop 50,0009 disallowed2026-10-10
ed.nlTop 50,00015 disallowed2026-10-10
destentor.nlTop 50,00015 disallowed2026-10-10
emerce.nlTop 50,000none disallowed2026-10-10
decorrespondent.nlTop 50,00012 disallowed2026-10-10
bd.nlTop 50,00015 disallowed2026-10-10
hccnet.nlTop 50,0001 disallowed2026-10-10
dvhn.nlTop 50,00018 disallowed2026-10-10
afm.nlTop 50,000none disallowed2026-10-10
keukenhof.nlTop 50,00019 disallowed2026-10-10
groene.nlTop 50,00020 disallowed2026-10-10
netherlandsandyou.nlTop 50,0001 disallowed2026-10-10
ebay.nlTop 50,0008 disallowed2026-10-10
at5.nlTop 50,00010 disallowed2026-10-10
autoweek.nlTop 50,000none disallowed2026-10-10
bndestem.nlTop 50,00015 disallowed2026-10-10
limburger.nlTop 50,00018 disallowed2026-10-10
naturalis.nlTop 50,0001 disallowed2026-10-10
nen.nlTop 50,0001 disallowed2026-10-10
rtvutrecht.nlTop 50,00019 disallowed2026-10-10
rtvnoord.nlTop 50,00019 disallowed2026-10-10
tubantia.nlTop 50,00015 disallowed2026-10-10
trimbos.nlTop 50,000none disallowed2026-10-10
independer.nlTop 50,0001 disallowed2026-10-10
nhnieuws.nlTop 50,00010 disallowed2026-10-10
pzc.nlTop 50,00015 disallowed2026-10-10
boijmans.nlTop 50,000none disallowed2026-10-10
beeldengeluid.nlTop 50,000none disallowed2026-10-10
omroepwest.nlTop 50,00019 disallowed2026-10-10
eyefilm.nlTop 50,000none disallowed2026-10-10
rtvdrenthe.nlTop 50,00019 disallowed2026-10-10
zoover.nlTop 50,000none disallowed2026-10-10
fontys.nlTop 50,000none disallowed2026-10-10
nd.nlTop 50,00020 disallowed2026-10-10
computable.nlTop 50,000none disallowed2026-10-10
managementboek.nlTop 50,0001 disallowed2026-10-10
noordhollandsdagblad.nlTop 50,00018 disallowed2026-10-10
ticketmaster.nlTop 50,0001 disallowed2026-10-10
lc.nlTop 50,00018 disallowed2026-10-10
indebuurt.nlTop 50,00015 disallowed2026-10-10
kadaster.nlTop 50,000none disallowed2026-10-10
rtvoost.nlTop 50,00019 disallowed2026-10-10
ftm.nlTop 50,00011 disallowed2026-10-10
zorgkaartnederland.nlTop 50,000none disallowed2026-10-10
omropfryslan.nlTop 50,00019 disallowed2026-10-10
paradiso.nlTop 50,0001 disallowed2026-10-10
rd.nlTop 50,00020 disallowed2026-10-10
binnenlandsbestuur.nlTop 50,0001 disallowed2026-10-10
delpher.nlTop 50,00020 disallowed2026-10-10
nautilus99.nlTop 50,0008 disallowed2026-10-10
encyclo.nlTop 50,0001 disallowed2026-10-10
nn.nlTop 50,000none disallowed2026-10-10
airbnb.nlTop 50,0003 disallowed2026-10-10
mediamarkt.nlTop 50,0006 disallowed2026-10-10
omroepzeeland.nlTop 50,00019 disallowed2026-10-10
adformatie.nlTop 50,0001 disallowed2026-10-10
gld.nlTop 50,00019 disallowed2026-10-10
npo3fm.nlTop 50,0001 disallowed2026-10-10
quotenet.nlTop 50,0003 disallowed2026-10-10
nporadio2.nlTop 50,0001 disallowed2026-10-10
noord-holland.nlTop 50,000none disallowed2026-10-10
omroepgelderland.nlTop 50,00019 disallowed2026-10-10
iex.nlTop 50,00019 disallowed2026-10-10
operaballet.nlTop 50,0002 disallowed2026-10-10
prorail.nlTop 50,000none disallowed2026-10-10
intermediair.nlTop 50,0001 disallowed2026-10-10
milieudefensie.nlTop 50,000none disallowed2026-10-10
beslist.nlTop 50,0002 disallowed2026-10-10
jeugdjournaal.nlTop 50,00015 disallowed2026-10-10
libelle.nlTop 50,00014 disallowed2026-10-10
sp.nlTop 50,000none disallowed2026-10-10
mvrdv.nlTop 50,000none disallowed2026-10-10
vinos-de-espana.nlTop 50,0001 disallowed2026-10-10
bibliotheek.nlTop 50,0008 disallowed2026-10-10
rkd.nlTop 50,0001 disallowed2026-10-10
mastodon.nlTop 100,0001 disallowed2026-10-10
l1.nlTop 100,00019 disallowed2026-10-10
nvm.nlTop 100,000none disallowed2026-10-10
q-park.nlTop 100,000none disallowed2026-10-10
onderzoeksraad.nlTop 100,0008 disallowed2026-10-10
boreasgroningen.nlTop 100,0001 disallowed2026-10-10
zalando.nlTop 100,0008 disallowed2026-10-10
medischcontact.nlTop 100,0007 disallowed2026-10-10
nationalgeographic.nlTop 100,0003 disallowed2026-10-10
roompot.nlTop 100,000none disallowed2026-10-10
voetbalzone.nlTop 100,00013 disallowed2026-10-10
mijnwoordenboek.nlTop 100,0001 disallowed2026-10-10
cda.nlTop 100,000none disallowed2026-10-10
hpdetijd.nlTop 100,0004 disallowed2026-10-10
rtlz.nlTop 100,00020 disallowed2026-10-10
architectenweb.nlTop 100,000none disallowed2026-10-10
autoscout24.nlTop 100,0005 disallowed2026-10-10
quiztimes.nlTop 100,0004 disallowed2026-10-10
rodi.nlTop 100,0004 disallowed2026-10-10
leiden.nlTop 100,000none disallowed2026-10-10
hebban.nlTop 100,00020 disallowed2026-10-10
rotterdamsklimaatakkoord.nlTop 100,0003 disallowed2026-10-10
webcambabes.nlTop 100,0008 disallowed2026-10-10
cz.nlTop 100,000none disallowed2026-10-10
expert.nlTop 100,000none disallowed2026-10-10
decathlon.nlTop 100,000none disallowed2026-10-10
nationalevacaturebank.nlTop 100,0001 disallowed2026-10-10
nationaleombudsman.nlTop 100,0001 disallowed2026-10-10
leidschdagblad.nlTop 100,00018 disallowed2026-10-10
vzinfo.nlTop 100,0005 disallowed2026-10-10
knmg.nlTop 100,0003 disallowed2026-10-10
haarlemsdagblad.nlTop 100,00018 disallowed2026-10-10
beeksebergen.nlTop 100,000none disallowed2026-10-10
wielerflits.nlTop 100,0007 disallowed2026-10-10
arnhem.nlTop 100,0001 disallowed2026-10-10
amsterdammuseum.nlTop 100,0001 disallowed2026-10-10
drimble.nlTop 100,0001 disallowed2026-10-10
genealogieonline.nlTop 100,0001 disallowed2026-10-10
vluchtelingenwerk.nlTop 100,0001 disallowed2026-10-10
quest.nlTop 100,0003 disallowed2026-10-10
nporadio5.nlTop 100,0001 disallowed2026-10-10
cobouw.nlTop 100,0002 disallowed2026-10-10