.edu websites and AI crawlers

Of 1,188 readable .edu sites in the census, 3.5% disallow GPTBot and 2.5% disallow ClaudeBot.

SitePopularityrobots.txtRead on
mit.eduTop 1,000none disallowed2026-10-10
harvard.eduTop 1,000none disallowed2026-10-10
stanford.eduTop 1,000none disallowed2026-10-10
berkeley.eduTop 1,000none disallowed2026-10-10
cornell.eduTop 1,000none disallowed2026-10-10
princeton.eduTop 1,000none disallowed2026-10-10
washington.eduTop 1,000none disallowed2026-10-10
academia.eduTop 1,00014 disallowed2026-10-10
columbia.eduTop 1,000none disallowed2026-10-10
yale.eduTop 1,000none disallowed2026-10-10
umich.eduTop 1,000none disallowed2026-10-10
upenn.eduTop 1,000none disallowed2026-10-10
psu.eduTop 1,000none disallowed2026-10-10
uci.eduTop 1,000no robots.txt rules2026-10-10
cmu.eduTop 1,000none disallowed2026-10-10
uchicago.eduTop 1,000none disallowed2026-10-10
ucla.eduTop 1,000none disallowed2026-10-10
wisc.eduTop 1,000none disallowed2026-10-10
si.eduTop 1,000none disallowed2026-10-10
utexas.eduTop 1,000none disallowed2026-10-10
uiuc.eduTop 1,000none disallowed2026-10-10
web.mit.eduTop 1,000none disallowed2026-10-10
nyu.eduTop 1,00011 disallowed2026-10-10
ucsd.eduTop 1,000none disallowed2026-10-10
purdue.eduTop 1,000none disallowed2026-10-10
ufl.eduTop 1,000none disallowed2026-10-10
usc.eduTop 1,000none disallowed2026-10-10
duke.eduTop 1,000none disallowed2026-10-10
umd.eduTop 1,0003 disallowed2026-10-10
ucdavis.eduTop 1,000none disallowed2026-10-10
unc.eduTop 1,000none disallowed2026-10-10
illinois.eduTop 1,000none disallowed2026-10-10
msu.eduTop 1,000none disallowed2026-10-10
northwestern.eduTop 1,000none disallowed2026-10-10
asu.eduTop 1,000none disallowed2026-10-10
colorado.eduTop 1,000none disallowed2026-10-10
arizona.eduTop 1,000none disallowed2026-10-10
virginia.eduTop 1,000no robots.txt rules2026-10-10
brookings.eduTop 1,000none disallowed2026-10-10
rutgers.eduTop 1,000none disallowed2026-10-10
tamu.eduTop 1,000none disallowed2026-10-10
bu.eduTop 1,000none disallowed2026-10-10
osu.eduTop 1,000none disallowed2026-10-10
utah.eduTop 1,000none disallowed2026-10-10
ucsb.eduTop 1,000none disallowed2026-10-10
caltech.eduTop 1,000none disallowed2026-10-10
georgetown.eduTop 1,000none disallowed2026-10-10
pitt.eduTop 1,000none disallowed2026-10-10
hbs.eduTop 1,000none disallowed2026-10-10
wustl.eduTop 10,000none disallowed2026-10-10
brown.eduTop 10,000none disallowed2026-10-10
tufts.eduTop 10,000none disallowed2026-10-10
hawaii.eduTop 10,000none disallowed2026-10-10
gatech.eduTop 10,000none disallowed2026-10-10
vt.eduTop 10,000none disallowed2026-10-10
unl.eduTop 10,000none disallowed2026-10-10
uga.eduTop 10,000none disallowed2026-10-10
umass.eduTop 10,000none disallowed2026-10-10
rochester.eduTop 10,000none disallowed2026-10-10
oregonstate.eduTop 10,000none disallowed2026-10-10
cuny.eduTop 10,00020 disallowed2026-10-10
iastate.eduTop 10,000none disallowed2026-10-10
uiowa.eduTop 10,000none disallowed2026-10-10
gwu.eduTop 10,000no robots.txt rules2026-10-10
udel.eduTop 10,000none disallowed2026-10-10
colostate.eduTop 10,000none disallowed2026-10-10
ucsf.eduTop 10,000none disallowed2026-10-10
vanderbilt.eduTop 10,000no robots.txt rules2026-10-10
iu.eduTop 10,000none disallowed2026-10-10
nd.eduTop 10,000none disallowed2026-10-10
wsu.eduTop 10,000none disallowed2026-10-10
dartmouth.eduTop 10,000none disallowed2026-10-10
fsu.eduTop 10,000none disallowed2026-10-10
usf.eduTop 10,000none disallowed2026-10-10
uoregon.eduTop 10,000none disallowed2026-10-10
byu.eduTop 10,000none disallowed2026-10-10
gmu.eduTop 10,000none disallowed2026-10-10
buffalo.eduTop 10,000none disallowed2026-10-10
uky.eduTop 10,000none disallowed2026-10-10
emory.eduTop 10,000none disallowed2026-10-10
missouri.eduTop 10,000none disallowed2026-10-10
ucsc.eduTop 10,0008 disallowed2026-10-10
uconn.eduTop 10,000none disallowed2026-10-10
uh.eduTop 10,0001 disallowed2026-10-10
uw.eduTop 10,000none disallowed2026-10-10
utk.eduTop 10,000none disallowed2026-10-10
gsu.eduTop 10,000none disallowed2026-10-10
ku.eduTop 10,000none disallowed2026-10-10
unm.eduTop 10,000none disallowed2026-10-10
northeastern.eduTop 10,000none disallowed2026-10-10
miami.eduTop 10,000none disallowed2026-10-10
nap.eduTop 10,0007 disallowed2026-10-10
kit.eduTop 10,000none disallowed2026-10-10
ub.eduTop 10,000none disallowed2026-10-10
getty.eduTop 10,000none disallowed2026-10-10
syr.eduTop 10,000none disallowed2026-10-10
case.eduTop 10,000none disallowed2026-10-10
bc.eduTop 10,000none disallowed2026-10-10
usu.eduTop 10,000none disallowed2026-10-10
rit.eduTop 10,000none disallowed2026-10-10
ucf.eduTop 10,000none disallowed2026-10-10
clemson.eduTop 10,000none disallowed2026-10-10
rpi.eduTop 10,000none disallowed2026-10-10
lsu.eduTop 10,000none disallowed2026-10-10
sc.eduTop 10,000none disallowed2026-10-10
temple.eduTop 10,000none disallowed2026-10-10
fordham.eduTop 10,000none disallowed2026-10-10
fiu.eduTop 10,000none disallowed2026-10-10
ucar.eduTop 10,000none disallowed2026-10-10
uvm.eduTop 10,000none disallowed2026-10-10
unh.eduTop 10,000none disallowed2026-10-10
sdsu.eduTop 10,000none disallowed2026-10-10
drexel.eduTop 10,0001 disallowed2026-10-10
unt.eduTop 10,000none disallowed2026-10-10
uc.eduTop 10,0001 disallowed2026-10-10
american.eduTop 10,000none disallowed2026-10-10
vcu.eduTop 10,000none disallowed2026-10-10
okstate.eduTop 10,000no robots.txt rules2026-10-10
utm.eduTop 10,000none disallowed2026-10-10
ou.eduTop 10,000no robots.txt rules2026-10-10
ua.eduTop 10,000none disallowed2026-10-10
sjsu.eduTop 10,000none disallowed2026-10-10
auburn.eduTop 10,000none disallowed2026-10-10
tulane.eduTop 10,000none disallowed2026-10-10
unu.eduTop 10,000none disallowed2026-10-10
upc.eduTop 10,000none disallowed2026-10-10
pdx.eduTop 10,000none disallowed2026-10-10
ucpress.eduTop 10,000none disallowed2026-10-10
umbc.eduTop 10,000none disallowed2026-10-10
msstate.eduTop 10,000none disallowed2026-10-10
alaska.eduTop 10,000none disallowed2026-10-10
uark.eduTop 10,000none disallowed2026-10-10
mtu.eduTop 10,000none disallowed2026-10-10
upf.eduTop 10,000none disallowed2026-10-10
washu.eduTop 10,000none disallowed2026-10-10
smu.eduTop 10,000none disallowed2026-10-10
unlv.eduTop 10,000none disallowed2026-10-10
wayne.eduTop 10,000none disallowed2026-10-10
unr.eduTop 10,000none disallowed2026-10-10
k-state.eduTop 10,000none disallowed2026-10-10
uwm.eduTop 10,0002 disallowed2026-10-10
wm.eduTop 10,000none disallowed2026-10-10
du.eduTop 10,000none disallowed2026-10-10
albany.eduTop 10,000none disallowed2026-10-10
toronto.eduTop 10,00022 disallowed2026-10-10
nmsu.eduTop 10,000no robots.txt rules2026-10-10
sfsu.eduTop 10,000none disallowed2026-10-10
artic.eduTop 10,000none disallowed2026-10-10
educause.eduTop 10,000none disallowed2026-10-10
fullerton.eduTop 10,000none disallowed2026-10-10
lehigh.eduTop 10,000none disallowed2026-10-10
csun.eduTop 10,000none disallowed2026-10-10
stonybrook.eduTop 10,000none disallowed2026-10-10
niu.eduTop 10,0003 disallowed2026-10-10
utdallas.eduTop 10,000none disallowed2026-10-10
uri.eduTop 10,000none disallowed2026-10-10
scu.eduTop 10,000none disallowed2026-10-10
universityofcalifornia.eduTop 10,000none disallowed2026-10-10
ttu.eduTop 10,000no robots.txt rules2026-10-10
montana.eduTop 10,000none disallowed2026-10-10
depaul.eduTop 10,000none disallowed2026-10-10
dukeupress.eduTop 10,0007 disallowed2026-10-10
swarthmore.eduTop 10,000none disallowed2026-10-10
nau.eduTop 10,000none disallowed2026-10-10
iit.eduTop 10,000no robots.txt rules2026-10-10
binghamton.eduTop 10,000none disallowed2026-10-10
uidaho.eduTop 10,000none disallowed2026-10-10
luc.eduTop 10,000none disallowed2026-10-10
uaf.eduTop 10,000none disallowed2026-10-10
fau.eduTop 10,000none disallowed2026-10-10
wfu.eduTop 10,000none disallowed2026-10-10
uwyo.eduTop 10,000none disallowed2026-10-10
odu.eduTop 10,000no robots.txt rules2026-10-10
chop.eduTop 10,000none disallowed2026-10-10
calpoly.eduTop 10,000none disallowed2026-10-10
umkc.eduTop 10,000no robots.txt rules2026-10-10
wpi.eduTop 10,0001 disallowed2026-10-10
olemiss.eduTop 10,000none disallowed2026-10-10
umt.eduTop 10,000none disallowed2026-10-10
ohsu.eduTop 10,000none disallowed2026-10-10
umb.eduTop 10,000none disallowed2026-10-10
nova.eduTop 10,000none disallowed2026-10-10
neu.eduTop 10,000none disallowed2026-10-10
uta.eduTop 10,000none disallowed2026-10-10
wmich.eduTop 10,000none disallowed2026-10-10
louisville.eduTop 10,000none disallowed2026-10-10
marquette.eduTop 10,000none disallowed2026-10-10
usfca.eduTop 10,000none disallowed2026-10-10
bgsu.eduTop 10,000none disallowed2026-10-10
adsabs.harvard.eduTop 10,000none disallowed2026-10-10
mtsu.eduTop 10,000none disallowed2026-10-10
umaryland.eduTop 10,000none disallowed2026-10-10
ucanr.eduTop 10,000none disallowed2026-10-10
slu.eduTop 10,000none disallowed2026-10-10
csulb.eduTop 10,000none disallowed2026-10-10
jmu.eduTop 10,000none disallowed2026-10-10
ohio.eduTop 10,000none disallowed2026-10-10
uoc.eduTop 10,000none disallowed2026-10-10
bucknell.eduTop 10,000none disallowed2026-10-10
ksu.eduTop 10,000none disallowed2026-10-10
jhuapl.eduTop 10,000none disallowed2026-10-10
njit.eduTop 10,000none disallowed2026-10-10
wwu.eduTop 10,000none disallowed2026-10-10
carleton.eduTop 10,000none disallowed2026-10-10
smith.eduTop 10,000none disallowed2026-10-10
utsa.eduTop 10,000none disallowed2026-10-10
memphis.eduTop 10,000none disallowed2026-10-10
uncg.eduTop 10,000none disallowed2026-10-10
siu.eduTop 10,000none disallowed2026-10-10
bcm.eduTop 10,000none disallowed2026-10-10
chapman.eduTop 10,000none disallowed2026-10-10
chicagobooth.eduTop 10,000none disallowed2026-10-10
ndsu.eduTop 10,000none disallowed2026-10-10
utoledo.eduTop 10,000none disallowed2026-10-10
brynmawr.eduTop 10,000none disallowed2026-10-10
ntnu.eduTop 10,000none disallowed2026-10-10
berklee.eduTop 10,000none disallowed2026-10-10
wesleyan.eduTop 10,000no robots.txt rules2026-10-10
pace.eduTop 10,000none disallowed2026-10-10
boisestate.eduTop 10,000none disallowed2026-10-10
isi.eduTop 10,000none disallowed2026-10-10
vassar.eduTop 10,000none disallowed2026-10-10
udayton.eduTop 10,0005 disallowed2026-10-10
clarku.eduTop 10,000none disallowed2026-10-10
gvsu.eduTop 10,0001 disallowed2026-10-10
appstate.eduTop 10,000none disallowed2026-10-10
syracuse.eduTop 10,000none disallowed2026-10-10
liberty.eduTop 10,000none disallowed2026-10-10
und.eduTop 10,000none disallowed2026-10-10
villanova.eduTop 10,000none disallowed2026-10-10
ecu.eduTop 10,000none disallowed2026-10-10
bard.eduTop 10,000none disallowed2026-10-10
waldenu.eduTop 10,000none disallowed2026-10-10
wku.eduTop 10,000none disallowed2026-10-10
pepperdine.eduTop 10,000none disallowed2026-10-10
uml.eduTop 10,000none disallowed2026-10-10
howard.eduTop 10,000none disallowed2026-10-10
utep.eduTop 10,000no robots.txt rules2026-10-10
usm.eduTop 10,000none disallowed2026-10-10
scripps.eduTop 10,000none disallowed2026-10-10
mtholyoke.eduTop 10,000none disallowed2026-10-10
montclair.eduTop 10,000none disallowed2026-10-10
unomaha.eduTop 10,000none disallowed2026-10-10
ie.eduTop 10,000none disallowed2026-10-10
calstate.eduTop 10,000none disallowed2026-10-10
tennessee.eduTop 10,000none disallowed2026-10-10
calvin.eduTop 10,000none disallowed2026-10-10
erau.eduTop 10,000none disallowed2026-10-10
ceu.eduTop 10,00012 disallowed2026-10-10
umassmed.eduTop 10,000none disallowed2026-10-10
marist.eduTop 10,000none disallowed2026-10-10
kennesaw.eduTop 10,000none disallowed2026-10-10
uakron.eduTop 10,000none disallowed2026-10-10
csus.eduTop 10,000none disallowed2026-10-10
miamioh.eduTop 10,000none disallowed2026-10-10
bowdoin.eduTop 10,0008 disallowed2026-10-10
fi.eduTop 10,000none disallowed2026-10-10
illinoisstate.eduTop 10,000none disallowed2026-10-10
mines.eduTop 10,000none disallowed2026-10-10
nrao.eduTop 10,000none disallowed2026-10-10
hofstra.eduTop 10,000none disallowed2026-10-10
lmu.eduTop 10,000none disallowed2026-10-10
creighton.eduTop 10,000none disallowed2026-10-10
shu.eduTop 10,000none disallowed2026-10-10
unav.eduTop 50,000none disallowed2026-10-10
tilburguniversity.eduTop 50,000none disallowed2026-10-10
hmc.eduTop 50,0001 disallowed2026-10-10
sdstate.eduTop 50,0008 disallowed2026-10-10
utsouthwestern.eduTop 50,000none disallowed2026-10-10
wichita.eduTop 50,000none disallowed2026-10-10
iese.eduTop 50,000none disallowed2026-10-10
cshl.eduTop 50,0005 disallowed2026-10-10
usna.eduTop 50,0007 disallowed2026-10-10
rowan.eduTop 50,000none disallowed2026-10-10
santafe.eduTop 50,0001 disallowed2026-10-10
ubalt.eduTop 50,000none disallowed2026-10-10
seattleu.eduTop 50,000none disallowed2026-10-10
oswego.eduTop 50,000none disallowed2026-10-10
udg.eduTop 50,0002 disallowed2026-10-10
stolaf.eduTop 50,000none disallowed2026-10-10
hamilton.eduTop 50,0001 disallowed2026-10-10
stetson.eduTop 50,000none disallowed2026-10-10
indstate.eduTop 50,000none disallowed2026-10-10
scad.eduTop 50,000none disallowed2026-10-10
comillas.eduTop 50,000none disallowed2026-10-10
webster.eduTop 50,000none disallowed2026-10-10
uwgb.eduTop 50,000none disallowed2026-10-10
valpo.eduTop 50,0003 disallowed2026-10-10
csudh.eduTop 50,00020 disallowed2026-10-10
adelphi.eduTop 50,000none disallowed2026-10-10
wcupa.eduTop 50,000none disallowed2026-10-10
tamucc.eduTop 50,0001 disallowed2026-10-10
northwestu.eduTop 50,000none disallowed2026-10-10
sunypress.eduTop 50,00017 disallowed2026-10-10
uams.eduTop 50,0001 disallowed2026-10-10
nku.eduTop 50,0006 disallowed2026-10-10
juilliard.eduTop 50,00011 disallowed2026-10-10
uwstout.eduTop 50,0001 disallowed2026-10-10
charleston.eduTop 50,0001 disallowed2026-10-10
cod.eduTop 50,000none disallowed2026-10-10
nyfa.eduTop 50,0004 disallowed2026-10-10
sae.eduTop 50,0001 disallowed2026-10-10
mdc.eduTop 50,0002 disallowed2026-10-10
sacredheart.eduTop 50,000none disallowed2026-10-10
purdueglobal.eduTop 50,000none disallowed2026-10-10
newhaven.eduTop 50,000none disallowed2026-10-10
valdosta.eduTop 50,000none disallowed2026-10-10
mu.eduTop 50,000none disallowed2026-10-10
sju.eduTop 50,000none disallowed2026-10-10
elmhurst.eduTop 50,0002 disallowed2026-10-10
upstate.eduTop 50,000none disallowed2026-10-10
millersville.eduTop 50,000none disallowed2026-10-10
lonestar.eduTop 50,000none disallowed2026-10-10
coastal.eduTop 50,00020 disallowed2026-10-10
ucam.eduTop 50,000none disallowed2026-10-10
tnstate.eduTop 50,0001 disallowed2026-10-10
csumb.eduTop 50,000none disallowed2026-10-10
aau.eduTop 50,0005 disallowed2026-10-10
stkate.eduTop 50,0004 disallowed2026-10-10
suu.eduTop 50,000none disallowed2026-10-10
msudenver.eduTop 50,000none disallowed2026-10-10
alfred.eduTop 50,0001 disallowed2026-10-10
lowell.eduTop 50,0008 disallowed2026-10-10
smc.eduTop 50,000none disallowed2026-10-10
usi.eduTop 50,000none disallowed2026-10-10
highpoint.eduTop 50,000none disallowed2026-10-10
bethel.eduTop 50,000none disallowed2026-10-10
nl.eduTop 50,000none disallowed2026-10-10
goucher.eduTop 50,0004 disallowed2026-10-10
smcvt.eduTop 50,000none disallowed2026-10-10
fullsail.eduTop 50,0008 disallowed2026-10-10
vccs.eduTop 50,0003 disallowed2026-10-10
anselm.eduTop 50,0001 disallowed2026-10-10
jcu.eduTop 50,000none disallowed2026-10-10
ciis.eduTop 50,0001 disallowed2026-10-10
ice.eduTop 50,000none disallowed2026-10-10
ptsem.eduTop 50,000none disallowed2026-10-10
merrimack.eduTop 50,0007 disallowed2026-10-10
usafa.eduTop 50,000none disallowed2026-10-10
umdearborn.eduTop 50,0001 disallowed2026-10-10
fortlewis.eduTop 100,000none disallowed2026-10-10
mondragon.eduTop 100,000none disallowed2026-10-10
downstate.eduTop 100,000none disallowed2026-10-10
lehman.eduTop 100,000none disallowed2026-10-10
whu.eduTop 100,0003 disallowed2026-10-10
susqu.eduTop 100,00013 disallowed2026-10-10
sgu.eduTop 100,000none disallowed2026-10-10
alamo.eduTop 100,000none disallowed2026-10-10
escoffier.eduTop 100,000none disallowed2026-10-10
deanza.eduTop 100,0009 disallowed2026-10-10
sau.eduTop 100,000none disallowed2026-10-10
enmu.eduTop 100,000none disallowed2026-10-10
chatham.eduTop 100,000none disallowed2026-10-10
digipen.eduTop 100,00020 disallowed2026-10-10
captechu.eduTop 100,000none disallowed2026-10-10
morningside.eduTop 100,000none disallowed2026-10-10
harpercollege.eduTop 100,0007 disallowed2026-10-10
howardcc.eduTop 100,0003 disallowed2026-10-10
dtcc.eduTop 100,00019 disallowed2026-10-10
uu.eduTop 100,0001 disallowed2026-10-10
stonehill.eduTop 100,000none disallowed2026-10-10
easternct.eduTop 100,000none disallowed2026-10-10
spcollege.eduTop 100,000none disallowed2026-10-10
andover.eduTop 100,000none disallowed2026-10-10
umes.eduTop 100,000none disallowed2026-10-10
uagc.eduTop 100,000none disallowed2026-10-10