.au websites and AI crawlers

Of 474 readable .au sites in the census, 16.5% disallow GPTBot and 15.4% disallow ClaudeBot.

SitePopularityrobots.txtRead on
abc.net.auTop 1,00012 disallowed2026-10-10
smh.com.auTop 1,00017 disallowed2026-10-10
vic.gov.auTop 1,000none disallowed2026-10-10
nsw.gov.auTop 1,000none disallowed2026-10-10
news.com.auTop 1,00020 disallowed2026-10-10
google.com.auTop 10,000none disallowed2026-10-10
qld.gov.auTop 10,000none disallowed2026-10-10
anu.edu.auTop 10,000none disallowed2026-10-10
uq.edu.auTop 10,000none disallowed2026-10-10
wa.gov.auTop 10,000none disallowed2026-10-10
theage.com.auTop 10,00017 disallowed2026-10-10
sbs.com.auTop 10,00012 disallowed2026-10-10
sydney.edu.auTop 10,000none disallowed2026-10-10
amazon.com.auTop 10,00018 disallowed2026-10-10
theaustralian.com.auTop 10,00017 disallowed2026-10-10
nla.gov.auTop 10,000none disallowed2026-10-10
sa.gov.auTop 10,000none disallowed2026-10-10
adelaide.edu.auTop 10,000none disallowed2026-10-10
oaic.gov.auTop 10,000none disallowed2026-10-10
blogspot.com.auTop 10,000no robots.txt rules2026-10-10
uwa.edu.auTop 10,000none disallowed2026-10-10
nine.com.auTop 10,00017 disallowed2026-10-10
rmit.edu.auTop 10,000none disallowed2026-10-10
abs.gov.auTop 10,000none disallowed2026-10-10
dailytelegraph.com.auTop 10,00020 disallowed2026-10-10
uts.edu.auTop 10,000none disallowed2026-10-10
ebay.com.auTop 10,0008 disallowed2026-10-10
monash.edu.auTop 10,000none disallowed2026-10-10
usyd.edu.auTop 10,000none disallowed2026-10-10
healthdirect.gov.auTop 10,000none disallowed2026-10-10
heraldsun.com.auTop 10,00020 disallowed2026-10-10
uow.edu.auTop 10,000none disallowed2026-10-10
deakin.edu.auTop 10,000none disallowed2026-10-10
pinterest.com.auTop 10,00018 disallowed2026-10-10
curtin.edu.auTop 10,000none disallowed2026-10-10
griffith.edu.auTop 10,000none disallowed2026-10-10
legislation.gov.auTop 10,000none disallowed2026-10-10
businessinsider.com.auTop 10,000no robots.txt rules2026-10-10
nt.gov.auTop 10,000none disallowed2026-10-10
business.gov.auTop 10,000none disallowed2026-10-10
couriermail.com.auTop 10,00020 disallowed2026-10-10
canberratimes.com.auTop 10,00014 disallowed2026-10-10
newcastle.edu.auTop 10,000none disallowed2026-10-10
eventbrite.com.auTop 10,0001 disallowed2026-10-10
asic.gov.auTop 10,000none disallowed2026-10-10
7news.com.auTop 10,0002 disallowed2026-10-10
unisa.edu.auTop 10,000no robots.txt rules2026-10-10
utas.edu.auTop 10,000none disallowed2026-10-10
realestate.com.auTop 10,00013 disallowed2026-10-10
flinders.edu.auTop 10,000none disallowed2026-10-10
ozemail.com.auTop 10,000none disallowed2026-10-10
seek.com.auTop 10,000none disallowed2026-10-10
skynews.com.auTop 10,00020 disallowed2026-10-10
brisbanetimes.com.auTop 10,00017 disallowed2026-10-10
iinet.net.auTop 10,000none disallowed2026-10-10
telstra.com.auTop 10,0005 disallowed2026-10-10
rba.gov.auTop 10,000none disallowed2026-10-10
auspost.com.auTop 10,000none disallowed2026-10-10
thewest.com.auTop 10,000none disallowed2026-10-10
tripadvisor.com.auTop 10,0009 disallowed2026-10-10
ecu.edu.auTop 10,000none disallowed2026-10-10
embassy.gov.auTop 10,000no robots.txt rules2026-10-10
beyondblue.org.auTop 50,000none disallowed2026-10-10
adelaidenow.com.auTop 50,00020 disallowed2026-10-10
westernsydney.edu.auTop 50,000none disallowed2026-10-10
foxsports.com.auTop 50,0003 disallowed2026-10-10
commbank.com.auTop 50,000none disallowed2026-10-10
perthnow.com.auTop 50,000none disallowed2026-10-10
marketindex.com.auTop 50,000none disallowed2026-10-10
crikey.com.auTop 50,00012 disallowed2026-10-10
une.edu.auTop 50,000none disallowed2026-10-10
vogue.com.auTop 50,00020 disallowed2026-10-10
finder.com.auTop 50,000none disallowed2026-10-10
watoday.com.auTop 50,00017 disallowed2026-10-10
reneweconomy.com.auTop 50,0001 disallowed2026-10-10
mamamia.com.auTop 50,00011 disallowed2026-10-10
whirlpool.net.auTop 50,00020 disallowed2026-10-10
smartcompany.com.auTop 50,00012 disallowed2026-10-10
awm.gov.auTop 50,000none disallowed2026-10-10
lifehacker.com.auTop 50,00019 disallowed2026-10-10
espn.com.auTop 50,0006 disallowed2026-10-10
australiangeographic.com.auTop 50,0009 disallowed2026-10-10
taste.com.auTop 50,00019 disallowed2026-10-10
airbnb.com.auTop 50,0003 disallowed2026-10-10
productreview.com.auTop 50,0001 disallowed2026-10-10
carsales.com.auTop 50,0004 disallowed2026-10-10
kidspot.com.auTop 50,00020 disallowed2026-10-10
themercury.com.auTop 50,00020 disallowed2026-10-10
broadsheet.com.auTop 50,0006 disallowed2026-10-10
bodyandsoul.com.auTop 50,00020 disallowed2026-10-10
uws.edu.auTop 50,000none disallowed2026-10-10
bandt.com.auTop 50,000none disallowed2026-10-10
ntnews.com.auTop 50,00020 disallowed2026-10-10
ahpra.gov.auTop 50,000none disallowed2026-10-10
australianmuseum.net.auTop 50,000none disallowed2026-10-10
ticketmaster.com.auTop 50,0001 disallowed2026-10-10
goldcoastbulletin.com.auTop 50,00020 disallowed2026-10-10
illawarramercury.com.auTop 50,00014 disallowed2026-10-10
whichcar.com.auTop 50,0007 disallowed2026-10-10
thesaturdaypaper.com.auTop 50,00010 disallowed2026-10-10
arnnet.com.auTop 50,00010 disallowed2026-10-10
gettyimages.com.auTop 50,000none disallowed2026-10-10
themonthly.com.auTop 50,00010 disallowed2026-10-10
engineersaustralia.org.auTop 50,00011 disallowed2026-10-10
newcastleherald.com.auTop 50,00014 disallowed2026-10-10
houzz.com.auTop 50,000none disallowed2026-10-10
gq.com.auTop 50,00020 disallowed2026-10-10
propterest.com.auTop 50,000none disallowed2026-10-10
examiner.com.auTop 50,00014 disallowed2026-10-10
nfsa.gov.auTop 50,00011 disallowed2026-10-10
smilingmind.com.auTop 50,000none disallowed2026-10-10
salvationarmy.org.auTop 50,000none disallowed2026-10-10
arena.gov.auTop 50,0003 disallowed2026-10-10
thechronicle.com.auTop 50,00020 disallowed2026-10-10
target.com.auTop 50,000none disallowed2026-10-10
weeklytimesnow.com.auTop 50,00020 disallowed2026-10-10
abcb.gov.auTop 50,00019 disallowed2026-10-10
mca.com.auTop 100,000none disallowed2026-10-10
federation.edu.auTop 100,000none disallowed2026-10-10
expedia.com.auTop 100,000none disallowed2026-10-10
delicious.com.auTop 100,00020 disallowed2026-10-10
thenightly.com.auTop 100,000none disallowed2026-10-10
stockhead.com.auTop 100,00019 disallowed2026-10-10
hotdoc.com.auTop 100,000none disallowed2026-10-10
thecourier.com.auTop 100,00014 disallowed2026-10-10
geelongadvertiser.com.auTop 100,00020 disallowed2026-10-10
aemo.com.auTop 100,000none disallowed2026-10-10
westfield.com.auTop 100,0001 disallowed2026-10-10
healthengine.com.auTop 100,000none disallowed2026-10-10
bordermail.com.auTop 100,00014 disallowed2026-10-10
justhorseracing.com.auTop 100,000none disallowed2026-10-10
townsvillebulletin.com.auTop 100,00020 disallowed2026-10-10
businessnews.com.auTop 100,0001 disallowed2026-10-10
themandarin.com.auTop 100,00012 disallowed2026-10-10
standard.net.auTop 100,00014 disallowed2026-10-10
readings.com.auTop 100,0002 disallowed2026-10-10
itbrief.com.auTop 100,000none disallowed2026-10-10
flightcentre.com.auTop 100,000none disallowed2026-10-10
screenaustralia.gov.auTop 100,000none disallowed2026-10-10
crn.com.auTop 100,0002 disallowed2026-10-10
tvtonight.com.auTop 100,0008 disallowed2026-10-10
aldi.com.auTop 100,000none disallowed2026-10-10
ngutechnology.com.auTop 100,0001 disallowed2026-10-10
bendigoadvertiser.com.auTop 100,00014 disallowed2026-10-10
catholic.org.auTop 100,000none disallowed2026-10-10
ruok.org.auTop 100,000none disallowed2026-10-10
adorebeauty.com.auTop 100,000none disallowed2026-10-10