.jp websites and AI crawlers

Of 1,001 readable .jp sites in the census, 11.0% disallow GPTBot and 10.0% disallow ClaudeBot.

SitePopularityrobots.txtRead on
yahoo.co.jpTop 1,0002 disallowed2026-10-10
amazon.co.jpTop 1,00018 disallowed2026-10-10
google.co.jpTop 1,000none disallowed2026-10-10
rakuten.co.jpTop 1,000none disallowed2026-10-10
sakura.ne.jpTop 1,000none disallowed2026-10-10
ameblo.jpTop 1,000none disallowed2026-10-10
b.hatena.ne.jpTop 1,000none disallowed2026-10-10
japantimes.co.jpTop 10,000none disallowed2026-10-10
biglobe.ne.jpTop 10,000no robots.txt rules2026-10-10
prtimes.jpTop 10,000none disallowed2026-10-10
mynavi.jpTop 10,000none disallowed2026-10-10
yomiuri.co.jpTop 10,00019 disallowed2026-10-10
nicovideo.jpTop 10,0001 disallowed2026-10-10
kyoto-u.ac.jpTop 10,000none disallowed2026-10-10
mainichi.jpTop 10,00018 disallowed2026-10-10
livedoor.jpTop 10,000no robots.txt rules2026-10-10
main.jpTop 10,000no robots.txt rules2026-10-10
docomo.ne.jpTop 10,000no robots.txt rules2026-10-10
blog.livedoor.jpTop 10,000none disallowed2026-10-10
nikkeibp.co.jpTop 10,00019 disallowed2026-10-10
tbs.co.jpTop 10,000no robots.txt rules2026-10-10
so-net.ne.jpTop 10,000none disallowed2026-10-10
blogspot.jpTop 10,000none disallowed2026-10-10
ntv.co.jpTop 10,000none disallowed2026-10-10
camp-fire.jpTop 10,000none disallowed2026-10-10
ameba.jpTop 10,000none disallowed2026-10-10
stores.jpTop 10,000none disallowed2026-10-10
shop-pro.jpTop 10,000no robots.txt rules2026-10-10
kantei.go.jpTop 10,000no robots.txt rules2026-10-10
jugem.jpTop 10,000none disallowed2026-10-10
ndl.go.jpTop 10,000none disallowed2026-10-10
store.shopping.yahoo.co.jpTop 10,000none disallowed2026-10-10
fujitv.co.jpTop 10,000no robots.txt rules2026-10-10
excite.co.jpTop 10,000none disallowed2026-10-10
nintendo.co.jpTop 10,00011 disallowed2026-10-10
asahi-net.or.jpTop 10,00022 disallowed2026-10-10
www.ne.jpTop 10,000no robots.txt rules2026-10-10
hotpepper.jpTop 10,000none disallowed2026-10-10
blog.jpTop 10,000no robots.txt rules2026-10-10
gnavi.co.jpTop 10,000none disallowed2026-10-10
eplus.jpTop 10,000none disallowed2026-10-10
sony.co.jpTop 10,000none disallowed2026-10-10
kadokawa.co.jpTop 10,000none disallowed2026-10-10
panasonic.jpTop 10,000none disallowed2026-10-10
hb.afl.rakuten.co.jpTop 10,000no robots.txt rules2026-10-10
vector.co.jpTop 10,000none disallowed2026-10-10
nhk.jpTop 10,00011 disallowed2026-10-10
privacymark.jpTop 10,000no robots.txt rules2026-10-10
shinobi.jpTop 10,000none disallowed2026-10-10
sony.jpTop 10,000none disallowed2026-10-10
xserver.ne.jpTop 10,000none disallowed2026-10-10
shueisha.co.jpTop 10,000none disallowed2026-10-10
sub.jpTop 10,000no robots.txt rules2026-10-10
panasonic.co.jpTop 10,000no robots.txt rules2026-10-10
vektor-inc.co.jpTop 10,000none disallowed2026-10-10
goope.jpTop 10,000none disallowed2026-10-10
jrc.or.jpTop 10,000no robots.txt rules2026-10-10
oricon.co.jpTop 10,000none disallowed2026-10-10
tsite.jpTop 10,000no robots.txt rules2026-10-10
lolipop.jpTop 10,000none disallowed2026-10-10
kodansha.co.jpTop 10,000no robots.txt rules2026-10-10
digital.go.jpTop 10,000none disallowed2026-10-10
canon.jpTop 10,000none disallowed2026-10-10
med.or.jpTop 10,000no robots.txt rules2026-10-10
weblio.jpTop 10,000no robots.txt rules2026-10-10
ascii.jpTop 10,0001 disallowed2026-10-10
form-mailer.jpTop 10,000none disallowed2026-10-10
tokyo-np.co.jpTop 10,00020 disallowed2026-10-10
hitachi.co.jpTop 10,000none disallowed2026-10-10
mixi.jpTop 10,000none disallowed2026-10-10
diamond.jpTop 10,000none disallowed2026-10-10
allabout.co.jpTop 10,000none disallowed2026-10-10
yjtag.jpTop 10,000no robots.txt rules2026-10-10
nikkan.co.jpTop 10,000no robots.txt rules2026-10-10
mapion.co.jpTop 10,000none disallowed2026-10-10
asahi.co.jpTop 10,000none disallowed2026-10-10
sourceforge.jpTop 10,000none disallowed2026-10-10
furusato-tax.jpTop 10,0001 disallowed2026-10-10
chunichi.co.jpTop 10,00020 disallowed2026-10-10
princehotels.co.jpTop 10,000none disallowed2026-10-10
mbs.jpTop 10,000none disallowed2026-10-10
sega.jpTop 10,000no robots.txt rules2026-10-10
hmv.co.jpTop 10,0006 disallowed2026-10-10
pinterest.jpTop 50,00018 disallowed2026-10-10
shogakukan.co.jpTop 50,000none disallowed2026-10-10
radiko.jpTop 50,000none disallowed2026-10-10
weathernews.jpTop 50,000none disallowed2026-10-10
suzuri.jpTop 50,0001 disallowed2026-10-10
kotobank.jpTop 50,0001 disallowed2026-10-10
jtb.co.jpTop 50,000none disallowed2026-10-10
sonymusic.co.jpTop 50,00010 disallowed2026-10-10
wowow.co.jpTop 50,000none disallowed2026-10-10
photozou.jpTop 50,0002 disallowed2026-10-10
booklog.jpTop 50,0002 disallowed2026-10-10
atpress.ne.jpTop 50,0001 disallowed2026-10-10
47news.jpTop 50,00020 disallowed2026-10-10
ktv.jpTop 50,0001 disallowed2026-10-10
tripadvisor.jpTop 50,0009 disallowed2026-10-10
nishinippon.co.jpTop 50,00020 disallowed2026-10-10
jorudan.co.jpTop 50,0001 disallowed2026-10-10
hokkaido-np.co.jpTop 50,00013 disallowed2026-10-10
tfm.co.jpTop 50,000none disallowed2026-10-10
suumo.jpTop 50,000none disallowed2026-10-10
chiba-u.ac.jpTop 50,000none disallowed2026-10-10
kyoto-np.co.jpTop 50,00019 disallowed2026-10-10
makeshop.jpTop 50,0007 disallowed2026-10-10
kobe-np.co.jpTop 50,0004 disallowed2026-10-10
huffingtonpost.jpTop 50,00015 disallowed2026-10-10
iza.ne.jpTop 50,00017 disallowed2026-10-10
wired.jpTop 50,00016 disallowed2026-10-10
honto.jpTop 50,0001 disallowed2026-10-10
fujisan.co.jpTop 50,000none disallowed2026-10-10
bloomberg.co.jpTop 50,00017 disallowed2026-10-10
zakzak.co.jpTop 50,00017 disallowed2026-10-10
cnn.co.jpTop 50,00010 disallowed2026-10-10
athome.co.jpTop 50,000none disallowed2026-10-10
gizmodo.jpTop 50,0008 disallowed2026-10-10
ghibli.jpTop 50,000none disallowed2026-10-10
gihyo.jpTop 50,0001 disallowed2026-10-10
businessinsider.jpTop 50,0008 disallowed2026-10-10
shinchosha.co.jpTop 50,000none disallowed2026-10-10
cdjapan.co.jpTop 50,000none disallowed2026-10-10
hulu.jpTop 50,00020 disallowed2026-10-10
okwave.jpTop 50,00019 disallowed2026-10-10
toho.co.jpTop 50,000none disallowed2026-10-10
tbsradio.jpTop 50,0001 disallowed2026-10-10
newsweekjapan.jpTop 50,000none disallowed2026-10-10
okinawatimes.co.jpTop 50,00019 disallowed2026-10-10
cyberagent.co.jpTop 50,0003 disallowed2026-10-10
tv-osaka.co.jpTop 50,000none disallowed2026-10-10
tkj.jpTop 50,0001 disallowed2026-10-10
vogue.co.jpTop 50,00016 disallowed2026-10-10
chugoku-np.co.jpTop 50,00020 disallowed2026-10-10
response.jpTop 50,000none disallowed2026-10-10
vis.ne.jpTop 50,000none disallowed2026-10-10
airbnb.jpTop 50,0003 disallowed2026-10-10
telemail.jpTop 50,000none disallowed2026-10-10
kyodonewsprwire.jpTop 50,000none disallowed2026-10-10
wowma.jpTop 50,000none disallowed2026-10-10
sanwa.co.jpTop 50,0001 disallowed2026-10-10
tmu.ac.jpTop 50,0001 disallowed2026-10-10
jlpt.jpTop 50,0003 disallowed2026-10-10
doctorsfile.jpTop 50,0001 disallowed2026-10-10
iwanami.co.jpTop 50,0008 disallowed2026-10-10
game8.jpTop 50,00010 disallowed2026-10-10
ekiten.jpTop 50,0001 disallowed2026-10-10
houterasu.or.jpTop 50,0004 disallowed2026-10-10
ryukoku.ac.jpTop 50,0001 disallowed2026-10-10
animate.co.jpTop 50,000none disallowed2026-10-10
ryukyushimpo.jpTop 50,00010 disallowed2026-10-10
realsound.jpTop 50,000none disallowed2026-10-10
geidai.ac.jpTop 50,0001 disallowed2026-10-10
pacifico.co.jpTop 50,000none disallowed2026-10-10
bs-asahi.co.jpTop 50,000none disallowed2026-10-10
kanaloco.jpTop 50,00010 disallowed2026-10-10
huistenbosch.co.jpTop 50,000none disallowed2026-10-10
qoo10.jpTop 50,0003 disallowed2026-10-10
creema.jpTop 50,0001 disallowed2026-10-10
4travel.jpTop 50,0001 disallowed2026-10-10
mantan-web.jpTop 50,0004 disallowed2026-10-10
logmi.jpTop 50,0004 disallowed2026-10-10
lifehacker.jpTop 50,0008 disallowed2026-10-10
jata-net.or.jpTop 50,000none disallowed2026-10-10
kajima.co.jpTop 50,000none disallowed2026-10-10
tokyo-sports.co.jpTop 50,0009 disallowed2026-10-10
mora.jpTop 50,00013 disallowed2026-10-10
sogo-seibu.jpTop 50,000none disallowed2026-10-10
tmd.ac.jpTop 50,0001 disallowed2026-10-10
bookwalker.jpTop 50,0007 disallowed2026-10-10
note.jpTop 50,000none disallowed2026-10-10
sound.jpTop 50,0009 disallowed2026-10-10
gmo.jpTop 50,000none disallowed2026-10-10
felissimo.co.jpTop 50,000none disallowed2026-10-10
tv-aichi.co.jpTop 50,000none disallowed2026-10-10
premiumoutlets.co.jpTop 50,000none disallowed2026-10-10
barks.jpTop 50,000none disallowed2026-10-10
joc.or.jpTop 50,000none disallowed2026-10-10
buyshop.jpTop 50,0001 disallowed2026-10-10
kitasato-u.ac.jpTop 50,00020 disallowed2026-10-10
inside-games.jpTop 50,000none disallowed2026-10-10
benesse.jpTop 50,0001 disallowed2026-10-10
gamespark.jpTop 50,000none disallowed2026-10-10
expedia.co.jpTop 50,000none disallowed2026-10-10
amazon.jpTop 50,00018 disallowed2026-10-10
fukuishimbun.co.jpTop 50,00019 disallowed2026-10-10
htb.co.jpTop 50,000none disallowed2026-10-10
japan-sports.or.jpTop 50,000none disallowed2026-10-10
crowdworks.jpTop 50,0003 disallowed2026-10-10
1999.co.jpTop 50,000none disallowed2026-10-10
askul.co.jpTop 50,000none disallowed2026-10-10
jeita.or.jpTop 50,0004 disallowed2026-10-10
saga-s.co.jpTop 50,00019 disallowed2026-10-10
ozmall.co.jpTop 50,000none disallowed2026-10-10
yamanashi.ac.jpTop 50,00014 disallowed2026-10-10
bs11.jpTop 50,000none disallowed2026-10-10
jsce.or.jpTop 50,000none disallowed2026-10-10
rihga.co.jpTop 50,000none disallowed2026-10-10
atcoder.jpTop 50,0002 disallowed2026-10-10
hokkoku.co.jpTop 50,00019 disallowed2026-10-10
palcloset.jpTop 50,000none disallowed2026-10-10
niigata-nippo.co.jpTop 50,00019 disallowed2026-10-10
newswitch.jpTop 50,00014 disallowed2026-10-10
orico.co.jpTop 50,000none disallowed2026-10-10
ibaraki.ac.jpTop 50,0001 disallowed2026-10-10
mouse-jp.co.jpTop 50,000none disallowed2026-10-10
thetv.jpTop 50,000none disallowed2026-10-10
mstdn.jpTop 50,0001 disallowed2026-10-10
macotakara.jpTop 50,000none disallowed2026-10-10
animeanime.jpTop 100,000none disallowed2026-10-10
fsc.go.jpTop 100,000none disallowed2026-10-10
shimotsuke.co.jpTop 100,00019 disallowed2026-10-10
neowing.co.jpTop 100,000none disallowed2026-10-10
isejingu.or.jpTop 100,0003 disallowed2026-10-10
jmty.jpTop 100,0001 disallowed2026-10-10
zaikei.co.jpTop 100,0001 disallowed2026-10-10
hpmmuseum.jpTop 100,00012 disallowed2026-10-10
keioplaza.co.jpTop 100,000none disallowed2026-10-10
p-world.co.jpTop 100,0002 disallowed2026-10-10
gqjapan.jpTop 100,00016 disallowed2026-10-10
pixta.jpTop 100,0002 disallowed2026-10-10
tokyo-kosha.or.jpTop 100,000none disallowed2026-10-10
wacoal.jpTop 100,0001 disallowed2026-10-10
codezine.jpTop 100,0001 disallowed2026-10-10
runnet.jpTop 100,0002 disallowed2026-10-10
sakigake.jpTop 100,00019 disallowed2026-10-10
daiken.jpTop 100,000none disallowed2026-10-10
minkabu.jpTop 100,0001 disallowed2026-10-10
sangetsu.co.jpTop 100,000none disallowed2026-10-10
newscast.jpTop 100,0001 disallowed2026-10-10
toei-video.co.jpTop 100,0002 disallowed2026-10-10
jsog.or.jpTop 100,0004 disallowed2026-10-10
mirasapo-plus.go.jpTop 100,000none disallowed2026-10-10
nnn.co.jpTop 100,00019 disallowed2026-10-10
resemom.jpTop 100,000none disallowed2026-10-10
agrinews.co.jpTop 100,00011 disallowed2026-10-10
takeshobo.co.jpTop 100,0008 disallowed2026-10-10
topics.or.jpTop 100,00010 disallowed2026-10-10
komei.or.jpTop 100,0001 disallowed2026-10-10
kakuyomu.jpTop 100,000none disallowed2026-10-10
qtmedia.co.jpTop 100,0001 disallowed2026-10-10
e-shops.jpTop 100,000none disallowed2026-10-10
toonippo.co.jpTop 100,0009 disallowed2026-10-10
jfe-steel.co.jpTop 100,0005 disallowed2026-10-10
chibanippo.co.jpTop 100,00020 disallowed2026-10-10
feel-kobe.jpTop 100,0002 disallowed2026-10-10
minpo.jpTop 100,00019 disallowed2026-10-10
localplace.jpTop 100,000none disallowed2026-10-10
ehime-np.co.jpTop 100,00019 disallowed2026-10-10
moviewalker.jpTop 100,0001 disallowed2026-10-10
epark.jpTop 100,0001 disallowed2026-10-10
qzin.jpTop 100,0001 disallowed2026-10-10
beyourlover.co.jpTop 100,000none disallowed2026-10-10
tullys.co.jpTop 100,000none disallowed2026-10-10
levtech.jpTop 100,0001 disallowed2026-10-10
nipponham.co.jpTop 100,0001 disallowed2026-10-10
sanin-chuo.co.jpTop 100,00022 disallowed2026-10-10
sportsentry.ne.jpTop 100,000none disallowed2026-10-10
gifu-np.co.jpTop 100,000none disallowed2026-10-10
showa-u.ac.jpTop 100,000none disallowed2026-10-10
jomo-news.co.jpTop 100,00019 disallowed2026-10-10
nhk-ondemand.jpTop 100,0008 disallowed2026-10-10
shi.co.jpTop 100,000none disallowed2026-10-10
setouchi-artfest.jpTop 100,0001 disallowed2026-10-10