Danbooru

Artist URL Metrics

Posted under General

I've been collecting Artist URL metrics to help with my URL handler to determine the priority of developing dead link detectors. It just finished collecting today, so I'm sharing this information in case anyone else might find it useful.

Note: For the JSON, the empty string key "" are those artists with bad URLs that were unparsable by Python's urllib, and after looking into a few of those, it seems that they don't have the schema "http://" or "https://" in front.

To give a peek though, the following are the counts for the top 200 of 92472 (sub)domains for artist URLs.

Rank(Sub)domainsCount
1com201185
2net167172
3pixiv.net131645
4www.pixiv.net130112
5jp84139
6twitter.com68861
7fc2.com30589
8twitpic.com25927
9nicovideo.jp22585
10pawoo.net17685
11blog.fc2.com13351
12tumblr.com12738
13twipple.jp9882
14p.twipple.jp9876
15www.nicovideo.jp9708
16deviantart.com9633
17seiga.nicovideo.jp9403
18yfrog.com8777
19ne.jp8345
20tinami.com6425
21www.tinami.com6379
22web.fc2.com5997
23ms5005
24circle.ms4963
25org4953
26drawr.net3687
27co.jp3515
28info3423
29twpf.jp3388
30sakura.ne.jp3039
31privatter.net3020
32nijie.info2891
33com.nicovideo.jp2571
34weibo.com2564
35facebook.com2303
36mixi.jp2260
37tv2225
38www.facebook.com2204
39shinobi.jp2057
40blog.shinobi.jp2056
41stickam.jp1964
42www.stickam.jp1963
43odaibako.net1880
44jugem.jp1864
45piapro.jp1854
46theinterviews.jp1770
47fm1698
48dlsite.com1695
49cc1695
50pm1693
51booth.pm1693
52artstation.com1682
53ask.fm1676
54pipa.jp1669
55www.weibo.com1593
56www.dlsite.com1577
57livedoor.jp1490
58blog.livedoor.jp1426
59mugimugi.org1396
60doujinshi.mugimugi.org1391
61geocities.jp1348
62ameblo.jp1322
63sketch.pixiv.net1318
64hentai-foundry.com1281
65b.dlsite.net1252
66dlsite.net1252
67instagram.com1207
68blogimg.jp1188
69tegaki.pipa.jp1181
70wikipedia.org1178
71www.geocities.jp1174
72hatena.ne.jp1127
73www.artstation.com1048
74pixiv.cc1046
75twitter.yfrog.com1044
76portal.circle.ms1038
77youtube.com1009
78me1005
79www.youtube.com991
80ja.wikipedia.org983
81patreon.com979
82doujinshi.org977
83www.doujinshi.org976
84amazon.co.jp972
85www.amazon.co.jp950
86webcatalog.circle.ms930
87www.instagram.com921
88www.patreon.com913
89naver.com911
90blog.naver.com894
91infoseek.co.jp832
92www.hentai-foundry.com767
93or.jp766
94www.animenewsnetwork.com727
95animenewsnetwork.com727
96atwiki.jp708
97blogspot.com663
98hp.infoseek.co.jp657
99plurk.com657
100www.plurk.com652
101ustream.tv639
102ameba.jp639
103www.ustream.tv637
104dic.nicovideo.jp623
105twitcasting.tv614
106dyndns.org598
107google.com596
108nifty.com594
109erogamescape.dyndns.org589
110wixsite.com575
111biglobe.ne.jp566
112bcy.net535
113sblo.jp534
114livedoor.blogimg.jp532
115to525
116img.jugem.jp513
117pictures.hentai-foundry.com512
118nanos.jp510
119x.fc2.com507
120wix.com506
121www.mangaupdates.com502
122mangaupdates.com502
123jimdo.com495
124takamin.com492
125www.takamin.com492
126anidb.net490
127yahoo.co.jp484
128photozou.jp478
129baidu.com465
130cn459
131ocn.ne.jp448
132seesaa.net446
133plus.google.com445
134exblog.jp436
135webclap.com431
136enty.jp422
137www7.atwiki.jp421
138xxxxxxxx.jp411
139stat.ameba.jp402
140so-net.ne.jp401
141com.cn383
142pixiv.blogimg.jp383
143lofter.com375
144sina.com.cn370
145oekakibbs.com369
146d.hatena.ne.jp369
147hi.baidu.com367
148yaplog.jp367
149f.hatena.ne.jp358
150fc2web.com358
151blogs.yahoo.co.jp345
152photo.mixi.jp343
153dion.ne.jp339
154fantia.jp337
155pixa.cc336
156deviantart.net336
157peing.net325
158melonbooks.co.jp323
159moo.jp321
160plala.or.jp316
161tw308
162www.melonbooks.co.jp307
163blog.sina.com.cn301
164dmm.co.jp300
165monappy.jp292
166suimy.net290
167yam.com289
168blog.yam.com287
169www.dmm.co.jp282
170spibal.webclap.com281
171mstdn.jp274
172st-hatena.com271
173f.st-hatena.com270
174homepage3.nifty.com270
175www.pixa.cc269
176line.me263
177nobody.jp260
178homepage2.nifty.com256
179www.twitcasting.tv254
180saiin.net254
181toranoana.jp253
182be250
183pictbland.net248
184marshmallow-qa.com246
185ddo.jp243
186cocolog-nifty.com242
187furaffinity.net241
188imagis.jp241
189weebly.com241
190www.toranoana.jp239
191twitgoo.com237
192www.furaffinity.net237
193blogspot.jp237
194goo.ne.jp236
195home.ne.jp230
196picarto.tv226
197jcom.home.ne.jp224
198omata-pic.com222
199drawcrowd.com221
200upp.so-net.ne.jp219
1