Danbooru

[Prototype] User Report Ver 6.3

Posted under General

@BrokenEagle98
For the Pools: I think there should be a column be added that counts how many of the added pools were removed by someone else.
So for example user A added 100 pools in total, but 25 (25%) were removed by User B afterwards. It's easier to see if there are possible pool vandals or how much the pooling is actually "worth" of that person.

Hmmm... what about edit wars, i.e. from your example, user A goes back and adds those 25 posts to the pool, user B then goes back and removes those 25 posts from the pool, and so on and so forth.

Even if User B was "correct" with his edits, he'll have approximately the same amount of Removes as User A. I quoted correct because many of the pools are subjective, so how can one tell what truly belongs to a pool...?

BrokenEagle98 said:

Hmmm... what about edit wars, i.e. from your example, user A goes back and adds those 25 posts to the pool, user B then goes back and removes those 25 posts from the pool, and so on and so forth.

Even if User B was "correct" with his edits, he'll have approximately the same amount of Removes as User A. I quoted correct because many of the pools are subjective, so how can one tell what truly belongs to a pool...?

It should only be counted Adds and Removals. If there are doubles, then it is that way. We should ALWAYS look behind those numbers of course. Otherwise we can just discard the Reports anyway^^. For example for taggers: One can add 500 tags to a posts. Great number, but if over 7/8 are misuse, then the number loses its shine.

Here's what I came up with...

Pool Details - Updated at Tue Nov 8 23:07:25 2016
RankUsernameTotalCreatesAddsRemovesOrdersObs AddsObs RemsOther
1DGKelly175017310802
2Claverhouse1720172003800
3Jarlath11111081111212
4Stan_Miller107210341001
5andalus104109310301
6NWSiaCB78075210001
7CharleyDodger7217100200
8Tayan6405513707
9Tsuki_no_Sakura5805810300
10Krugger5425100301
11game200947054200100
12Wildfire_desu46046002900
13Zekana4514261100
14Sythini44143702200
15wheelchair44033102010
16onlyaw4104000101
17fossilnix4104100000

Note: Cutoff was 40 total Pool changes; duration was 30 days

Note: Obs Adds==Obsolete Adds, Obs Rems==Obsolete Removes

If it looks good, I'll incorporate it into the next release/update...

BrokenEagle98 said:

Here's what I came up with...

Pool Details - Updated at Tue Nov 8 23:07:25 2016
RankUsernameTotalCreatesAddsRemovesOrdersObs AddsObs RemsOther
1DGKelly175017310802
2Claverhouse1720172003800
3Jarlath11111081111212
4Stan_Miller107210341001
5andalus104109310301
6NWSiaCB78075210001
7CharleyDodger7217100200
8Tayan6405513707
9Tsuki_no_Sakura5805810300
10Krugger5425100301
11game200947054200100
12Wildfire_desu46046002900
13Zekana4514261100
14Sythini44143702200
15wheelchair44033102010
16onlyaw4104000101
17fossilnix4104100000

Note: Cutoff was 40 total Pool changes; duration was 30 days

Note: Obs Adds==Obsolete Adds, Obs Rems==Obsolete Removes

If it looks good, I'll incorporate it into the next release/update...

What is "OBS" standing for?

Obs, as in Obsolete. Check the note below the table.
"Note: Obs Adds==Obsolete Adds, Obs Rems==Obsolete Removes"

Basically, they're the columns you asked for, i.e. add a post that gets later removed, or remove a post that later gets added...

Looks like it's an implementation of a "translator report":"https://github.com/r888888888/reportbooru/commit/43d3f6a71a5e7c85bfdf15b4ebfee4a145f1392a], similar to mine in that it counts the adds/removals of all of the translator tags, i.e. translated, check_translation, partially_translated, translation_request, commentary, check_commentary, commentary_request.

A reason why it might be empty is because it is being generated right now. When writing a file to disk, the OS reserves the name in the file system which is why it's showing up as empty.

Created another Supply vs Demand chart like back in forum #120141.
Note: Search numbers pulled from the Popular Searches report.

Searches vs Uploads
RankTagnameTypeSearchesUploadsSearches/Uploads
1saltyicecreamArtist1017442543.5
2null_(nyanpyoun)Artist953151906.2
3himura_kisekiArtist849151698.2
4ricegnatArtist561541403.75
5misaki_kurehitoArtist51366856.0
6ke-taArtist59149657.11
7mtu_(orewamuzituda)Artist48249536.0
8donald_trumpCharacter487810487.8
9yua_(checkmate)Artist512814366.28
10futanariGeneral966235276.05
11keijo!!!!!!!!Copyright665625266.24
12dandon_fugaArtist528020264.0
13zhengArtist491219258.52
14monster_musume_no_iru_nichijouCopyright660431213.03
15lusamine_(pokemon)Character500824208.66
16bestialityGeneral544527201.66
17sombra_(overwatch)Character1563182190.62
18hammer_(sunset_beach)Artist855647182.04
19league_of_legendsCopyright1393191153.08
20monster_girl_encyclopediaCopyright802254148.55
21iowa_(kantai_collection)Character1247186145.01
22getsuyoubi_no_tawawaCopyright549638144.63
23animated_gifGeneral647449132.12
24warspite_(kantai_collection)Character1014677131.76
25animatedGeneral19731154128.12
26kouji_(campus_life)Artist570846124.08
27masak_(masaki4545)Artist568247120.89
28shadowverseCopyright509844115.86
29scathach_(fate/grand_order)Character77107898.84
30rapeGeneral63346893.14
31rwbyCopyright1413315591.18
32caster_(fate/extra)Character60707482.02
33bdsmGeneral928911481.48
34bondageGeneral78629880.22
35tenryuu_(kantai_collection)Character52787075.4
36mei_(overwatch)Character54637374.83
37suzuya_(kantai_collection)Character47036374.65
38blazblueCopyright54428068.02
39houshou_(kantai_collection)Character52197966.06
40kashima_(kantai_collection)Character907414064.81
41graf_zeppelin_(kantai_collection)Character47857464.66
42shimakaze_(kantai_collection)Character48077564.09
43hews_hackArtist52288362.98
44neptune_(series)Copyright1165618762.33
45d.va_(overwatch)Character1055817062.1
46hamakaze_(kantai_collection)Character875715357.23
47prinz_eugen_(kantai_collection)Character47979053.3
48overwatchCopyright3539868651.6
49kongou_(kantai_collection)Character522310649.27
50tentaclesGeneral472810047.28
51uncensoredGeneral716516343.95
52pokemonCopyright3008869943.04
53rem_(re:zero)Character984924340.53
54monster_girlGeneral690917439.7
55mercy_(overwatch)Character848521739.1
56kaga_(kantai_collection)Character797421037.97
57paizuriGeneral507913537.62
58bismarck_(kantai_collection)Character476112737.48
59hatsune_mikuCharacter752420237.24
60otoko_no_koGeneral709819236.96
61shigure_(kantai_collection)Character516514435.86
62re:zero_kara_hajimeru_isekai_seikatsuCopyright1086930635.51
63hibiki_(kantai_collection)Character548315635.14
64narusawa_ryoukaCharacter529715733.73
65shielder_(fate/grand_order)Character904727133.38
66feetGeneral644119433.2
67girls_und_panzerCopyright2092964632.39
68yuriGeneral1535550230.58
69sexGeneral1656254330.5
70sagisawa_fumikaCharacter507116730.36
71sword_art_onlineCopyright483218326.4
72fire_emblemCopyright521220026.06
73cum_in_pussyGeneral755229425.68
74granblue_fantasyCopyright2137987324.48
75huge_breastsGeneral1219450324.24
76zhan_jian_shao_nyuCopyright709429524.04
77loliGeneral593424823.92
78pokemon_smCopyright721931922.63
79kantai_collectionCopyright88299402221.95
80fate/grand_orderCopyright20460108718.82
81love_live!_sunshine!!Copyright649739216.57
82touhouCopyright50139308616.24
83fate_(series)Copyright21522135415.89
84love_live!Copyright891678411.37
85translatedGeneral60136349.48
86pussyGeneral71518228.69
87cumGeneral53806598.16
88idolmaster_cinderella_girlsCopyright1041513557.68
89idolmasterCopyright982315916.17
90nudeGeneral632111765.37
91assGeneral934718355.09
92pantyhoseGeneral602215393.91
93nipplesGeneral615719383.17
94large_breastsGeneral1138337643.02
95pantiesGeneral515923352.2
96originalCopyright801238972.05
97breastsGeneral11578105561.09
981girlGeneral7713182360.42

Will add it to the prototype report at the next iteration, as it gives a helpful indicator to uploaders of what people are looking for.

BrokenEagle98 said:

as it gives a helpful indicator to uploaders of what people are looking for.

Animated futanari bestiality bdsm rape involving Donald Trump, you mean?

Can't see myself uploading any of that any time soon.

I'm not getting what you mean by scores, since median score is based on the scores. (specifically it's the Q2 value)

As for favorite count, there could be a category named median favcount... is that what you're looking for...?

BrokenEagle98 said:

I'm not getting what you mean by scores, since median score is based on the scores. (specifically it's the Q2 value)

As for favorite count, there could be a category named median favcount... is that what you're looking for...?

It's already there what I said: Make an own category for median score and/or favorite count, since some users aren't mentioned there, although they should lead this category (Ars AND CodeKyuubi, I assume). Or maybe not creating a new category, but maybe the lower border from 300 to..whatever...200 maybe? 300 posts in a month are still quite a lot, but more than enough to get a good grasp of the user's uploading habits :o.

May I ask why the reports aren't actualized the same time? Some reports are still from the beginning of November while the latest Approver report is from November 20th.
I think the reports should be actualized simultaneously.

Just some updates since (i think) the reports are beginning to stabilize.

I think including the standard deviation on the tagger report is useful information since the average can be misleading depending on the sample. Median count might be useful too.

Many of the upload/approver reports already include confidence intervals for deletion and negative scores, but it's straightforward to add confidence intervals for expected score also. To be succinct, this number represents a lower bound on the expected average score. Whether or not score is an accurate indicator of quality will always be up for debate, but it's useful to have this information.

Putting these here for comparison. Did a direct comparison with the same time periods in an attempt to validate the results of both reports, however this did not yield exactly the same results...¯\_(ツ)_/¯

Despite that, many of the numbers for both versions of the report are still very close to each other which is good. Not sure why the numbers are so far off for the artist report. Gonna go back and check my code again.

Going through the reports on Isshiki though, it's clear for the artist and wiki page reports that create events are being counted as part of the editing events instead of being mutually exclusive. This was determined by comparing the Total, Creates, and all other editing columns, as the sum of any editing column plus the Creates column should not exceed the Totals column. This issue is demonstrated below.

  • Isshiki Artist Report (1st row): 370 Creates + 371 Name = 741 > 472 Total
  • Isshiki Wiki Page Report (1st row): 90 Creates + 317 Oth Name = 407 > 364 Total

Will be submitting an issue on Reportbooru for the above. Also, now that the other reports were updated on 4 Dec, will be running those reports as well as a comparison.

Reportbooru issue # 2
https://github.com/r888888888/reportbooru/issues/2

Data

http://isshiki.donmai.us/reports/contributor_uploads/2016-11-29_v1.html

Contributor Upload Details - Updated at Tue Nov 29 08:30:54 2016
RankUsernameTotalQueue BypassDeletedParentSourceSQEGenTagCharTagCopyTagArtTagEmptyTagRemoves
1Sacriven101910135111101883212067341041152130010184137
2andalus8128093758127948101982814851295792188
3Fenen785763181357856245310824244115815127687197
4zeparoh765764066765678816337849279967651098
5gary25566674670459674502108641360977111136633110
6tapnek58554382258557672131021035720585337
7Qpax51251023349445451723553450546444566
8zaregoto506503237506389704710654592736506066
9Lannihan438436228438354701413342634456431389
10CharleyDodger361361083613461328042772580349351
11Shallie36035802136033129013202312422367736
12Bibs3563551381973094078123173394230178
13Guilty343353224110133485087433675662200143
14keonas338334226332173115508879345389336037
15Jarlath3323223163323284097707633683241071
16Doragonn329329038329168115467428501509328031
17Elektronik283527212832453448449274348278051
18dereyoruk27827715226717773288434263352275046
19john198027427407827417848485488268322273451
20Zettamorose26426407261255186838748491258523
21Randeel25824222025818358177561336292257129
22GiantCaveMushroom25825805258257109435404288257128
23Blue_Stuff254253119252245905268493309254026

Note: Cutoff was 250 total Upload changes; duration was 30.08 days

http://isshiki.donmai.us/reports/post_changes/2016-11-18_v1.html

Post Details - Updated at Fri Nov 18 23:53:55 2016
RankUsernameTotalParentRatingSource+-GenTag+-CharTag+-CopyTag+-ArtTag+-EmptyTagOther
1Type-kun3179950132400, (28)0, (0)1, (1)33, (41)0, (0)9
2evazion223607299927164, (286)5, (0)2, (235)30, (1)4, (9)11
3RaisingK142709136154852, (6891)1, (0)1, (1)495, (0)4, (12)1804
4kuuderes_shadow12535264015741, (716)24, (1)181, (6)0, (1)2, (14)23
5Rignak116851211911738, (829)6, (4)9, (14)4, (5)6, (4)10
6BrokenEagle98100019306280, (111)2143, (5)63, (40)2028, (290)107, (719)44
7Hillside_Moose72241210184, (2322)996, (1056)4134, (5228)0, (0)0, (3)0
8NWF_Renim69194006533, (306)67, (51)103, (99)330, (0)0, (4)2
9zeparoh539837316650, (1286)41, (10)45, (5)3, (0)2, (10)30
10Benit14946063006486, (228)39, (15)8, (2)5, (0)0, (18)8
11bad_mongo3274200134, (3216)1, (0)2, (0)3, (2)0, (1)1
12Insanity_Demon244220102884, (212)11, (1)7, (2)5, (4)0, (3)12
13EB214529075605, (154)124, (19)41, (5)18, (3)2, (9)9
14Provence1599971319769, (89)124, (0)14, (0)14, (0)13, (9)70
15OOZ662138219021369, (251)45, (41)2, (70)1, (0)0, (3)5
16CharleyDodger135611522402, (100)169, (17)188, (10)35, (3)4, (32)27
17iphn12706802701, (226)0, (0)1, (0)1, (0)0, (1)0
18RiderFan9651001183, (98)2, (0)2, (1)0, (0)0, (0)8
19KyteM891200866, (67)68, (27)183, (155)1, (0)3, (44)20
20Vid-szhite8878001393, (31)7, (1)9, (0)0, (1)1, (8)71
21reiyasona8121001265, (68)0, (0)0, (0)0, (0)0, (0)4
22john198074836151412, (20)439, (0)328, (1)51, (0)204, (2)46
23henmere6978034159, (90)67, (0)50, (7)459, (212)1, (274)7
24Unbreakable6763001950, (170)8, (1)0, (0)0, (0)0, (1)0
25Fenen62949411001, (26)38, (3)7, (3)20, (1)1, (6)12
26Sacriven603111031115, (96)9, (0)25, (1)6, (2)0, (3)3
27ion2885400120424, (355)0, (0)0, (0)0, (0)0, (0)0
28tapnek5242891460, (272)19, (4)3, (10)114, (82)0, (39)10

Note: Cutoff was 500 total Post changes; duration was 30.08 days

http://isshiki.donmai.us/reports/artist_commentaries/2016-11-28_v1.html

Artist Commentary Details - Updated at Mon Nov 28 23:02:08 2016
RankUsernameTotalCreatesOrig TitleOrig DescrTrans TitleTrans DescrOther
1Ricetaffy99234981836658018
2Sacriven76376122220
3andalus61360605101
4john1980269107511444905
5Jarlath21521411110
6Vid-szhite2055214941164
7NWSiaCB178600271881
8RaisingK165311598190
9Krugger15414715010
10Krad_Hunter13012401122
11Moonspeaker1297033971102
12dereyoruk12312211110
13Tsumanne113537638251
14Brightlight103622723320
15Lannihan807822220
16zaregoto771891138448
17Elektronik757500000
18Hoppo757301210
19Dinglecockles727200000
20Kilias71301236240
21GiantCaveMushroom686800000
22Blue_Stuff666401110
23Stun-99656500000
24Qpax655549000
25Randeel656500000
26DanbooruBlacklist615800221
27OMGkillitwithfire59380016150
28TicClick575413330
29impulse_eye565600000
30Paracite5450534370
31firechikara53250417180
32JuanValdezJr5301735280
33Sausageroll525200000
34sweetpeɐ514612441
35Nitrogen09504200650
36BrokenEagle9850230121222

Note: Cutoff was 50 total Artist Commentary changes; duration was 30.08 days

http://isshiki.donmai.us/reports/artists/2016-11-15_v1.html

Artist Details - Updated at Tue Nov 15 19:37:43 2016
RankUsernameTotalCreatesNameOther NamesURLGroupDeletesUndeletesWikiOther
1BrokenEagle98762644172115012280
2RaisingK690550063500000
3andalus217562316111000
4henmere207294713617143120910
5tapnek82549172521011
6CharleyDodger6636063020010
7Qpax5138041221000
8sweetpeɐ49137103400040
9kars414231031110020
10Randeel410094106130
11Zettamorose4023011710010
12Kikimaru4025061302002

Note: Cutoff was 40 total Artist changes; duration was 30.08 days

http://isshiki.donmai.us/reports/wiki_pages/2016-11-15_v1.html

Wiki Page Details - Updated at Tue Nov 15 21:10:07 2016
RankUsernameTotalCreatesTitleOther NamesBody EditsOther
1evazion6089211385019
2BrokenEagle9849711811393643
3andalus165211111440
4henmere11345422600
5CharleyDodger10739022554
6john1980644300210
7Kronnang_Dunn6218010420
8Benit149594000190
9zeparoh38330430
10iridescent_slime381305250
11keonas36270920
12EB30171690
13bad_mongo25190150

Note: Cutoff was 25 total Wiki Page changes; duration was 30.08 days

Updated

It will be... most of my computer's cycles went to generating the above comparisons though. I also still have to do comparisons against the other reports that got generated on 4 Dec.

I'll sneak some time in this weekend though to update it, as it's mostly an automated process by now...

Shouldn't the vandalism parts be deleted from the reports? I see some users there, like iphn who are doing a great job at their tagging. Yet, this user is listed under the vandalism section.
I mean, I could understand it if there are a lot of reverted posts, but is this really the case?

All I want to say is that the two van dalism sections could put users in a wrong spotlight.

issue #2690

That report is just a rough first attempt. It's being placed on Isshiki so that others can comment on it to help refine it. Not sure what the metrics are to record an instance as vandalism...? I'll have to take a look through the code later to see how it works...

Edit:

Looks like what it's doing is counting every tag edit combination by Member-level users, and displays all that have a count >= 5.

Perhaps a name change would be appropriate to remove the negative connotation, because as you pointed out, many of those edits are valid.

Thoughts?

Updated

1 5 6 7 8 9 10 11 12 13 15