Danbooru

[Prototype] User Report Ver 6.3

Posted under General

NWF_Renim said:

When a post gets deleted through the mod queue it gets credited to albert.

To be more accurate, when it gets deleted through the mod queue, it ALSO gets credited to albert.

E.g., http://danbooru.donmai.us/post_flags?search[post_id]=2521288

If albert doesn't manually apply any flags, he could always disregard all post flags where creator_id=1. Otherwise, the language for deletion through the queue is standard, which could also be searched for and discarded.

http://isshiki.donmai.us/reports

I'm digging the new user coloring and column ordering functionality, although pages like this make me feel colorblind. I know there are supposed to be 3 different member levels represented, and maybe it's my crappy monitor, but I couldn't tell the difference between Member, Gold or Builder if my life depended on it.

Noticed some of the same concerns that I had noted previously, namely:

  • The notes report is still missing the totals column
  • Still missing the pools report
  • Post changes report still missing General tag category
  • Contrib could be taken out of all reports, since it really only matters for uploads, and those reports are already being separated
  • Some of the cutoff values seem rather high, as the reports are not very populated

Here is some new feedback:

1. Noticed that the Create events may not be counted separately from all other events, e.g. the artists report has me listed as having 935 Total, 809 Creates and 819 Name.

  • This should not be. The Creates column plus any other column should never exceed the Total column, since the Creates column should be mutually exclusive of every column except for the Total column.
  • This holds true for all versioned reports excepts for the Post report, since the create events are already separated into the Uploads report.
    • So this would need to be fixed in the Artists, Artist Commentary, Notes, Pool, and Wiki Page reports.

2. In the Forum Topic report, in addition to counting the different forum topic categories, it would be interesting to see the total number of replies to the topics like in the Prototype Report. The replies category shows those users that generate topics with a lot of feedback/interest from the community.

The colors are indeed messed up.
For example approvers (since we have all user classes there except Platinum):
http://isshiki.donmai.us/reports/approvers/2016-10-30_v1.html
Purple = Builder
Yellow = Moderator
Red = Admins
Navyblue = Gold
Navyblue = Member
Green = Janitor
(Grey = Platinum)

So I'd suggest to make a lighter blue for Member level (like in the forums) or change to color to, I don't know, pink for example. Btw. Purple and Navyblue is also hard to distinguish, but it is still ok.

Colors do also only work on the latest report sometimes (except Approvers for example where colors work also for older version).

Artist commentary for example:
http://isshiki.donmai.us/reports/artist_commentaries/2016-10-28_v1.html (Old)
http://isshiki.donmai.us/reports/artist_commentaries/2016-10-30_v1.html (New)

Updated

Here is the current color scheme for users: reference

Admin color: red (#FF0000)
Moderator color: orange (#FFA500)
Janitor color: green (#008000)
Builder color: #6633FF
Platinum color: gray (#808080)
Gold color: #0000FF (blue)
Member color: auto (browser default for hyperlinks)

The following are just my suggestions:

For Builder, maybe change it to teal (#008080).
For Gold, maybe change it to deeppink (#FF1493).
For members, maybe change it to blue (#0000FF).

Ultimately though, it would be nice to be able to modify the colors with user custom CSS, or even better, use the user's custom css from Danbooru, and have the same markup of usernames that exists on this site. That would include post-uploader, post-approver, super-voter, etc.

Reference

  • All color names/hex values pulled from Wikipedia

https://en.wikipedia.org/wiki/Web_colors

Updated

1. Get the JSON of the Uploads report from here (members) or here (contributors).

2. Copy all of the JSON text and post it into the JSON window at https://jqplay.org/.

3. Copy the text between the quotes in "map({user:(.name),untagged:((.total)-(.artist | tonumber))})| sort_by(.untagged) | reverse" into the Filter window at https://jqplay.org/.
Note: Javascript needs to be enabled.

What the above does basically is subtract the Totals column by the Artist tags column, and then sorts by the result.

The following are the results for both tables:

Member
[
  {
    "user": "Guilty343",
    "untagged": 147
  },
  {
    "user": "Rignak",
    "untagged": 136
  },
  {
    "user": "Monki",
    "untagged": 48
  },
  {
    "user": "Megamet",
    "untagged": 32
  },
  {
    "user": "TomReidem",
    "untagged": 28
  },
  {
    "user": "Kentaku",
    "untagged": 26
  },
  {
    "user": "Cristianlush",
    "untagged": 22
  },
  {
    "user": "Chimera99",
    "untagged": 20
  },
  {
    "user": "mnichu",
    "untagged": 18
  },
  {
    "user": "hamasen205",
    "untagged": 17
  },
  {
    "user": "worldendDominator",
    "untagged": 12
  },
  {
    "user": "Elektronik",
    "untagged": 9
  },
  {
    "user": "kars41",
    "untagged": 8
  },
  {
    "user": "Krugger",
    "untagged": 6
  },
  {
    "user": "fsnfanboy",
    "untagged": 5
  },
  {
    "user": "Omegamagnum",
    "untagged": 3
  },
  {
    "user": "kudus",
    "untagged": 3
  },
  {
    "user": "Danaii",
    "untagged": 2
  },
  {
    "user": "NWSiaCB",
    "untagged": 1
  },
  {
    "user": "Stun-99",
    "untagged": 1
  },
  {
    "user": "Dinglecockles",
    "untagged": 1
  },
  {
    "user": "SciFi",
    "untagged": 1
  },
  {
    "user": "Kikimaru",
    "untagged": 1
  },
  {
    "user": "Parnifia_the_Bastard",
    "untagged": 0
  },
  {
    "user": "Rashurk",
    "untagged": 0
  },
  {
    "user": "DanbooruBlacklist",
    "untagged": 0
  },
  {
    "user": "nanami",
    "untagged": 0
  }
]
Contributor
[
  {
    "user": "Bibs",
    "untagged": 180
  },
  {
    "user": "Qpax",
    "untagged": 99
  },
  {
    "user": "DeusExCalamus",
    "untagged": 35
  },
  {
    "user": "CharleyDodger",
    "untagged": 18
  },
  {
    "user": "Fenen",
    "untagged": 14
  },
  {
    "user": "Sacriven",
    "untagged": 11
  },
  {
    "user": "Stan_Miller",
    "untagged": 9
  },
  {
    "user": "zaregoto",
    "untagged": 9
  },
  {
    "user": "andalus",
    "untagged": 9
  },
  {
    "user": "Provence",
    "untagged": 7
  },
  {
    "user": "Jarlath",
    "untagged": 7
  },
  {
    "user": "GiantCaveMushroom",
    "untagged": 6
  },
  {
    "user": "gary25566",
    "untagged": 6
  },
  {
    "user": "Shallie",
    "untagged": 3
  },
  {
    "user": "Doragonn",
    "untagged": 2
  },
  {
    "user": "Apollyon",
    "untagged": 2
  },
  {
    "user": "zeparoh",
    "untagged": 2
  },
  {
    "user": "pikuchan",
    "untagged": 1
  },
  {
    "user": "tapnek",
    "untagged": 1
  },
  {
    "user": "dereyoruk",
    "untagged": 0
  }
]

Check the first post for the latest... Also I plan on updating the rest tomorrow, primarily to validate the results on http://isshiki.donmai.us/reports

Ver 4.6 -> Ver 4.7

  • Added two new table types
    • Translator Tags table which tracks all of the adds/subtracts of certain translator tags. <Provence: from a Dmail>
    • Requests tables which track all of the adds/subtracts of non-translator *_requests tags.
      • Adds table is ordered by total tags added, showing those who are producing those requests.
      • Removes table is ordered by total tags removed, showing those who are fulfilling those requests.
Edit:
  • Updated all tables to Nov 2 to match the latest reports on Isshiki for comparison

Updated

A couple things:

  • Something seems off in the wiki page table - the creations column is zero for everyone, and the other names column credits me with 246 edits, but I don't think I added nearly that many.
  • Would it be possible to wiki-linkify the tags in the post details tables? That way my userscript can colorize them by type.

evazion said:

  • Something seems off in the wiki page table - the creations column is zero for everyone, and the other names column credits me with 246 edits, but I don't think I added nearly that many.

Ah snap... the Create events were being added to the Title column (wonder how long it's been that way...?) Anyways, it's been fixed....

As far as the other names, well originally that field was being set to NULL when nothing was entered there, but at some point it started being switched to "". So even if you don't touch the other names, it'll convert it over to the new blank format of "", and NULL != "", so my script counts that as an edit. I'll probably add in a check for that in a future version, once I've found all of the other fields in all of the other versioned-types with the same issue.

  • Would it be possible to wiki-linkify the tags in the post details tables? That way my userscript can colorize them by type.

Done...

Also, after looking at it more closely, I realized that I had forgotten to add the Translator and Requests tables into my forum post builder script, but they're added now.

Edit:

Forgot to mention that I had fixed the Wiki Page table.

Updated

Thanks for the quick fix. I think any text field that isn't marked NOT NULL in db/structure.sql is likely to have that issue. I know there are more than a few fields where null and the empty string may be used interchangeably.

EDIT: Also, this is probably off-topic, but what's up with the user usernam adding text to so many posts? Are those edits valid? Is tagging random comic posts with text (see: comic text) really necessary?

evazion said:

Thanks for the quick fix. I think any text field that isn't marked NOT NULL in db/structure.sql is likely to have that issue. I know there are more than a few fields where null and the empty string may be used interchangeably.

EDIT: Also, this is probably off-topic, but what's up with the user usernam adding text to so many posts? Are those edits valid? Is tagging random comic posts with text (see: comic text) really necessary?

@Wypatroszony gave them a negative feedback. Maybe this need a second look?

Could we expand the taggers category to 50 posts as the cutoff line?
Right now the cutoff is at 100 posts, and the list will surely be longer, but then tagging is pretty important and 50 posts per user are enough in my eyes to tell if a user is good or bad at tagging and 50 posts is a good amount of posts that would be bad tagged.

Also another concern is space: Right now there is the actual list and then some kind of JSON list (I can't work with that, what is that?).
So my question is, because after time, there will be many dates and JSON links, so I wonder if older date will be discarted after some time? And really, what am I supposed to do with a two month old report^^?
So is there some control mechanism behind that deleted older reports automatically and do we really need these JSON links?

Updated

@Streichkonzert

I updated the Top/Bottom tables with the new cutoffs.

To answer your other questions, the reports on Isshiki are still a work in progress. The historical reports are there because eventually different time periods will be selectable so that user trends can be analyzed, such as their activity going up or down in various areas. (Similar to the RankDiff in my tables)

The JSON is very useful to programmers like myself since it is structured data. HTML is unstructured data, so I'd have to fumble around with RegEX's in order to scrape the HTML if that's all I had access to.

I plan on using the JSON this coming week to do a direct comparison between his data and my data and see if there are any huge outliers that may indicate a problem in his or my code.

evazion said:

Also, this is probably off-topic, but what's up with the user usernam adding text to so many posts? Are those edits valid? Is tagging random comic posts with text (see: comic text) really necessary?

Streichkonzert said:

Wypatroszony gave them a negative feedback. Maybe this need a second look?

I've removed text from all the posts where it was added by that user.

1 4 5 6 7 8 9 10 11 12 15