Change log - 8/27

The sonohara.donmai.us server now uses a solid state drive to host the thumbnails. This should hopefully reduce the iowait that was causing the server load to spike. This necessitated a bunch of code changes so let me know if anything broke.

If things go well I will add a similar drive for hijiribe.

This change currently breaks iqdb parsing of the XML because the thumbnail URL returned is a relative URL.

Is this intentional or can you make it an absolute URL again?

albert said:
The sonohara.donmai.us server now uses a solid state drive to host the thumbnails. This should hopefully reduce the iowait that was causing the server load to spike. This necessitated a bunch of code changes so let me know if anything broke.

If things go well I will add a similar drive for hijiribe.

One thing I wonder, will it possible to readd the amount of tag edits a user has done with these changes?

The site has been running much much better for me ever since I saw the fastbooru tweet go up.

it broke my app XD~

anyway is there a planned fix for tag page in api?

http://danbooru.donmai.us/tag/index.xml?page=2 and
http://danbooru.donmai.us/tag/index.xml?page=3 and
http://danbooru.donmai.us/tag/index.xml?page=100
just all returning the same list (which is page 1).

piespy said:
This change currently breaks iqdb parsing of the XML because the thumbnail URL returned is a relative URL.

Is this intentional or can you make it an absolute URL again?

Bump. Can you tell me if you're going to fix it soon, or should I implement a workaround?

piespy said:
Bump. Can you tell me if you're going to fix it soon, or should I implement a workaround?

it's easy to workaround.
for all preview_url without a protocol and hostname, i just grab the one from file_url and make preview_url pointing to the same host.

Palatis said:
it broke my app XD~

anyway is there a planned fix for tag page in api?

http://danbooru.donmai.us/tag/index.xml?page=2 and
http://danbooru.donmai.us/tag/index.xml?page=3 and
http://danbooru.donmai.us/tag/index.xml?page=100
just all returning the same list (which is page 1).

Just a random poking in the dark, but did you, umm, try JSON pages instead? I really wouldn't be surprised if they worked, based on the previous experiences...

Edit: Nope, not this time.

Palatis said:
it's easy to workaround.
for all preview_url without a protocol and hostname, i just grab the one from file_url and make preview_url pointing to the same host.

I did this now.

The "Find similar" link on all pictures is broken for the same reason, by the way.

piespy said:
The "Find similar" link on all pictures is broken for the same reason, by the way.

I'd make a trac for this but it's just timing out whenever I try to open it. So bumping this instead.

Bumping again. Trac still isn't working.

I just checked, and it seems that the Trac is working now.

If it goes down again, I'd recommend just PMing Albert about it (the last time it went down, he fixed it shortly after I PM'd him).

piespy said:
The "Find similar" link on all pictures is broken for the same reason, by the way.

This really does need fixed (also shouldn't be that hard to change a relative link to an absolute one). Also it appears now that trying to force IQDB to work with the direct URL from danbooru causes it to stall forever. A change to the hotlink permissions may also need to be done.

I think this is a pretty important thing that needs fixed for moderation purposes, since I like to verify that new uploads aren't duplicates or lower quality versions of existing posts (also to be able to flush out tags and artists and such where they are better versions).

Doing this kind of search manually, or even being forced to download each image in the queue to run IQDB directly is a bit too much work to expect for a large mod queue. Moreover when downloading and running it that way, there will usually be a match with that exact post, which is inferior performance to the direct approach that compared only against *other* posts.

Right now I'm basically back to approval without a similarity search which I think is a bit risky for quality reasons. It'd be nice to have the old "find similar" function working properly again.

Shinjidude said:
Also it appears now that trying to force IQDB to work with the direct URL from danbooru causes it to stall forever.

Danbooru works fine for me, however Hijiribe always stalls on my end. Sonohara seems to work fine too.

You can copy the location of the thumb and submit that way rather than downloading the image and submitting it. This is far from ideal but it works for images you suspect are dupes.

Shinjidude said:
This really does need fixed (also shouldn't be that hard to change a relative link to an absolute one). Also it appears now that trying to force IQDB to work with the direct URL from danbooru causes it to stall forever.

Both issues should be fixed now. I've changed the iqdb frontend to just fix the broken URLs, since it doesn't look like Albert's going to do anything about them any time soon.

Nice! This is very helpful. Thanks a lot.

piespy said:
since it doesn't look like Albert's going to do anything about them any time soon.

How right I was, unfortunately.

But now that the hanyuu.net link is down again and I really want to stop maintaining it, how do I get Albert to change it to danbooru.iqdb.org and fix the relative URLs? I tried the forums, I tried dmail, there's been a lonely trac ticket for 6 months to no effect... I feel like I'm out of options to get his attention.

Apparently by sending me a message on Steam.

What do I need to do?

Also if I don't answer to dmails for something you think is important, you should just message me again. It may be the case I read your message, put it on the back burner to think of it, and then forget about it because I don't see the notice anymore.