Danbooru

Similarity Tool Not Triggering

Posted under Bugs & Features

Not sure if this is isolated to myself, but when I tried to see if https://pawoo.net/@junyurijp/5317580 had been uploaded by using the bookmarklet, but nothing similar came up. I then tried using the bookmarklet to upload it from pixiv to see if that would trigger it and it still did not. The post has been uploaded before at post #2446059

Similar testing against post #2448150 had no tripping of it. But tests against post #2689672, and post #2703424 do trip the similarity trigger.

I'm not sure if it's a problem just for the artist in question vashaps2 or what is going on.

The built-in Find Similar tool in general is hit-and-miss for me. Not only does it sometimes not return a similar image when it exists, but it works very slowly sometimes (Up to a minute's wait), it's just better to use iqdb.

This is verified as I noted in topic #13677. Basically, there are a plethora of posts that fail to match similarities even against themselves.

I created issue 2 on IQDBS for this, but it still hasn't been fixed... :/

BTW, a second way a post can match is if it is an MD5 match, however the two sources (Pawoo and Pixiv) had different file sizes and MD5 hashes.

CodeKyuubi said:

The built-in Find Similar tool in general is hit-and-miss for me. Not only does it sometimes not return a similar image when it exists, but it works very slowly sometimes (Up to a minute's wait), it's just better to use iqdb.

Danbooru's find similar is based on piespy's iqdb code, so they should return the same results, assuming everything is working properly. I would guess the slowness is in downloading the image.

BrokenEagle98 said:

This is verified as I noted in topic #13677. Basically, there are a plethora of posts that fail to match similarities even against themselves.

I created issue 2 on IQDBS for this, but it still hasn't been fixed... :/

Are these failures on old posts, or are there any on posts uploaded since issue #2867 was fixed ~3 months ago? I'm wondering whether that fixed it or not. For the older posts, albert would probably have to regenerate the entire iqdb database to ensure it isn't missing any posts.

After the help evazion provided me in issue #3010, I was able to investigate this issue again.

I went back through one month worth of posts (I can go back further if needed), and every one of them was able to find themselves when using the POST_ID function, so it looks like this issue has been fixed at least for all posts uploaded recently.

1