Danbooru

ArtStation Integration

Posted under Bugs & Features

wet ass pussy

I've noticed that there is some automated restructuring of image URLs in artist URL boxes and I think something similar may need to be done with ArtStation sources.

First of all ArtStation profiles have actually two different URLs. For example.

I think that both of these should be required in the artist's URL list, or simply just the one with the user name in the TLD rather than www. This is not so important however.

Also it appears that the image URL artist name (stupid typo...) is injected into the source image URL, as follows.

Notice, jason-chan in there.

This could potential make it so that the source URL is all that is needed as with the case of DeviantArt and Pixiv, however I'm not certain whether you can derive information from the URL leading to the direct post. Which seems to me to imply that a user would have to post with the direct URL and then change source to the artistname.artstation.com link of the post.

I think this could go in a few different directions, I just want to raise awareness that this source could be handle much better.

Updated

Reply
wet ass pussy

A few important updates.

Full Resolution

On a posts page on ArtStation clicking the download or full size button leads you to load a deceptive URL. Often in fact the image you get is not preferable. As you can see by the image below sourced from this page:

In reality the highest resolution can be found only by modifying the one above to replace /large/ with /original/ as below:

Additionally although the image using /large/ may in some cases be the same dimensions as the /original/ it can in fact still be lower quality as in this case

Notice that the /original/ is both a higher file size and zooming in close you can see that it is also significantly better quality.

For these reasons I think it's imperative to have some automated sourcing done for ArtStation as is done for Pixiv. All ArtStation images should be fetched from /original/, all the time.

Sudomains

Users can modify their subdomains on ArtStation as I found out with Geo Siador. Notice from their artist page that they changed it from ep1cc.artstation.com to geosiador.artstation.com. For this reason the post page starting with WWW should always be used since this does not appear to be alterable by the artist. This is the type of post page that should be linked to as the HTML in an automated image > HTML source system.

Although I propose this course of action I'm not sure exactly how to fetch the associated HTML page just using the image source URL. If you have suggestions please jump in. My earlier reply to this topic is evidently incorrect.

[Edit: I fixed the URL from my first hyperlink]

Updated

Reply
evazion

Thanks for doing this research. I agree, ArtStation is another site we ought to add upload support for. Made issue #2769 for this so it's not forgotten. Personally I'm gonna focus on bcy.net first though, but after that's dealt with I can look into this, unless Type-kun or albert get to it first.

Reply
wet ass pussy

Alright that's good news. It's already done for other boorus? Since for how long? I guess I just assumed it wasn't and acted accordingly so I'll fix some of my uploads.

Oh and regarding ArtStation I just remembered posts also have tag lists which could aid in uploading as with Pixiv and other sites.

Reply
evazion

Looks like Toks and ghostrigger did most of this work in 2014. Here's the list of supported sites and here is the history if you really want the full details of who did what and when.

And yeah, I do want to support getting the tags and artist commentary and everything else, just haven't had time to sit down and work on this yet.

Reply
wet ass pussy

I was trying out the Image > HTML with Gelbooru and appears to not work. Sankaku and e-shuu however do. From my experience uploading I can say Facebook does not work either. I'll investigate more into which appear to be working at a time that isn't 4am some day soon.

Reply
wet ass pussy

Using image URL for source

I would like to rescind my earlier suggestion that people manually change the URL after upload. This is going to cause to many troubles when the change is automated. Because verbose edits are flushed after a short period the URL that was originally uploaded from will be lost. We cannot tell whether an image was uploaded from /original/ or /large/ unless its in the edit history. This will just cause additional work since the ArtStation post will have to manually viewed in order to see which source URL the corresponding post on Danbooru is actually sourced from.

Some scripting would be useful here but I lack any technical knowledge to do so. I will fool around with some manual artstation gardening techniques and post them if they were good.

So, please just leave the image URL.

Broken originals

Occaisionally I run into /original/s that renders an error. Firefox reports that the image "cannot be displayed because it contains errors." And Chrome, that the file is not found.

Example page:

Culprit URL:

I've emailed ArtStation regarding this but have not heard back. I will reply if I get an explanation or they fix the problem. It could be the case that these corrupted images are a pitfall that have to be resolved by contacting the website.

Why ArtStation doesn't provide a link for /original/

This isn't very significant however I emailed ArtStation inquiring as to why they do not provide any link to the actual original image and this is my result:

My email:
The download and open in new tab buttons on illustration posts do not give the original but rather the 'large' file link.

IE for https://www.artstation.com/artwork/OERZb
https://cdnb3.artstation.com/p/assets/images/images/001/701/139/large/nikita-varb-toro-yu-zhu-study.jpg?1451260957
https://cdnb3.artstation.com/p/assets/images/images/001/701/139/original/nikita-varb-toro-yu-zhu-study.jpg?1451260957

As you can see the original is much better than the 'large' one so why not link to that one instead?

ArtStation Support reply:
Hi,

Unfortunately we do not link to the original for bandwidth reasons. Some original files are up to 10MB in size and we cannot do this. For most purposes, large is enough.

Thanks,

Leo

--
Leonard Teo
CEO, ArtStation

Reply
wet ass pussy

evazion said:

Was looking at http://drawcrowd.com and noticed it seems to function in the same way:

That's interesting and I will give greater consideration to this source since the files I was getting there were so truncated and worthless. This could be on par with other sources and it should be automated too if possible. I foresee that eventually it may be broken if their cloudflare URL changes or they switch hosts. I wonder whether that domain is used for all user content on the site, and whether it is their own URL or if it's shared with other sites.

Reply
Sacriven

Sorry if this is a bit OOT, but I noticed that Artstation provides two kinds of URLs for their artist. The first is ****.artstation.com and the second is www.artstation.com/****. Which URL is the one that is more safer and accurate when it comes to uploading? I remembered that some guy said that sometimes the artist' images size and resolution differs for both URLs.

Reply
wet ass pussy

Sacriven said:

Sorry if this is a bit OOT, but I noticed that Artstation provides two kinds of URLs for their artist. The first is ****.artstation.com and the second is www.artstation.com/****. Which URL is the one that is more safer and accurate when it comes to uploading? I remembered that some guy said that sometimes the artist' images size and resolution differs for both URLs.

It should be the same resolution for either ***.artstation.com or www.artstation.com/***. That being said I think it would be best at this point to just upload from the image URL and then change nothing.

The problem is this. ArtStation has truncated versions of user content available on their website. They have deceptive 'download' and 'expand' links, however you need to manually edit these image URLs to have /original/ rather than /large/, as demonstrated below:

sweetpeɐ said:
On a posts page on ArtStation clicking the download or full size button leads you to load a deceptive URL. Often in fact the image you get is not preferable. As you can see by the image below sourced from this page:

In reality the highest resolution can be found only by modifying the one above to replace /large/ with /original/ as below:

Earlier I had suspected this has something to do with the user domain versus their profile on www.arstation.com (e.g., https://www.artstation.com/artwork/AgBvWe versus https://daole.artstation.com/projects/AgBvW) but this was incorrect. Eventually the post page will be linked to directly so uploaders should not be concerned over which is preferred since it will be done just like Pixiv.

Reply
Sacriven

Well damn, it means that all of my Artstation uploads weren't original-sized then. Thankfully I only uploaded a few. If only Danbooru has a feature that can replace an image completely without deleting the said post ID :/

Reply
Qpax

But the problem is as sweetpee mentioned some of the /original/ urls turns out to be corrupted. In my theory they are not corrupted but rather the original file size. I usually come across with this problem when I upload from artstation and when I do I usually check the other sources of the said image. So if artstation link has let says 500kb sized image on artstation then its possible find same size in artist's other fanart account such as pixiv or deviantart. But sometimes for example if the pixiv version image has 1mb file size but usually you find the much higher resulotion version on artstation sometimes. I wonder if this corruption issue /original/ has anything to do with artist side. Maybe they don't upload original versions of their works but rather sample sizes to artstation so thats why we might be getting these kind of errors.

Anyways thanks for reminder. If the artstation direct link for images provided with non-corrupted /original/ url then I'll not change my artstation uploads after I have uploaded them on danbooru. However if the /original/ link is corrupted and if you have only uploaded /large/ version then I don't think there will be any problem if we change the direct link with the image page.

And lastly thanks for changing sources for my artstation uploads sweetpee. You are such a sweetie =D

Reply
evazion

sweetpeɐ said:

I would like to rescind my earlier suggestion that people manually change the URL after upload. This is going to cause to many troubles when the change is automated. Because verbose edits are flushed after a short period the URL that was originally uploaded from will be lost. We cannot tell whether an image was uploaded from /original/ or /large/ unless its in the edit history. This will just cause additional work since the ArtStation post will have to manually viewed in order to see which source URL the corresponding post on Danbooru is actually sourced from.

I prefer leaving the image URL alone whenever possible because changing it loses information as you say, but here I don't know if it will be possible. I've looked but I can't find a way to derive the artwork page URL (https://www.artstation.com/artwork/zKbD6) from the image URL (https://cdnb3.artstation.com/p/assets/images/images/003/237/339/original/-2.jpg?1471462922). This is problematic because if we keep the image URL for the source then a) the source in the sidebar can't link to the artwork page, b) the artist finder and the "fetch source data" button (which gets the source tags) won't work.

Basically for those to work we need to be able to get to one of these URLs:

Which I don't think is possible from the image URL alone, it doesn't contain enough information:

The `/003/237/339/` bit is the image ID (i.e. it's ArtStation image number 3,237,339), but that's different from the artwork ID (1101731) and the artwork hash (zKbD6). The 1471462922 bit is a Unix timestamp, I'm guessing the revision date (assuming artists can revise images like they can on Pixiv). I don't see any way to derive `zKbD6` from these things.

Occaisionally I run into /original/s that renders an error. Firefox reports that the image "cannot be displayed because it contains errors." And Chrome, that the file is not found.

Example page:

Culprit URL:

So normally image URLs look like this:

The filename (/muck-muck-20161207-long.jpg) is usually the artist name and the artwork name separated by a dash, but here the artist name isn't present for some reason?

This is important because it means the artist finder won't always be able to work if we use image URLs, since they don't always contain the artist name. Even if it's there, it's ambiguous which part of `katty-haven-yellow-monster.jpg` is the artist name. So this is another reason why I think we might have to use https://www.artstation.com/artwork/zKbD6 for sources, since given that URL it is possible to find the artist name.

Finally there are these URLs too: https://ak-chyo.artstation.com/projects/Lr1lk. I was about to say this is the best source to use because it contains both the artist name and the artwork ID, but then I saw it doesn't work for https://ak-chyo.artstation.com/projects/zKbD6. So I don't know.

Reply
BrokenEagle98

The pattern eludes me... or maybe it's just not there.

Given the post URLs of...

https://www.artstation.com/artwork/zKbD6
https://ak-chyo.artstation.com/projects/zKbD6

...with image link of...

https://cdnb.artstation.com/p/assets/images/images/003/237/339/original/-2.jpg?1471462922

...I've been trying to figure out if there's a way to reverse an image link to get to the original post without much success.

The identifier at the end of the post link (zKbD6) could be base 64 or base 62.

Base64->10: 858370298
Base62->10: 906266096
http://convertxy.com/index.php/numberbases/

Neither of which matches either the extra identifier at the end (1471462922), or various arrangements of the directory structure (003/237/339).

Does anyone else have any extra insight on this, or are all those data items unrelated and the image URL is truly irreversible...?

Reply
1 2 3