Could arca.live commentaries for existing posts be fetched automatically?

Posted under General

source:*arca.live/b/* -bad_arca.live_id -commentary_request -commentary

There are upwards of 1700 arca.live posts missing commentary. If I understand the site correctly, every forum post should have at least a title. There's definitely a lot of untagged bad_arca.live_id or missing commentary or commentary request in there, though.

I spend a couple minutes manually clicking Fetch and commentary request on like 30 posts, but then I saw the pages of results and gave up. Could this be automated somehow?

I think source:*arca.live/b/* -bad_arca.live_id commentary:false should be a better search for this, but it times out for me.

I guess the main problem with my script was that I didn't have any skip logic for potential problem posts so if I tried to rerun it, it'd just get stuck trying to fetch the same post and trigger a CAPTCHA for the extractor. I started running it again shortly after I saw this topic with some fixes and new skip conditions in place and haven't run into any rate limiting troubles so far.

I haven't finished going through all posts missing commentary yet but I'm triggering runs every now and again so more arca.live posts should be receiving either commentary request and korean commentary or bad arca.live id. I've gotten (source:*arca.live*) -has:commentary -user:Skill_Issue -bad_id -bad_source down to about 800 results at the time of posting.

Shortly after the extractor was fixed I fetched the commentaries for the most prolific arca.live uploaders (Skill_Issue, Machikado and Fenton, maybe there was another name in there that I'm forgetting) so the remaining results are just from everyone else. I think all missing arca.live commentaries should be filled in by either late today or tomorrow.

1