People afflicted with OCD compelled to partake in a worthless scavenger hunt is why people hate them.
Imagine climbing a tall structure in hopes of finding something special, like a rare weapon for example, as a reward for managing to get up there, and all you find is one of these fuckers "rewarding" you with a worthless token. THAT is why people hate them, because their mere existence takes out the fun of exploring the world. Luckily the devs learned and added escort missions for them, which you can use to torture them, and once you had your fun you can just yeet them and not worry about missing out on something because you didn't fulfill the quest.