This really isn't that evil. We've seen how quickly Kogasa bounces back when Sanae hit Kogasa's sore spots about her past. It's not like she's just an umbrella anymore, forced to sit in a bin while people pass her over because they don't like the colour... leave her behind and she'll probably just wander back to the cemetery, where she appears to be quite happy living alone and scaring people.