Come to think now, I got once a 5-stars weapon from the permanent banner when I was expecting a character.
Gotten two from the permanent banner, a catalyst I never use and Ganyus bow (that I use with with her, wasn't even aware it was hers until her rerun that offered it). I've only ever wished on the weapon banner one ten pull and managed to get Raidens polearm, never bothered to again.