[Live2D Protips]
Eyes are delicate matter for face tracking, so expect a lot of jitter out of it. I've seen plenty of 2D Vtubers with this 'lazy eyes' look on them.
You can try to compensate the jitters from rigging side by adding some extra 'buffer' keys to the eye open state.