Extra problematic since the word for am/pm (and multiple words related to "noon") literally has that exact Chinese character for "zodiac horse" in it because noon is the "hour of the horse" (traditionally 11 am to 1pm).

The other zodiacs also have their own hours of the day but Horse/Noon is the one that is still retained in common phrases.