Here is the schematic. Terminal A is a controlled ground from the BCM, B is a ground supplied when you press the switch and C is your power feed from the BCM. Sounds like either the switch in the mirror or something with the wiring in the rearview mirror.
Attachment 6985