Is it configured using RC assisted provisioning or as a generic IP phone? I might try factory defaulting it and provisioning it again. Do you have any other of the same model phone are working correctly?
I'm having this same issue. We have five Cisco Spa 508g Ring Central phones -- the voicemail indicator light doesn't light up on any of them when there is a message. Was there a resolution to this issue?