Do MoCA devices need to be powered on all the time?

Yes, they are designed to stay on all the time.