That is a sensible thing to do.
Remember, when connecting/disconnecting a cable, if a shortcircuit happens accidentally at the receiver side of the switch, the receiver usually has an overcurrent protection mode, so that the receiver isn't harmed.
(Some receivers can restart themselves, after...