For some reason the Harmony configuration application does not apply the HR20 control buttons in "Activities" correctly by default.
It seems to apply the buttons correctly in "devices" but not "Activities" that include the HR20 as a device.
I needed to manually add all the "Control"...