in that case yes you need to remove the inner bit where the speakers are then remove 3 screws 2 under the bit of trim i've just mentioned and one hidden under a black plastic grommet, you will need to remove the door card to remove the plug for the mirror, then you can pull it all off and cover it.
fyi it will be quite hard to refit as you need to squeeze it back under the rubber door bit and its a pain in the arse.