Indeed it is. I don't know exactly how you remove it, but I've seen exploded diagrams of the arm rest on google and it does look like just the arm rest bit separates from the main assembly.
I have the same problem. Mine's cracked in several places and the 'leatherette' replacements cost a bloody fortune! Can't seem to find a used one at all!