I did some searches and couldn't find much. There are references to it being riveted on, but no suggestions/how-to for taking it off.
If it's going to be a major issue taking it off to swap, the only thing I can think of is that a locksmith (yeah, I know..$$$) might be able to swap the cylinders without removing the whole assembly.
I just talked with the service tech at one of our local dealers. He said the rivit is just to hold the bracket in place, so could just be drilled out and replaced with a screw later. In fact, said that it really isn't needed since the bracket itself holds the lock unit in.