pins and needle bearings

I am puzzled by how to separate the swingarm from the "rocking lever," the L-shaped casting that connects the tierods to the lower shock mount of a 2006 SM610. I have to replace the needle bearings on the rocking lever (above the lighter) but want remove the lever from the swingarm to seat the bearing.

It looks like there is a rubber seal over the outside of the rocking lever's needle bearings that will need to be removed first. Second, I worry that I will damage and/or not be able to remove the old needle bearings and install the new needle bearings with the rocking lever attached to the swingarm.

Do you know how to remove the rocking lever from the swingarm?