Yes. These are called isolators. The bushings are actually in the swing arm. The isolators are eccentric and must be installed correctly. See the instructions.
olskool i got my 93 flh out of a bone yard & my thoughts too when removed these are bent but no.There is a bump onem it goes in a slot if i remember, it been a few years..& Welcome from south bend.....