Welcome to THE forum. If you are referring to the front, inboard shift lever that connects to the shaft and then to your actual foot levers, than no you do not have to remove the inner primary. Just remove shift shaft that goes back to the rear shift lever, loosen the allen bolt on the inner front shift lever, remove outer foot levers and slide the shaft out.
Be sure to check the bushings in the hole the shaft goes in. When they wear it causes undue stress on the whole system. Clean shaft and slide it back in and check for play. If you have any you may consider new bushings. Use some never seize or some good grease on re-assembly. Good luck and let us know how it goes.
Bodeen