I had an idea:

I might put socket-head cap screws in from the backside
through the retract plate, then tighten a lock nut. I should
be able to fit an allen wrench in there to hold the bolt, then
torque the nut. We'll see how that goes!