You have an error in your schematic.

You need to cut the positive lead on the retract servo but not the ground lead.

That has to be connected to provide the output signal to the servo. Without it, the servo will not move.