ORIGINAL: britbrat
The little brass block should have a snap-on collet on the pin that goes through the servo arm (either that or a nut that threads on). You can buy replacement collets at your LHS.
Thanks everyone - that's the problem. The collet or the nylon retainer is gone. I'll check around and get another.
I love this site!