It could be blowback. On the ground, give up elevator and push on the control surface. Does the elevator collapse back down despite the servo trying to hold it? Try this with your surfaces.