Are your elevators joined in the center, or are there 2 separate push rods?

If they are joined, you could be experiencing a flex in the torque rod between the elevator halves making them act a little like ailerons.