The ATV should have absolutely no effect upon how fast the servo moves. Something else is going on. ATV should act just like you put a physical limit on the stick, as far as the servo is concerned.

Another way to limit travel is to put the ATV at full, and then move the control rod more towards the center of the servo arm.