You haven't given us any details about the make or design of this model or the controller it uses. It's hard to help without knowing what you've got.

Sounds like it steers by varying the motors. That's going to be slow to respond. And as it controls pitch/altitude with thrust it will also have more than just turning effect. You may find one direction works better for turning than the other.