I have a habit of yanking up on the elevator during the roll so it makes the plane fall out and go some other direction.
Yea I was going to suggest you go in and turn up the tension on your transmitter springs on you ailerons, elevator, and rudder. Just take the back off the transmitter and turn the little screw. It really helps "feel" the center when you are trying to do axial rolls and pulling up with out rolling one way or the other.