If you get yaw and nothing else when you apply rudder, then applying rudder and holding it would cause you to keep yawing, and you'd be making a flat turn. That would not keep you flying in a straight line.