I'm no hovering expert but I've never heard that having to use the ailerons was good. I thought the theory was to enter the hover nice and smooth (from an elevator or harrier or even a simple stall turn - just don't turn). That way the only inputs would be throttle/ele/rudder. If you start chasing it around reenter and try again.