Right now I can keep it up in the air and move around, it just takes a bit more joystick I think that it should to keep her steady.
Sounds like a bit of friction or 'stick' in the flybar / upper rotor assembly.
Or a slightly bent flybar. The flybar is the picky part.
Reduce flybar weight first to improve the performance. If you like the results, there are dozens of optional parts to make you grin. Just pop the weights out of the rubber weight boots and try that as a place to start.