Stick with it, a well set up CP is far more stable than a Fp.

Flying it in small spaces can also make them unstable as they are affected by their own downdraft, but I have flown small helis like yours and they all seem to have a tendency to drift left on take off if you give it a little right stick on take off to counter the left effect it may help.

Its a case of keep persisting until your brain starts communicating fast enough with your fingers.