Congratulations!
Welcome to the next level... the one where you start confusing tail-in and nose-in inputs... but take heart, this too will pass.
I actually mastered nose-in takeoffs and landings before I was comfortable with side-on hovering. In fact I've been flying mild aerobatics including loops, rolls, 540s, full-down autos for a couple years and am just now getting comfortable hovering side-on. You just gotta force yourself to work on your weak points.