You would think that with that speed it wouldn't matter where the CG is.
I know is sounds kinda silly but are you putting enough rudder input in ? Rudder is one of those control where you might think you are giving it full deflection when in fact you are nowhere near it.