No it should not spin like that.. you should get only a slight heading change, if nothing at all when you hit idle up..

Either a gyro, or servo or its in the geometry of how you have set your tail servo... can you provide a picture?