Sounds like the effect of sweep. At positive angles of attack, you get roll in the direction of yaw. At negative angles of attack, the opposite.

Dihedral is a factor. The plane will always roll in the direction of applied rudder, regardless of attitude. The effect of the fin/rudder acting like half a wing/aileron, is also a factor, depending on how far above the CG it is.