You were most likely experiencing slipstream... P-Factor is a very minor effect. Even during take-off your AOA is not high enough with an Extra for p-factor to make that much of a difference. Slow speeds and high power settings is when slipstream is most pronounced.
I guess there is no way to know, huh?