I would guess it is just a weather vane effect,, I mean when you are hovering downwind the plane is hovering and is also moving with the wind (drifting),, and when you are going up againist the wind your plane is more responsive to the direction of the wind,,,