Try flying with a little more speed. on say 3/4 throttle. However having to hold the noseup in turns is normal but if the model is flying slowly it will appear to be more affected by the wind.

6 mph winds are quite light but you need to make the first, into wind part large to give you time to position the intersection and start the downwind circuit.