I also don't really mind flying in the wind... It's been said before, and I agree that 10 mph winds is about as high as you'll want to fly in. Then flying in a hover is really just flying foward flight... Slightly gusty wind kind of complicates things because then keeping your altitude in a hover gets pretty difficult because the amount of translational lift is constantly changing.

Be carefull when making a turn back downwind, the wind will tend to increase the rate of roll pretty quickly, and you'll concequently loose altitude pretty quickly as well.