Your on the right track. Wind is only an issue when you bring the ground into the mix. Ground track and speed are definitely affected but the air speed and control are not. Where people run into trouble is when they compensate for groundspeed, by changing airspeed, or ground track, by crossing the controls. On the ground where you have the wheels applying force then wind can cause the plane to weathervane or flip, but not in the air. Of course gusts and thermal activity are another matter.