It's not a true analogy, but if you are flying a model that is, say, 1/8 scale of full-sized aeroplane, then a 30 mph wind causes the same reactions on the model as a 240mph wind would on the full size. It's actually worse because of air density, but there are a dozen other factors.

Airfoil shape has as much to do with it as weight/wing loading or motor power. And as you say, being able to keep up speed relative to the wind is important, too. I have a little Fighterbird electric and there are times it is a battle to come back "upstream" on windy days.