When the birds get to scared to fly :P. I've seen a video of someone flying an rc plane in hectic wind conditions - but then again it seems as if he knows what he is doing. Experience plays a big role in what winds you can still have the plane under control and which not.
But if you are asking when does the plane start ripping apart because of the wind - hmmm, why don't we go test it hehe