Ken and I fly in similar conditions. He is right on but I would also add. There are days that it blows a steady 15-20mph. These are not to bad. Then there are days when it is 5-20mph that I wont fly. I gust at the wrong time will put you in the shop for a few hours.
I would also add the plane does make a difference. As a rule the lighter the wing loading the lighter the winds it will take. I had a US 60 I flew for many years. I flew it no matter the wind. One year at our fly in it was blowing 30+ all day long. My and another guy had a low inverted pass contest. He was flying a Patriot that also cut the wind. When you have an event with a few hundred spectators someone has to fly. I won BTW. He would not drag his rudder in the grass.

David