Sometimes, everyone seems to be waiting around to see if anyone else will fly. And if one guy does it (and survives) a few others may give it a shot. But, yeah, there are guys who won't fly at all on any but the absolutely calmest day...and that's too bad.
People are also missing out if they never ever fly in any kind of a cross-wind. It's true that cross-winds are a pain, and make landing a WWI type almost impossible. But it's also neat to have a chance to practice crabbing and side-slipping.