All good points,
My humble opinion is: The people that are complaining do not find our Hobby/Sport NECESSARY. There could very well be a small airport in the vicinity with full scale aircraft doing what they do. Weedwhackers buzzing in the neighborhood, as well an occasional Harley rumbling up the street.
Some find this more necessary than grown men flying their toys which in their mind are not a product of practical means. Couple this with the fact that we tend to be a introverted group, looking from the outside in. Of course we know that not to be the case.
My 2 Pennies