RE: Is noise really the problem....?
Noise can certainly be a problem. People who don't bat an eye at a neighbor running a chain saw/leaf blower/weedeater all day long will be up in arms if they hear a .40 crank up.
The harassment of animals is another problem. Chasing livestock and protected birds will get the locals out with torches and pitchforks.
Overflying buildings, especially after being asked not to, is a large part of it. I've known cases of homeowners using shotguns against the encroaching planes.
$$$ is also a problem. The average RC club/membership just doesn't have enough tax base to compete with, let's say, a sports complex or housing development.
Other types of irresponsible flying, like FWI or dangerous flying, can kill a club quickly, and give the whole sport a big black eye.
The attitude of "I have a right to fly anywhere, anytime I want to" has cost a lot of goodwill and fields.
A lot of this can be remedied by better public relations. Many people still see R/C as "men with big toys", and a lot of R/Cers haven't done anything to change this outlook. My club has several public relation programs in place, and one of our fly ins is a part of a whole town celebration. A club I just left had the same setup.
We are not an island, we're in the middle of a large community. We must work to be part of that community and not isolate ourselves. We don't need the AMA to do this, it needs to come from a local level. Talk to people and governing bodies BEFORE you crank that engine or write those club by-laws. Present yourselves as responsible adults engaged in a sport/hobby that has many beneficial returns. If you're told to not fly somewhere, DON'T! Stop flying, and try to legally address the problem. Don't rant and rave, don't get mad, don't assert your "rights" to fly your plane. You may not have as many "rights" as you think you do.
To coin a phrase from a song: "Just be nice to the gentlemen, Fancy, and they'll be nice to you." We're the underdogs. WE have to make the first move, and be the most correct, proper, polite, and legal. Fair? Maybe not, but that's the way it is.
Dr.1