Though mostly limited to strafing or bombing runs...fixed wing hobby level RC is capable of attacking cars on the freeway, stadiums full of people, school yards, city streets, poisoning open reservoirs, shorting out power lines, etc.
All it will take is an epidemic of this sort of activity by those who hate our society to shut all of us down.
The FAA is being pre-emptive and using some forward thinking ability.
Yes...if there were more FAA people emotionally connected to our hobby that would obviously help.
It wouldn't surprise me to see years from now just a few government run designated flying areas equipped with "electronic tethers" that only the most avid flyers would be willing to travel to out in the middle of nowhere.