I agree with the OP the technology is there to accomplish a nefarious task with some available drones today. And true that development has come from the UAV sector for not only the professional but the “hot damn,” gotta have guy to peek at a sunbathing neighbor.
The payload issues outlined by other’s comments add validity to the drone’s delivery usefulness. That also points to the now apparently dead front door grocery delivery systems so hyped just a few years ago.
Unless you are delivering a pack of toilet paper or box of large condoms, the drone needs to be large, noisy and capable of navigating through a neighborhood of power lines, trees, swimming pools, fences, parked vehicles, etc., likely only being capable of dropping the payload in the middle of the street.
It is not to say some determined idiot won’t try to hurt people, but it is less likely to succeed with enough damage to be harmful.
The FAA’s task to control airspace for everyone’s safety has merit. Unfortunately, AMA threw us under the bus along with the mentally deranged and Joe Camel yahoos rather than separating and prompting sensible and responsible modelers.