The problem is that this is true of everything, but the general public doesn't care as long as it's loss doesn't affect them. You can't take away motorcycles because it affects too many people, even though more innocent (meaning not involved in the activity) people are killed by them in a single week than have ever been killed by a civilian operated "drone."