It hasn't been a problem in the past. There is no clear regulation which forbids flying over private property.
The FAA does not care about this at all - it's not their job to make sure all homeowners are happy, safety is their concern.
Airspace regulations define aircraft operations, not property rights.

Now we have some powerful drones and fpvs in private hands and there should be regulations. The government will not act until some accidents happen. They sure like to be able to send out drones to anywhere and anybody they want.
If a drone hovers close to my house, I see this as a thread, who knows what it carries. I think reporters with camera drones is something we don't want to see.