Joshua, first, I have some questions. Just how big is this private airport area, and is this neighbor's house in the approach pattern? I would definitely stay away from flying over or near any houses ( good advice, no matter what anyone says
). How often is this field used for full scale aircraft, and what type of aircraft? If your rc flying zone contains any houses, I would take the advice of "don't fly there. Find another site", also good advice, no matter what anyone says.
Myself, I would look elsewhere to enjoy my rc flying, it sounds like this wouldn't be a "fun" place . I'd want to be flying, not fighting.