We have a contest at a field that has the exact same problem, 400' limit because of overflying military aircraft.
Put it this way...its not uncommon for us to get a visit by either the MP's or the civilian police during an event

Fortunately the CD has a magical way of dealing with it
FAI and Masters are by far the worst culprits, but there is no way to fly the sequence in less than 400' altitude.