Our 500 foot rule is just that. Imagine you are in a bubble of 500 foot radius.
You can fly right down to one millimetre from the surface, provided you stay 500 feet clear of people vessels or structures. You have to be both VFR and VMC, of course. Done it many hundreds of times.
Now, in reality, it is almost impossible to be sure that there isn't someone taking a pee behind a hedgerow ... and a fence is technically a structure (maybe) ... and someone could claim that you caused his horse to miscarry its foal ... but so long as you are acting reasonably, you won't get nicked.
AFAIK.
With the permission of the land-owner, there is no barrier to your making a landing, either. (I'm talking non-commercial flights, here) But, even if you do land without permission, the worst you can be acccused of is trespass, with its attendant requirement that the property owner shows the harm or loss which he has suffered.
Your rules may differ.