RE: 400 feet
The FAA said please try to follow these suggestions. The AMA said No, we know more about aircraft safety then the FAA so we are ignoring your sugggestions and make up our own rules.
That is what happened in a nutshell.
Soon the FAA is going to say, "Here are the laws, follow them."