Remember it's easier to get forgiveness than permission. Asking someone's permission puts them on the spot. They're afraid they'll be responsible for any mishap if they gave you the go-ahead, therefore it's safer to say no. If you just go, then someone has to complain before it becomes an issue, and if you fly safely and responsibly, who's gonna gripe? Most will be entertained.