Simulator experience or even RC car experience helps a lot. Remember, you are not just learning to fly, you are also learning to operate something by remote control, a skill that is not natural.

Don't worry about what others think of your beginner skills, as your skills increase and you really start hot dogging, you will learn the cruel truth.....nobody pays any attention to your flying.