I totally agree that it is possible, I taught myself to fly a 6ch collective pitch 450 sized 3D electric helicopter (one of the hardest things to fly full stop), only had two little crashes with stripped gears and a bent boom etc.
I found that learning and understanding fully just how your model works re lift, turning, physics etc helped a LOT, as it gave me a better understanding of what I was actually doing. IMHO, pre-flight set up is everything, RC models are small aircraft, and only take minor errors in control set-up to make major problems for yourself.
Simulators (now I have one) are great tools, they help with the general feel of an aircraft, and do give you as much stick time as you want to put in, and if I could EVER make my Phoenix aircraft feel and fly 100% like my real ones (vs 85-90%), I'd be a much happier man.
I guess - again IMHO - this hobby for a beginner is about patience, taking your time to get it all right before your flight, knowing your limitations, and just getting out there and enjoying it, as personally, this is the first hobby I've ever had where just getting out myself is what I enjoy, sure a club adds a bunch of like minded folk into the mix, but that social side is not paramount to the experience, as it's an experience all unto itself.