2 thoughts,
First, you aren't too old to learn this. Guys your age, LOTS of them, are learning how to fly full scale planes. That's harder, trust me. Guys your age probably represent the biggest group of students there are...

Second, you need to be out there frequently, especially at first. Twice a week minimum! Wind presents special challenges - LEARN them - so you aren't scared to fly in them! It'll open up many more flying opportunities.