RE: when to stop trying
I started this hobby at the age of 50 just under 2 years ago. Like you, I found it quite hard and frustrating to learn to fly at times. Our club has several different trainers and I learned something different from each one. At times some of them gave quite conflicting opinions. I found the flight simulators helpful but FMS was not worth the time or effort as it gave me a false sense of capability. Along the way I had a few crashes and completely destroyed my first trainer before getting my wings. The day after I got my wings I totally destroyed my second plane. I've totally destroyed 4 planes now, each crash certainly sucks and hits your confidence levels but I learned something from all but one of the crashes.
Now that I've got my wings, the frustration and effort has been totally worth it. There are days where I go to the flying field and walk off after hours of time there with a grin from ear to ear. While learning, the frustrating / down days definitely outnumbered the good days. Now it is by far the other way around. Getting as much stick time as possible is the first bit of advice I've give. Hang in there is the second.