I think you made the right decision. I once went out with my Sig Kadet Senior on a very windy day. Two other more experienced fliers leaving the field suggested that I not fly and save it for a better day. Well I had my heart set on flying, and continued to setup. Got my motor started, did a range check and then just stopped and thought about that gusty wind. It would have been nuts to go up. I shutdown the motor and cleaned up and went home. Good decision, because I still have the plane intact. I got some fesh air and still had some fun. There will always be another day.

Knowing your limitations and erroring on the side of caution is an important thing to learn. Your instincts that day said it just wasn't a good idea, and I think it was correct.