I also like the building but it's only really worth it to me if I'm going to be doing a scale model. For example, I'd never bother building a trainer or something like an Ugly Stick. What's the point. I'd rather just buy an ARF and get out there to fly. As for "paying someone to build for me" I'd guess I'd end up spending more on a scratch-built plane than on a kit. Also while I enjoy gluing balsa together, what I really love is the challenge of figuring out how to replicate this or that scale structure using whatever materials and/or processes needed. For example, when I needed an aluminum cowl for my Eindecker to replace the too small ABS cowl that came with the kit I started out building from. I looked around and finally found an aluminum camping pot in the right diameter and with the right curves and had at it with my dremel tool.
I guess the real test is whether, given the choice, you'd choose to spend the day at the field or spend it building. Personally, I've been trying to "time manage" and do both. I try to build only at times that I couldn't be doing other things -- like playing ball with my kids.