Johnny, I know what you mean here, as I've had some of the guilties before. During that time, I just took breaks, and regrouped. Always seemed to come back stronger and better for it though. I've taken as much as 3yrs(no more then that though), off of the hobby, and have done the break thing 3 or 4 times through my hobby career(about 30yrs now).
I've found the hobby gives me something to think about during idle times, has helped me immensely with patience(gotta have it), and keeps me occupied, as much or as little as I want.
I'm fortunate my family is supportive, and let's me "hobby" at will, and knows where to find me. Also knows I will drop what I'm doing if they need me(unless I've mixed epoxy, and am joining wings, or something like that). You know what I mean.
I think we all need something we do, to call our own. I do this RC thing for ME! And yes, I can be rather selfish with it(not in a bad sort of way), I do share it quite a bit, but selfish to the point that I don't do it for anyone else. If I do or share something, it's because I want to, not because I have too. And if you can't tell, I don't feel guilty whatsoever anymore. Oh well...I'm going flying, ...why? Because I want too, and I'm going to go see all my friends today, which are a big part of me now. That's a whole other reason I do the club thing. Take care all.