My 2 cents
I've been in the addiction (hobby) for just over a year and I've happily spent about two thousand dollars. I'm currently building a 4*60 as a second plane and convinced my wife to get me a Saito .91 as a Xmas present.
Of course, everyone isn't going to go that route.
My thoughts - Like was said, go to the field, see what's flying. Ask if anyone wants to sell you their old trainer. I think, that if you're serious about the addiction, you'll be wanting a sport plane by the end of the season, so don't drop a fortune on a trainer.
You can plan to move the engine and radio to the second plane, which makes getting something like an OS FX .46 more economical.
Plan for the long term, like you said in your original post, sometimes you end up spending more by going cheap. I've had many instances where I bought something low end and had to go back and get a better one. (battery charger, fuel pump, etc.)
Do a lot of research and ask a bunch of questions. Of course, since the weather is picking up, you will want to get flying pretty quick. Many clubs will offer orientation flights, or many pilots might offer you a buddy box ride on one of their planes.
You'll know when you're hooked.
If cost is a major consideration, ignore me entirely, but make that clear in your posts. There are bunches of guys who will help you get started on the real cheap (I'm just not one of them).
Tim