Ok, i'm in Aus but i'll try to help.

this is by no means a cheap hobby, but then nothing fun ever is, in Aus the cheapest way of getting started will still cost about $300USD, you can do it cheaper BUT most of the equipment is no good for your next plane.

The AMA (Academy of Model Aeronautics) web site http://modelaircraft.org/templates/ama/ should have alist of clubs in your area, go and visit the clubs and have a chat to the people, if there like the clubs here they love a chat.

The clubs generaly have some one that will give you a fly of a trainer type plane and quite often there is second hand equipment for sale from other club members.

as for hobby shops and prices have a look at www.towerhobbies.com

what ever you do do NOT get sucked in to buying a plane that looks good but it waaaaay beyond your flying ability.

if your reasonably handy and like building things have a look at www.spadtothebone.com

good luck and have fun