An electric the size of a typical glow plane can be expensive. The parkflyer-size planes (mine are from GWS) are not expensive. Brushed motors and controllers are not expensive. Brushless (more efficiency -> more power) is another thing. Batteries, if you go LiPo, are not cheap but NiMH is still a viable option. Chargers can be expensive if you want a do-everything unit but lesser models might serve you well for the near future.

The support gear and fuel for a glow plane is not free either.

For me, electric was the more practical way to get started. Depending on your circumstances (where you live, with whom, do you always have heavy winds, how far is the nearest "real" flying site, etc) it might or might not be the best for you.

Anyway, the decision to join a club first is a good decision.