There is no such thing as too light a wing loading. The lighter wing loading will not affect your top speed. However it WILL lower your landing speed and decrease the time required to recover from a stall. All good things in most folks books. The suggested wing loadings you are reffering to are intended as guidlines towards a MAXIMUM wing loading. For example many of the current 3D fun fliyer models are quite a bit BELOW the usual glider wing loading figures. You don't see them worrying about it.

Just go fly it as is.