I find it helps to think of wing loading relating to how fast the plane must fly to stay in the air, rather than flying poorly.
Different aircraft behave better with very light wing loading such as 3D, aerobatic, etc.
But what I have found is that some scale I have built behave better with higher wing loading, ie: they fly more scale like.
You do have to be careful with flying speed, with a high wing loading you will stall out much sooner.

So I guess what I am saying is that light wing loading is not the be all and end all of aircraft design.