There is no doubt that the size affects the scale effect and greatly changes how the wing loading affects a model.

I would suggest that to determine if the wing loading is good for your case you should examine a number of designs of various types from trainers and sport models to pattern and scale models for designs that are close to your intended size range. To keep it meaningful I would say you should examine everything that is within 10% of the size you are concerned with to keep the size scale effect in mind. From that you can determine the range of wing loadings for the type and size of model you are interested in. Probably scale if I'm reading between the lines correctly.

Once you have a range of wing loadings for reasonably successful models I would say that if you can stay on the lighter side of the range you model will fly well with fun type attributes. If you come out on the heavy side of the range you will have a model that will demand more attention and judgement to avoid attitudes that will result in disaster. And it probably won't be much fun to fly on a regular basis.