The rule is that we see and avoid them, not vice versa.
That rule applies to all aircraft not just models. I know of one full scale pilot who had his certificate suspended because he did not see and avoid a model. The model pilot was also considered at fault.