I guess if some pilot decides to get his jollies buzzing an R/C flying area there's not a lot that can be done, except get out of his way.
If he is flying low enough to read his N number then write it down and call the FAA. They generally assume he was flying too low if you can read the number. The number size is based on its visibility below 500 feet.