but most flutter happens on control surfaces where there is a pressure difference between the two sides, The only time that happens with a rudder is in knife edge. I'm only asking because I've never heard of a rudder flutter, on either real or model planes.

High speeds will cause flutter also as will even small amounts of slop in the setup. Flutter can be heard during high speed passes sometimes and should be cause for getting on the ground right away!

Ernie