Could it be that the rudder is too small? A bigger rudder would be more effective at lower speeds, correct? There is no trouble controlling it once it gets moving.

The plane has a "Das Ugly Stik" style rudder that is a half-circle in shape. It's pretty small.