With the radio on, can you wiggle the rudder? if so you have a slop issue.

Check to see how much movement is in the servo (some have centering issues), and tighten your cables, they should give a satisfying "tong!" when plucked.