Could the problem be in the radio transmitter? Probably not likely, but seems the only thing left unchecked.

Next time it happens, back on the ground, maybe swap the elevator and rudder servos at the receiver and see if the rudder stops working....