Not really-- ailerons work well. It very much depends on the aircraft -- combat models & flying wings invariably don't have rudders.
There can be limitations in the flight envelope without a full set of flying surfaces, but not necessarily unworkable limitations.