I have not had that problem and I have ruddered mine alot. I assume that you have verified that no weird mixing is going on now. I mean when you rudder on the ground there is no elevator deflection.
It sounds like an incidence issue. Did you check the wing incidence and maybe double check the ailerons to verify that they are all centered with the wings.