Check your servo arms. With throttle & trim full down, and all other controls and trim centered, the servo arms should be as close to right angles off the servo as possible (left and forward servo should stick straight out to the left, right servo to the right). It sounds like your control throws are off, which is what will happen if the servo arms aren't centered. Make sure you re-level your swashplate if you adjust the servo arms.

Chad