tzeming, I am not as experienced as the other guys, and am still learning, but it seems that the leads or wires are switched for the ailerons and rudder, or at least try switching them on the receiver and see if that cures that part of the problem. It could also be that you swapped the positions of the servos; you could try switching them.
This seems logical to me, but as I say, I am still new at this, and I just volunteered my thoughts since you did not direct your inquiry to me. As for the pitch problem, you could try adjusting the linkage between the servo arm and the swashplate or the attachment point for the linkage on the servo arm. Just a thought and I apologize for butting in. I would be very interested in the more experienced guys responses to see if I am on the right track. Best of luck with resolving your problem. I hope my new Blackhawk (RTF) does not suffer from such problems.