Think of it like this. Every time you pull back on the stick, it's gonna try to turn towards the low side of your stab. Look, it won't take but a few minutes. Be very careful and cut if off and retry.
BTW, you can't trim this problem out. It only happens when you pull back on the stick.