This is ONE of the reasons for test fitting several times BEFORE applying glue. Once glue is applied it complicates things.

I assume you are calling the aileron torque rod the "shaft"??

Did you use epoxy on the torque rod? If you have a covering iron (household iron in a pinch) heat up the area near the torque rod and it MAY soften the epoxy enough to remove the aileron. Use a twisting motion instead of a pulling motion as soon as able.

Check the aileron and the wing trailing edge with a reliable straight edge to see which one is crooked. Perhaps both.