The stiffness of a hinge is nothing compared to the airpressure that's hitting the control surface.

My one question is this: Did you have the control surface flexed while you were adding the CA? This is very important, or else the gap may be too small to allow the hinge room to flex.