If your surfaces move relatively easy, there is no damage. With a triangular leading edge on the surface it is very hard to get it "too close"... Really.

Edit:

If need be, CA hinges can be removed more easily than might be expected. Simply cut the hinges between the surfaces to remove the control surface, and using a sharp #11 X-Acto, very carefully cut on both sides (top and bottom) of the nylon portion of the glued hinge stubs. This will separate the nylon and allow it to be pulled from the slot. Then you can insert a new hinge.