I did it on one aileron only, and for me, the same method you used, worked. If they were glued at some point in time, you might try squirting some accelerator into the hole, maybe that'll fix it?

Otherwise than that, I have no meaningfull tips on this subject.. it's a bit trial and error. I guess I was lucky the parts stuck?