Or, you can just buy new caps. I have never been able to rescue caps or tips by soaking them in acetone.

I've found the best way to avoid this is to make sure the tip is clear of CA before
putting the cap on. I wipe the tip, then let it stand for a while, so the glue has a chance to run back down into the bottle before capping.