On my 2oz. Medium CA glue the cap got stuck on.

I can get it off, but then there is CA gunk all over the cap fitting.... I don't know what I can use to take CA off of the plastic bottle and the CA in the cap. I think something like laquer thinner would burn through the plastic. Is there anything that I can use that wouldn't burn trough the plastic?
Thanks-Brian