Try a different glue. Wood glue cleans with a damp paper towel. Epoxy cleans with a paper towel and rubbing alchohol, only before it sets, poly glue cleans with a paper towel and rubbing alchohol, only before the foam gets rubbery. I'd say try a different glue.