To really know for sure would be to take some foam from somewhere inconspicuous and try that stuff on it. If it melts or disintegrates, well, you know not to use it as a filler. If it works, you have your fix in hand.

CGr.