Try you craft store. Its called Delta Creamcoat. Not fuel proof but a ton of colors for a buck a bottle. I then seal with a clear coat of krylon. The paint will protect the foam. Or epoxy thinned.
Ron