Typically windex should not eat away the adhesives... though the ammonia is not great on them...

Glow fuel is another matter however. It can make the covering release or come off ( but it should never cause tears, etc. ).

It can EASILY dissolve the adhesive material used on most coverings ( with exceptions ).

Your best bet in a case such as this is to seal all seems.

You should first make sure the existing covering is holding well, then clean it as much as possible, and reheat it with an iron to assure adhesion.

Then use a clear coat covering such as Top Flite Clear Coat spray over any non transparent plastic area of the plane. Apply several coats.

This will seal all of the covering seems and prevent glow fuel from getting in under there...

So is your material torn or is it coming off?

If the latter reheat then reseal as I indicated.