I've got an OS 91 F/S that I've run many times with just the header pipe and no muffler. There is a guy at my club who has been running a Saito F/S without a muffler or pipe for years. (His threads are broken out of the head.) It seems to have had no bad effect on his engine, so I don't think that you've hurt your engine.
Cheers!