Basically it is there for noise reduction and back pressure.

You can definitely remove it. I've done it on several engines. I've enlarged the hole in the muffler outlet too. It did give me more RPM on the engines I did it on. They had to be re-tuned after doing it of course. It may not benefit every engine out there though but you can always put it back in if you aren't happy.