Yeah, but the exhuast gases don't stay in the same "size" as the exhaust port - they spread outwards. If they're blocked you get turbulence (for lack of a better word) and they can't escape as quickly.

You want to keep their journey as smooth as possible....