That the mount for the muffler tail end allows some play could be of help.

Adding a support for the end of the header (e.g., with a stainless steel strip mounted onto engine's cylinder head screws) definitely will fix it for all.

The broken header probably can be brazed back with the yellow brazing rod sold by DA + a propane torch.