Hack out the remains of the fin. Then use the main section that broke off as a template for making a replacement.

I did this using 5mm balsa cross grain laminated with 1.5mm each side. This was for both horizontal and vertical stabs, which turned out far stronger and barely heavier than the original pieces.