You will be able to trim it out but the trim will only work at one speed and one attitude.

The worst result from a tilted stab is that the plane won't track well through a loop. It'll "screw out" of loops, coming out of the loop on a different heading and roll angle. The worse the tilt, the worse the screwing effect.

I have completely disassembled and rebuilt planes that have had this problem. It will make a difference in any looping maneuver.

Is it enough to bother you? That depends on the type of flying you do and how particular you are. Personally, I'd cut the joint loose, shim it and reglue. Should be easy enough on a slab fuse too.

Dave