I am assuming this is a two bladed prop.

Are you saying that when the prop stops the SAME tip is ALWAYS on the 'left'?

If so then the hole may be OFF CENTER or the hub is larger and/or heavier on that point that is now at the bottom.

I assume the balance unit does NOT have a rough spot right where it stopped.