G'day Mate,
I'm willing to bet that you have lost a washer, between the prop driver & the front bearing.
Have a look for it, it may have fallen off when the prop driver came off & you didn't notice it was missing, until now!