If you can make a shim that reduces play to about 0.05mm, that would be fine. Do not take out all play, because there will be no way of knowing just how much pretension you put on the bearing, and the crankcase will expand more than the shaft, for which the front bearing must compensate.