You'll probably need to remove the rear bearing to get a real good look at the ball retainer...
Looks to me (as well ) like part of the bearing retainer...could be the folded over tab(s ) are breaking off?

If it already has a plastic caged bearing, then...???