Is the driver you are using roughly the size of the Inside Diameter of the bearing hole in the grip? I think my problem was that the torx driver I was using fit snugly inside the inside collar of the bearing, and then when I applied pressure, it popped that inside collar out of the bearing.