Jim
If it's carbon check to ensure that it's round, if not sand the high "sides" starting w 320 and working to 600. If round, work down evenly w 400 to 600. Wet limits the mess.
If it's aluminum (especially anodized) it's probably best to work on the sockets, the split dowel / sandpaper technique works.