You don't have to take very much material off the shaft to make a flat spot for the set screw. You can use a regular file rather than a power tool to avoid the risk of taking more metal off than you wanted to. It'll take a little longer but not a big deal.