RE: Removing chuck from drill press?
There is a possibility that both the shaft and the chuck are ground off-center. If you get the chuck loose, you might try rotating the chuck 180 degrees and trying again. You might be able to get the runouts to cancel out.
Nashcat