Going down a size, sometimes ur lucky if a bit of heat shrink if the size difference is so little, ensure that set screw is locking in a groove and loctite. Other way is to go to hobby store and find brass or aluminum tubing that slips over ur current shaft. Aluminum tubing can be cut easily via flat blade and rolling blade accross top of tubing on table, brass... tube cutter i guess.

Ivan.