Ok sorry I see what your trying to do. In the view you show. I would just use an over-size wheel coller and put a small flat spot for the set screw to dig into. A little locktite will keep it in place.