ORIGINAL: spokman
One thing I'm concerned with is that the grind stone is polishing the holes more than it should. I might use another tool to put some kinda groove in the hole in the smooth area?
Spokman, I faced the same problem as yours due to loading of the cone-shaped grinding stone. I am using a carbide cutter I got from micromark.com with excellent results (p/n 60671).