Nothing drills balsa like a sharpened piece of brass tubing. Sharpen the inside edge of the tube with a dremel grinder and it'll give you razor clean holes. But be careful. It'll make razor clean holes in fingers too.

For larger sizes I cut it undersize by hand with an X-acto and then use a dremel sanding drum to finish.

Dave