Get yourself some brad point drill bits. They have a sharp point on the end that lets you position the bit accurately and greatly reduces the risk of slippage.

I managed to get a 3mm one that is great for point hinges.

Terry