Block the hole otherwise you may have problems with tuning.

I prefer to put a very short bolt in where the nipple is (4-40 by memory but don't quote me on that). Make sure that it doesn't intrude onto the crankshaft. Otherwise a short length of pipe with a plug in it (I use the plugs from fuel dots - they are short and readily obtainable.