I use a drill press to push the bearings in rather than whacking them.
Also, I've never needed to freeze them either, just a nice snug press. If you do freeze them make sure you are lubed up good to prevent the condensation from starting the R word.