My friend was telling me that the flywheel is balanced to minimise vibrations from the crank...
Your friend is correct. The flywheel along with crankshaft is designed to reduce dynamic vibrations. If desired I will provide a reference to engineering textbooks that describe the design of dynamic balancing. The reading is heavy.
Will removal of the flywheel completely, cause too much vibration?
It probably does not matter much.
Bill