It's as critical as you want to get with it.

Some people wouldn't dream of starting an engine before they balance the prop. Personally, I never balance any prop under 16" - The only exception being: If I am having some sort of problem, I will check the prop's balance, but even that is very rare.