I never "herd" anyone say that either.
I balanced a H9 extras ailerons and flew it with just one servo/aileron. Twice I lost the gears in one of the servos and was able to land the airplane with no flutter. Without gears in the servo the aileron was completely free. It was not a waste of time for me.
I lost the gears due to other problems- not flutter.
There are several ways to balance the ailerons . One is shown in the latest RCM in the how to do it column. It combines the balancing system with the control horn.
BTW balancing the surfaces would surely ease and comfort the pilot. I bet he would surely be uncomfortable knowing they were not. I would not go near an airplane that didn't have it.