Farmboy approach to Cap'n Johns idea
Use two hose clamps around the prop hub. By spreading them apart you can vari the amount of counterweight.
Starting point would to add more weight on the same side as the counterweight in the engine.