Put some short pieces of fuel tubing between the collar and the brake arm. You can also put some small washers between the tubing and arms. It softens the initial hit of the brakes, and makes for more controllable braking.