Yup... Definite mechanical disadvantage with this particular linkage setup. Just what I expected to see. This geometry is providing far less torque than the servo is capable of delivering. Yes, a higher torque servo would eliminate your "Softness" at high speed but, setting your linkage up correctly would most likely cure the problem without having to spend $200+ on servos.
Todd