I did try to make a support half way down the fuse. It did help it out a lot and now moves much better. But still just don't like the idea.

I seen the post with the bell-crank idea. I may try that out, if not use the extra servo. But this time running 2 push-rods half the length.