RE: Ball links for Rudder horh?
Your right, the ball link is not a good idea at the rudder end.
I am not sure how you are going to go without a clevis. The only other attachment method I can think of is a z bend, but I wouldnt use a zbend on the rudder end either.
Why not use a high quality 4 40 clevis. I like the metal gp ones but I think any would be fine.