I have used those ball linkages forever. Never had one come off. Sometimes I even wonder why I use them just
because they are so hard take off. I usually have to pry it off with a flat screwdriver blade. If you set your end points correctly so there is no binding, I doubt they would ever come off by themselves. And I love how they allow unfettered movement up/down left/right when the angle isnt just perfect or when the linkage moves a little during servo operation. JMO though.