Yes --- if possible. One of the potential consequences of increased "slop" is flutter -- which can be partially resisted by staying outboard on the servo holes. However, moving the link inboard on the control horn increases the mechanical advantage of the control surface & it can sometimes overpower a servo with an outboard link -- which can leave you with inadequate control authority.

The initial "servo inboard/control horn outboard" concept is entirely correct -- but there are compromises required for everything. Keep your control throw minimization to a minimum