Brett,
Unfortunately you are setting yourself up for more failure than you can possibly imagine. The setup of the servo grommets and the brass insert is designed to isolate the servo from the vibrations that are present in the airframe. If they are not set up properly those vibrations will transmit directly from the airframe to the servo. Vibration is the mortal enemy of electronics, and will kill a circuit board. It can also destroy the gear train in the servo. If your servos are setup incorrectly trust me that it's well worth the time to go back and install them properly. Otherwise you will probably be taking your plane home in a Hefty back sooner or later.

Ken