Chad,
Right now it doesn't matter if you have the "rubber things" (also known as grommets) in or not. Since you have glued the servos to the wood the grommets will have no effect at all. All vibrations will be transferred directly from the wood to the servo through the glue.