Can you describe the type of linkages at the servo arm and aileron, and the type of pushrod used ? Servos don't normally vibrate when you return to neutral, although there might be some deadband. I suspect you have some freeplay in your linkage system and that can cause flutter. Did you overdrill the holes in the servo arm and control horn ? Is your pushrod stiff enough ?