More likely that the length of the leads, combined with the extra connectors, is causing a drop in voltage. You could try a 5 cell battery pack to increase voltage (but this will also decrease the packs capacity due to increased current draw).

You could also solder the the extension to the "Y" connector and the ends of the "Y" to the servos leads, or try using heavier guage wire.
Dennis-