How long do you own you L4 now, Kev?
When mine came from the factory (I ordered two over my carreer by now) one had the servo rods in hole 1 (all the way in) the other one in hole 2(little farther out). Both had the remainder of the servo horn broken off to fiit INSIDEthe fuselage. GUess what, in the first couple weeks I had lots of trouble keeping the thing steady even in the second hole ... so yes, I would agree, if you are only flying for a few days or weeks, BOTH servo rods in the 4th hole is DEFINITELYway too much. (I know a bunch of seasoned fliers who still have fun flying it on the 3rd hole!)
Also, did you ever try to just put ONE servo (the aileron servo) out one hole less than the elevator servo ? (like THIS: www.rcline.tv/photo/1245/servoarm-tuning )
This will give you a lott more foreward punch than the factory setup does, but the left/right movements are not as agressive but still sufficient for perfect control ... it will increase stability greatly!

Regards,
Sven