taking off the speed brakes will make it faster, it will also effect your level flight trim. The droops are to prevent tip stalls at low speed so I'd leave them on for a bit.
I hope you do not have the AFS connected