Does the esc run a receiver pack(4 aa batteries)? Or does it have BEC? I remember reading somewhere that some on and off switches only turned off the receiver leaving power to the motor still. Its always a good idea to unplug the batteries first then turn off the switch. If everything still works normally with the switch on (motor turns off and on by throttle control) the above maybe your case.