You need to use an ESC that's intended for RC car or boat use. Airplane speed controls are not designed to have their "off" position in the middle of the stick movement. That's why you have the difficulties you do. Short of using the adaptor, there isn't really a solution.