Well this has been an interesting project, but I finally got it. I started out with a spdt switch as suggested by MonkeyBoy. I attached the white wire to the center, a jumper back to white on one pole, and a jumper to black on the other. Result was normal in one position, and what I initially thought was off for the other. Problem was I could switch the toggle into off, and the motor would not come on with the pot, but If I turned the motor on first, then switched the toggle to off, the motor would continue to run...

I tried the jumper to red next and found that one switch position was normal, while the other was full power.

I finally found that by disconnecting the red wire from the pot, the motor would stop. I installed the switch to just turn the red wire on and off, and its working great. When I get into trouble, a quick flick and my motor is off. You never know what to expect I guess!
Thanks again for your help guys.
Best regards,
Wayne