As you suggested, all you need to do is set the pot to the OFF position, and check which side of the pot is shorted to the white wire. Then you just install a switch across those two wires to allow you to short them, effectively bypassing the pot setting.

Russell.