So, I am done with this. I took an old JR servo I had and pulled the elec's out. I soldered on a connector for the output and mounted the board in the base of the servo case. This will allow me to use double stick foam tape for mounting. Mounted the pot on the the board with 2x tape.
I tried this out and it is awesome. regular HL traverse speeds at full stick and since it is proportional I can move the turret extremely slow with precise adjustments.
Thanks again for the sugestion Darkith