Google for "radio control transmitter glove". Cunningly arranged so that the transmitter sits inside with the aerial snugly fitting through the hole at the top, but with a hole for each hand to work the transmitter which is visible through the clear panel. Also keeps your hands warm.
If desperate, you can always put the transmitter (for goodness' sake NOT a "controller") inside your jacket.