Foam floats. As does balsa.

What you really want to do is put your RX and battery inside plastic bags, and seal them in there good. Use a bit of silicon or something to seal where the wires come out of the bag. You can test the bagging job in a sink if you go carefully.