Yup, you can replace the pot with two appropriate resistors to make things smaller. Measure the value from the wiper to each end, and sub in a match. The values should be equal, and probably around 2.5k (for a 5k pot), so a pair of 2.2k or 3k resistors will suffice.
If the match isn't quite perfect, a little trim will fix it.

They're not carrying any current, so 1/4 watt will do.

D.