Put a drop of Blue thread lock on the screw. That will still let you turn it, but it will put enough friction on it to keep it from moving on its own.