In some cases, the diaphragm can be under pressure depending on the position or the piston and the rotary valve. That could be enough to prop the regulator plunger open.