Sounds like the regulator plunger is either damaged or has debris holding it off the seat. The plunger is the little piece under the spring. This is what seals the tank pressure when the engine is shut off while pressure is still in the tank. Take it apart again and make sure there is nothing keeping it from sealing.

Dave