It sure sounds like a leak in the regulator. But you might want to check the fuel lines carefully in case one of them has a pinhole in it.
You might try bypassing the regulator and see if it has the air bubbles or not and then try hooking it back up again. Check the fittings carefully and ensure the fuel tubing is on tight and not loose or weakly on the fittings.