RE: Whats wrong....?
Have you tried putting it under water whilst pressurising it? As Spartan says, leaking through the pump isn't a problem but leaking out of the air gauge/valve/pipework would be.
I was just trying to ascertain whether it was the action of removing the pump that caused the problem or just a straightforward air leak. Do both valves do the same?