Hi,
The most common cause for this is a change in air flow around the carb when inverted. A change in angle of attack changes the air flow through the cowl. This effects the pressure sense port on the carb. A simple shield to block prop blast corrects the problem. Be careful not to block the port.

Dave