It could be a pressure change within the cowl when inverted that is affecting the diaghram vent on the carb .
I would remove the carb diaghram cover and solder a tube to it and run a line from the vent cover to inside the fuselage (away from large sudden pressure changes).
There are several threads on installing the vent tube and line here on RCU.