Yes--the O ring may not be any good. As the eingine gets hot, the crankase will begin to expand a little--this could create a tiny airleak where the carb fits into. It wouldn't take much, and with a bad or non-seated O-ring, you could have problems.

Actually, I'm just shooting in the dark--I'm stumped.