I too was getting it backwards (when inverted) more often than not. Then I read Mike Hurley's column in MA a few months back. The trick he proposes is to fly the tail instead of the nose when things appear "backwards" . This didn't work for me, but got me to think of a mental trick that did work: When things are "backwards", I move the rudder stick so that the stick points in the direction I want the plane to yaw. Kind of like the elevator stick - we pull on the stick so that it points "up".
As I've gotten used to this, I'm no longer afraid to attempt to correct a line and have had a huge improvement in my flying.

So, you just have to search for the mental trick that is right for you.