I don't use it on pattern planes -- or any other aircraft with symetrical airfoils -- I use the rudder to counter adverse yaw (if any). You are correct that it negatively impacts inverted flight.

It is definately usefull in some applications, such as the case of a beginner trying to learn to fly with a Cub, or similar aircraft.