I'm glad that you understand why the rudder is needed and are using it.
You might try stopping after the first 1/4 of the roll. If you are doing everything properly, it should continue flying straight ahead in knife edge.
If all else fails, just be proud you can do a rolling circle, as it's a very difficult manuever!
Tom