Torque steer is when the plane rolls the direction opposite to what the prop is spinning and the plane changes direction because of it.
There are a few things you can do to minimize this:
1) As you already said, throttle back after lifting off. Just don't back off to the point the plane stalls
2) Add some trim to the ailerons to help hold the left wing up
3) Add some weight to the right wing. This is the last thing I'd do as it will affect your plane at all speeds and, in some cases, can make a plane unstable
4) Work on learning just how much/little aileron input it takes to get the plane to do what you want. It's possible that you applied too much "side stick" and, combined with the engine torque, it caused your issue.
I'm sure others will have other thoughts on this as well