do you mean when you give it throttle? because it's really NOT supposed to go anywhere unless you give it gas.
check to see that your brake is adjusted properly.