When it's tilted one side will create slightly more lift(can be trimmed, creates drag) but, when the elevator is deflected, if it's not lined up with the wing it pushed the tail out of the line of flight. (yaw)
If it's effecting straight line flight, it's either seriously out of whack or it's not straight with the thrustline. (incidence)