Backwing, you are correct in your thinking. If a surface is deflected into the airstream, the air will push on it (and the servo), and it WILL put more strain on the servo than if it were straight.

But the amount is so minimal, that throughout a day of flying, you may reduce your battery life by about 30 seconds.