I always read/ was told that "creating lift causes more drag than killing lift." The downward moving aileron is creating lift, and the upward moving one is killing it. The drag created pulls that wing back, in effect yawing the aircraft.