To add to Ben's explanation.

Consider what you're doing when the ailerons go up. Rather than spoilers in the classic glider sense you're actually reflexing the trailing edge. If you started with a symetrical wing then you've now got an upside down lifting section. Lifting sections like to pitch nose down. But since it's upside down you get a nose up action.