One downside is increased drag further above the center of pressure (aerodynamic center) than is already the case. This will tend to increase the existing speed-sensitive pitch change.

Another downside is an increase in the pitch-axis and roll axis polar moments.

Finally -- it will look ugly.