That still wouldn't help.
Delta Elevons have pitch and roll control driven by two servos and mixing. Add canards and roll has to work the same but pitch has to work the opposite. so the servo can't supply the two inputs in the opposite direction at the same time.

The way you have it your canard fights the elevon. If slow flying high alpha its fine but at speed this acts at first like speed brakes and then forces a stall. depending on your cg one wins over the other but with a lot of fowles air.

If two servos are a must, split the elevons, put one servo on the canards linked to the inside elevons for pitch control; up and down
and the other servo on the outside elevons for roll control only. Infact if you got creative you could go old school and attach a link from the pitch control servo to the roll control servo on a slider. This still will not allow the Canards to have roll control which is fine.

In this manor neither surface will work against each other, and this is the common flight config for slow to sub sonic for these types of aircraft.