The larger carb will flow more fuel at high RPM, but you're seeing the effects of over carburetion at low RPM. Can't lean it enough to smooth it out because it just dumps too much fuel. If you lower the RPM it just dies from flooding.
Put the smaller carb back on it.

It won't have the same top end, but it'll idle and transition cleaner.
EDIT:
Could be an air leak?