I heard of this problem before hear on RCU with split ailerons. Someone said that it has to do with the bandwidth available to us. I will post a link if I come across the thread.
Sure enough, I notice it a slight bit on a plane I have, on the ailerons. I would assume the same situation happens with the elevators. But I could be wrong.

Sean