My first thought by reading what is going on here is the servo arms are not exactly even with each other at rest.

As they travel during flap deployment, one arm is approaching the apex of the arc movement earlier than the other... it's a geometry thing.
It could also be the flap horns are not exactly in line at the hinge line and/or at different heights with each other, or the hole heights don't match (servo or horn).