Just to clarify it dosent turn at all when at idle but does when you pick the revs up? Is this on the starter box or on the track? The way i'm reading your post you are getting interference when the engine idles. If so it could be a lot of things, any metal to metal parts rattling, your switch playing up, etc. etc.

Is how i've read it how you ment?