One of the following is most probably the cause of poor performance. The brushes may be worn or, more probably, you have a high impedance path somewhere in the wiring. That could be a bad connector (corrosion) or a partial break somewhere along one of the leads between the battery terminals and the starter. That bad connector, if that is the problem, could be anywhere in the loop, even where the brush caps connect to the battery leads.