No this is normal. Just hold it in for about 5 seconds to make sure it remains at that voltage and does not fall suddenly. It slowly lowers because you are drawing current from it and discharging it. It should go down very slowly, like hundreths of an amp every few seconds.