That's never a concern. The battery will simply drop voltage and not perform adequately before actual damage is done. Most battery damage comes from not using a storage voltage or from improper charging. That said, the vast majority of batteries die from old age.