That is correct but in this case watt/hours are irrelevant. The only thing that we are interested in to determine the life of a battery pack is the capacity of a pack, the current draw and the time spent at that current draw. The 6V pack will supply more current with the same load and therefore have a shorter life like SAL98 mentioned.
Think of it as a light that burns twice as bright last's half as long.