For batteries, I tend to think of the battery as the package and the cell(s) as the structure or guts. In other words, a 6 volt lantern battery has 4, 1.5 volts cells connected in series and formed into a roughly rectangular battery package.
Joe