Tripp, some capacitor types exhibit what is known as "dielectric adsorption". The insulating material stores a certain amount of charge that isn't immediately available at the electrodes. You can short the electrodes, and the voltage drops to zero. But then when you open the electrodes, the voltage will rise again as charge carriers slowly trickle out of the insulation.
-Jon
