Sounds like there's voltage potential between neutral and ground. Your common plug tester lights between hot & ground, hot & neutral, and neutral & ground... the neutral - ground light usually shows reverse polarity..
I'd try checking the voltage again under load.. You might discover a high impedance connection on the neutral and your tester may be displaying backfed voltage..
