When you don't reground the neutral at a remote site you not only see the voltage drop across the neutral feeder you also see the local ground shift between ground and neutral.
If you have something like a PC that uses the EGC as DC ground, connected to something that has a reference to neutral like a TV you will get a lot of hum and you might even let the magic smoke out.
