Sounds like there is a bad connection on the neutral conductor that is feeding the panel.