sparky66wv,
I personally would try to convince them to change the panel. The work involved in relocating the panel would probably merit a grandfathering. See if an AHJ agrees.