If you can't replace them, taping and leaving on neutral bus is much better of two less than ideal options. This doesn't meet current code, but is not much different than what was permitted for years until a few codes ago. I know it is not the service equipment, but as long as neutral bus is isolated from grounds, it seems to be just a junction point.