Sounds to me like an open phase on the primary side of the 480 delta bank resulting in 2 of the phases going ground return across the ground connection between primary and secondary, and paralleling the pole ground wire and the service drop. Is the 480 delta bank a wye primary (e.g. one bushing on the HV instead of two)?