What I;m saying is From the pole mounted Transformer down the Pole should be the 3 phases & a Neutral conductor(same as a utility company would do to the building underground via PVC ).(ground rod installed at pole location which is remote from building) Then at the main service rated disconnect(at the building) a bonding jumper installed, (same as utility company again) then grounding Electrod conductor installed as per code. That way you have a 480/277 at the ist disconnect for correct grounding.
I don't see a need for running both a neutral & a ground dn the pole to the ist disconnect switch But it could be done if Neutral floated at that panel.