Winnie, could you elaborate on “…protection relay intended for 277V”?
If there is anything that needs a ‘neutral’ in the 480V circuit, you are out of luck with the 480V 3-wire ∆ winding. There is no “277V” available with the described configuration, as would be for ordinary 480Y/277V 4-wire service.
