I'd say change the circuit to 240v, 2 pole breaker, although your wire colors may be wrong if it's black and white in conduit. 6 fixtures at 400W will be too much for a 120V 20A circuit. You should calculate at 125% since those lights will be a continuous load. No matter what, using a single pole breaker for the 208V high leg is not correct.
