Definitely sounds like the control device for the compressor has failed in the ON position.

Usually, these are fairly large mechanical relays, subject to the usual contact welding problems, but I have seen one unit which used solid state relays, in which the output device (SCRs or TRIAC) failed by short-circuiting.

Either way, it sounds like you will need to change a relay.