You'd be surpised what you can carve out of brick/concrete with careful use of a rotary hammerdrill.

Providing the conduit is stuck in the concrete, you may be able forgo the box connector and just have the conduit protrude through a hole in the box.

(I worked on a new prison project where the inspector allowed us to omit the box connectors as the conduit and box were embedded in concrete.)