Only way you are going to fix that properly is dig it up and repair the bad joint.
Gluing conduits is 1st year apprentice stuff, especially if they are laid under-ground.
I wouldn't go down the road of sealing the conduit up, it screams of handyman workmanship.
BTW, what size is the PVC conduit?
