From what I read here it is time to get legal help and break away from this guy. 24K is waaaaaaaay too much for a builder to owe you. You are being taken advantage of big time. Sometimes it's hard to see when your stuck in the middle of it but from this end it is painfully clear. This situation could get ugly.