Unless you check with the other contractor, you are only getting one side of the story. Sometimes it's the contractor who is refusing to return.

Also, when you take over the job, you also take responsibility for the other guy's work. For example, if his wires are too small, you have to replace them.

There are no ethical issues. Just make sure you get paid.