John,
That is the first thing I tell contractors around here. If you didn't do the work, contact the building dept. to see who did. Make sure your name is not on that permit. Even if you started it, but someone else finished it, again, call then write a letter stating that you are no longer the contractor of record. You don't want you name caught up in some legal suit if something goes wrong.
I also tell the EC's around here, if you bid on a job, think you have it, and submit a permit to the GC, check in now and then to see if the work was done. Sometimes the GC will take your permit with your lic. on it, and let someone else do the job.
If I see a job that looks really bad, I check the permit to see if there is a lic. EC on the job. Sometimes there is a lic. EC signed permit, but the job is so, hacked up, I would call the EC to see if he really did the job or not.