I would just make sure I was OK with the local code enforcement folks and ignore this jerk. After a few more baseless complaints the town will too. They might even tell him to stop making false complaints.

Greg Fretwell