I looked too and I couldn't find permission anywhere in the NEC to install a receptacle in a closet.
Of course I couldn't anything prohibiting it either.
So it's up to your inspector to come up with the goods and that should be in the form of a code reference. Ask him what code was violated. As long as you're diplomatic about it and your inspector's not phsyco you should be able to sort it out.