Not the inspector. Plus I find it hard to believe he allowed SER in conduit. Not listed for use in conduit.
If you read this thread you can see how inspector and contractor alike will say that your grounding electrode at the second building was accurate. You should have floated the neutral and fastened the wire from the grounding buss to the rod(s).
