It does appear that the "main panel" is the disconnect at the pole, and the panel in the classroom is a "sub," so the inspectors' view is reasonable. The pole is where the neutral/main are connected.
That aside, assuming PVC, USE, or other non-metallic raceway between the pole and the classroom, I don't see much cause for concern if the panel in the classroom has a "main" breaker, and is treated as the "main" panel.
In the end, the inspector makes the call.
