Your inspector is woried about water entering the building through the opening you made when the old panel was removed. This could peel the stucco off the old vinyl siding, and maybe enter the building through some covered opening in the old siding.
I would suggest 6 inch sheets of flashing around the new panel, sealed to panel and the old stucco to make a water-tight installation.
Earl
