You are on the right track. If it looks like the problem is confined to two circuits see if they are on the same multiwire branch circuit then take everything apart and check the neutral connections.
Also don't discount a neutral problem with the service.
-Hal
