I'm thinking that the voltage may induced into the 'disconnected' line from the grounded conductor. When you open the breaker, there is no longer any current flowing in the remainder of the circuit to induce voltage into it.

With the breaker closed, whatever else is running on that circuit will create a current flow in the parallel conductor.

If this were DC, we could use a compass to tell which way the mystery current is flowing.