With power left on two other phases sharing the neutral, if you lifted that neutral at some point you could end up with voltage on one side via the loads.
Not only would this represent a shock-risk to you, it could also unbalance the voltages on those other loads. Given a large load on one phase and a small load on the other, you could see the voltage across the latter rise to almost the phase-to-phase level.
