It is not a bad idea to turn off everything on a circuit before you open the overcurrent device but people seldom do it and I really have not seen much bad ever happen because of it. I suppose if you were using an Edison fuse as a switching device the button in the bottom would get burned up pretty badly after a while.
