A real electrician would use a wad of electrical tape instead of duct seal. Screwing plywood to the back of the box might be better. If you're really unlucky, you might be able to knock the plaster off the other side of the wall.

I'm not a fan of silicone. I need to use plaster so I can take several tries to get it smooth and still wash it off my hands.