Patience is the Key. With working with Plaster, I make a starter small hole in the middle of the Box, Hi Hat, and it seems like a crack travels to that point. Then you could chip out the rest without sweating too much.
Good Luck