Not sure if push-matic had door style covers to screw shut.... Or some didn't? Havent seen many in some time... But yes it can be done although not the neatest option, but certainly easier than moving everything into a sizable j-box. Just watch your de-rating (310.15) while refeeding it all.
Mark Heller "Well - I oughta....." -Jackie Gleason