Yes, I have seen a few GFCI outlets that are sideways like the one in your second picture. I don't have a picture handy though. While I have seen GFCI's like that I have never seen just a regular duplex receptacle though.