The plastic cap they give you is to keep out concrete and debris when this box is used per its listing. It's not a finish or waterproof cover and the box isn't listed for the use you describe as they can only be finished with floor box covers.