On busy sites, it was common for my foreman and I to leave our keys in out trucks - especially if they were parked in a place where they'd need to be moved for a delivery.
When working by ourselves? We'd keep the keys.
Sorry to hear about your loss - and especially the resulting long walk home!