If you really want this to be nice for the next guy, reidentify the black in one traveller set to red and the red in the other set to black, then mate them to red and black in the fan cable. (reidentified white is always the hot in a switch leg).
It would then be easy to sort this out in 10 years.
