Nah. See, this universe is well weird. Sometimes, people leave and then they come back, only they aren't them, they're another them, from a different time or place or whatever.
Doesn't make much sense, but you kinda get used to it. Travelling with you helped.