It's lonely. At least it seems that eventually whatever brought us here will probably send us back. When time travel's involved there's a little less finality about it. I have no idea if I'll remember any of this but I tend to go back to where I grew up every so often, so I'm sure I'll see it again someday.
I think finding the willingness to do so is one of the biggest barriers.