A few weeks back, we were in a place called Fillory. We found a questing creature called the White Lady who could grant wishes. Someone asked to know what happens when we disappear from here. The answer was that we go right back to the time period we were taken from. That kind of suggests you never leave.
Ah, but the possibility that we will at some point is pretty good.