It is possible to leave, we simply don't know a way to do it on our own. People have to simply wait until they're send back.
But even if it might take a longer time for some of us, once we return it's to the same point as when we left. So anything you wanted to do, or anyone who might worry... They'll be there once you go back.