Yeah, you could definitely say that. Margo and Eliot had left Fillory at some point and when they traveled back, that's where they ended up. 300 years into the future. Things didn't end well for either Josh or me in our present, so they were able to pull us forward into the future where they were.