Well, I think it's quite safe to assume that everyone still there is quite fine, unless there's some impending doom focusing on the Shire. There's the idea that time is, in essence, still while we have gone away—that, perhaps, when we return it will be like we'd dreamed, no matter how long we've been here.
And then there is the real possibility that we won't even remember it. Honestly, dear, I wouldn't worry about it. From what I have seen in my eons of life, you have no need to be so distressed.