The sadness is indeed inevitable; it is part of life. You may find it helps to find a way to acknowledge what you miss? On the day of the new year, I leave offerings at our family shrine and ask the ancestors to watch over my friends and family who have returned to my old world. Taking some time for the sadness makes me less likely to be surprised by it at times when I would prefer to be joyful.
We would be pleased to have you, if the timing will work with your other celebration. The New Year's table is always happier with more people around it.