You can meet with him, as you planned, and inform him you will not be present anymore. You can meet him and erase his memories... Or you can do nothing, and simply seem to disappear.
The choice is, inevitably, up to you. You know him best, after all. I would have to take time to determine the best course of action and at present I would not say that time is something we have a lot of in this situation.