Well, I don't know how to help you with that. I'm the one with amnesia here.
[It's not that he doesn't remember their relationship-- he doesn't remember you at all. For him you're just a strange grumpy guy who likes kicking things, apparently. And him.]