I never truly forget them, I don't think. At least, I think of them often. [And while they're good/happy memories, they do make him feel sad, in the end -- nostalgic and melancholy, unable to move past the things he knows he'll never experience again, at least like that, at least with all of them]
But I think you're right, with that. The good memories... they're why we want to remember.