As much as I like the idea of Norman being sympathetic, that flashback page rings a little false to me considering that Harry was born at the cost of his mother's life, and Norman was fairly depressed over it.
I mean, I DO think that Norman loved Harry then, I just don't see him being obvious about it at that point in time.
I'll ask MadGoblin, an expert on the Goblin if there ever was one, his thoughts.