[Because, in the end, it isn't possible to not care at all. But he can pretend as much, most of the time.]
[...] [Reaches out and pats his head]
Guess you'd at least have some idea what I'm talking about. [His entire reaction suggests as much, that he'd have faced some kind of hardship in his life.]