Why the damn hell would he care who Babs and Tim are, why especially would he care who Babs' father was or what kind of relationship she had with him, and why should he retain any of that totally uninteresting and useless-to-him information when he ceased being the Spectre, given that he's lost/given up basically everything else from that period?