He didn't know in the time you rememeber. He won't know for years... We're a decade apart, you and I. [There's a whole lot you don't yet know. That you probably can't even imagine.]
[He's ignoring the trust remark. Once he might've felt guilty and awful about that, about knowing he maybe didn't have to hide as much as he thought. Now... there're too many other memories clouding his mind, to bring himself to care about it.]