"because you know entirely too much about me, and you shouldn't"
He's a bit worried, humans aren't supposed to be that clever. They don't have time travel, and don't know about Time Lords. Gallifrey is a society of secrets, and having this human woman knowing any of them is terrifying.
"this" he motions between them "it was nice, but I really should go"