It was, actually, a fairly good response, given Harry had been kept in the dark for a large portion of his life at Hogwarts. Even now, he knew there were things Dumbledore wasn't telling him. The gifts proved that.
But he wasn't going to admit that. "If Voldemort really thought that, he wouldn't be so worried about getting rid of me."