Well, that can be explained quite simply through your gullibility and stupidity.
[This is stated rather matter-of-factly, almost no malice behind it whatsoever.]
Even The Doctor must have recognised that. I knew the moment you didn't recognise me. The Doctor trusts his companions, tells them about my creations, his enemies, his plans, about me... At least he does with the clever ones. The ones he can rely on to understand and not get someone killed. Those too incompetent to understand simply get manipulated into arriving where and when he needs them.