Oh. Well, I don't think it's all THAT common. I'm not even sure why the Doctor has a time machine in the first place, especially when we seem to be acting like tourists. With...really bad luck in always finding trouble.
He doesn't seem to care much about us talking about things from several decades in the future when we're in the past either.