You have to admit that their paranoia's well-grounded. Even if you were able to talk with them, there's always the chance that if they mention something to you that they don't want Mirror to know about, Mirror could still find out about it.
She's your patron. And you do give her plenty of leeway in that regard. Not that it's necessarily a bad thing, just a risky thing.