Hey, when you're only got reports and media presentations to go on for years, you get a certain impression.
Only when they know you were a sneaky spy liar for the wrong side. Every other sneaky spy liar gets the benefit of the doubt before they assume they've sold out or swapped sides. SHIELD'S very much become a one strike and you're out situation.