The other eyebrow goes up to match the first. He's well aware that Ianto blames himself for getting him taken away, and isn't surprised that Ianto might have mentioned it to Mary.
"You mean, you really are that incompetent that all those glitches and 'losses' are just accidents?" he asks dryly, clearly nowhere near convinced.