"Yes! Yes, I do, alright? I don't cheat. I've never cheated."
So the fact that he did and with a man to boot kind of says a lot about what all this is really about. If he wanted to get back at Jack, he'd do literally anything else but this. There's a line you don't cross.