"You didn't make me mad. I just... I'm mad at the situation." And the fact that he'd put her in it. So essentially he was mad at himself.
He swept her hair away from her face, gently, stroking her cheeks with the backs of his fingers. "I'll stay. How else would I keep him from gettin' ya?"