He shifts, not away from her, technically, but he may end up away from her a little. He really is a good person, he's just bitter. And he has good reason to be, not that he shares that reason with anyone - ever.
"What brings you out so late in the day? Troubles with your boyfriend?"