If it helps, I hardly believe you would be called that even if you'd walked away. [His shoulders slump a little bit, half grateful and half a little resigned too. But he's not going to complain about it either way out loud.
Not that he necessarily minds Stiles himself, just... the awkwardness of the situation isn't great for either of them, he knows.]