"Oh, so just bits of my life are fake but waking up here with someone else I'm apparently sleeping with in addition to you who looks like your ex, that's totally normal, is it?" He sounds freaked it and angry because he is. Bad enough waking up here like this but now he's just supposed to agree that his mind has been altered even more than just erasing his memories?