At his reaction, James really wished that he'd not said anything at all. he had only told him that it was better with him because, well, for one, it was, and for two, he thought that maybe he'd felt somewhat bad about James fucking another guy and that maybe if he told him that, he'd feel less bad about it. And he felt less bad, alright, if he'd felt bad at all. Instead he seemed... smug. And James didn't care much for smug.
The question caught James off guard, though Fisher's awkwardness in clarifying it further made him smirk a little his own self. He gave a small shrug of his shoulders, however, not sure he had an answer, or an adequate one at least, for the question. "Curiosity, I guess. He was there, he was willing... It's not like I have to worry about him telling anyone." He paused for a moment, pursing his lips in consideration. "I don't think I'll do it again though." He really didn't feel like he wanted to.