There's a long moment where John just stares at Sherlock, his mind racing. He's angry again, annoyed, he feels slightly betrayed, and used. He knows Sherlock doesn't mean for him to feel that way, but that's how he feels. He let him in, let his guard down. He comforted the man, even kissed him! And now Sherlock didn't seem interested in the slightest.
Something inside John snaps when Sherlock doesn't answer, he reaches out and grabs the other's wrist roughly, giving him a tug. "Sherlock." He growls, his eyes narrowing. "Answer me when I speak to you." He orders.