If Scott realized that the hand on his shoulder was there to keep him from pulling away, really realized it, he'd likely respond with annoyance at his own predictability and increased respect for James. Because his response is to tense up and lean back away from the hand. There's another soft growl there, in response to the grip and pull of James' hand. The confidence, the pull, and just the grip.
He finishes with James' belt and his hand on James side tighten at the same instant that soft, rough-edged sound leave his throat. A second later and he's moved on to unfastening James trousers, backs of his fingers pressed against James cock and sliding downward. Then he turns his head to the side, nips James forearm and realizes they haven't said a word since the last 'really'.
He rather likes it that way. "How undressed do you want to be?" he asks, precisely and, perhaps surprisingly, clearly.