They shouldn't have told him. Should have stayed secret. They're breaking somebody's trust by saying anything at all; they're disloyal. And now he won't look at them, won't touch them; what if he thinks they're damaged goods?
He doesn't even know the half of what it was like. Never tell, a voice tells him. Never, ever tell.