Yes, he remembers that with Spike all too well, but it only exasperates him further because he didn't know what to do with it then either. They only really got through it because in the end Spike able - perhaps due to Ianto's influence - to articulate what he needed.
Of course, he had a lot more reason to want to help Spike, too.
He glowers at Spike for a long moment, all of this churning in his head, and then he lets out a sigh, running a frustrated hand through his hair.
"All right, point taken. But anyway, despite the bluster, you really think he's not actually going to hurt Ianto? Or anyone?"