If he was searching for something particular he wouldn't.. What?
Loïc realised probably a little too late that his confusion was probably showing, and he attempted to erase it from his face; he didn't want to look.. Well, confused. It seemed like the man had been making some sort of light joke, and clearly Loïc hadn't been expecting it. Who knows. He might not have understood it anyhow. Probably.
He did, however, understand the sentiment of something more interesting popping up anyway. He'd spent enough time in here - well, enough spare time, proportionally - to understand that principle in general, and then seen how it applied to other things. Most often it seemed to show up in coversations, much like this one, although people didn't seem to notice when they were veering off topic so much as they did when it wasn't verbal.
At the question, Loïc realised he wasn't even sure what Ser Durand was holding, and instinctively he ducked his head a little so as to try and catch a binding on the book he was holding. He realised half a moment later he could just look at the shelves and see what area they were in. Then he realised he wasn't even looking for a book. May but he was slow today..
'Oh, I wasn't really.. looking.' Again, he'd mostly arrived here more out of instinct than anything. 'I just, spent a lot of time here, and you seemed like you were looking for..' He suddenly felt like this was a bad idea. He was going to see this man enough later; why try and see him now? 'I'm sorry, I can go,' he said, already sort of turning to leave, 'I'll probably see you when we prepare to leave anyhow.'