Link clenched his jaw, aching to argue. Getting constantly reminded by people that he 'just wasn't the same', or 'used to know better', when he had been trying his best to remember at all had been slowly fraying at his temper, and he felt he had the right to get angry and not be forced to grin and bear it.
But Jerrin didn't know how much it'd been getting dumped on him by others, only what she heard from Robbie, and Robbie wasn't too terrible about it, all told, so she really didn't have any idea of the position Link had been in these past few months. So she didn't really deserve his temper.
As for Zelda, he'd have to sit her down over the issue later, but there wasn't any good to come of putting her on the spot in front of an old friend she probably barely recognized and a stranger, so he let it drop with a shrug and a mumbled, "yes, ma'am."
Besides, he knew how mothers were, he didn't doubt for a second that Jerrin wouldn't exercise her Mommy Powers on everyone involved.