Normally, Bolson might have been put off by that abrupt dismissal, but Link made a point, and it sounded like the little bit of space he and the queen would have that night to themselves would be it for some time to come. Unnecessarily overcrowding the time between now and then wasn't a very kind thing to do.
And as it had been pointed out, staying in an inn wasn't as safe as a private residence, and Link's nerves were probably already fraying faster than a poorly-constructed rope as it was. No need to add to it.
So he looked at Karson. "I do believe the captain of the royal guard has dismissed us, Karson," he said, giving Link a cheeky look, before theatrically bowing. "We simple construction workers will humbly take our leave and return to work."