It would of course be beyond shameful for a butler to panic in the face of adversity. [Beat.] Not to mention it's quite unbecoming to complain. [Which is him admitting he is, in fact, not at all pleased by any of this.]
Then again, I would assume not everyone arriving here has reason or need to hold themselves to those standards. [Hence why not everyone handles it as gracefully? --Is he suggesting this is how every butler should handle these magical shenanigans? Yes.]