That is true. [He's referring to the "haven't properly settled yourself in" part but means for it to sound like "you must be cold" is included in that. Ah, the joys of being forbidden to outright lie.]
Yet at a time like this I cannot possibly make such things - anything related to my own comfort - my priority.