"Wait, yew and yer grandmama didn't live here? Then where? Did anyone live here? What about slaves?" He didn't see a reason for the place to be left in such a state, but that was him. There were quite a few things the two didn't see eye to eye on, and this was one of those issues.
Following her, he replied, "What's wrong wit' da comments? They not be true, lass?"