I have it that Noah's father didn't start a family until he moved to La Grange, so she would still be native, born and raised in La Grange. Perhaps she refused to go to Dallas for the summers at some point as she grew older? And just Noah had the tight relationship with the grandparents.