Harry did follow, looking around just enough to locate the front door and considered the size of the windows, in case he needed to make a hasty retreat. It was sure as hell smaller than Malfoy Manor, he thought, as he followed. At least it was warmer. He didn't quite remember what had happened to the Manor, but all things considered, was quite grateful not to have to return there.
Draco had stopped, so Harry stopped a couple steps below and swept a wave of his hand, sarcastically inviting Draco to keep going. He wanted to tell him that yes, he was right here, he hadn't managed to get lost yet, but thought better of it.