More than the actual reasoning behind their anger, Harry was irritated that the whole thing was getting blown out of proportion. He hadn't given that Death Eater any information, though admittedly his comment had hit close to home. But there were a lot of woods - all three of them knew that much by now. They'd seen quite a bit of them.
But he was determined not to argue. He'd gotten what he wanted from the journal entry, gotten to talk to someone other than his friends; it had been especially nice talking to Ginny, though frankly he'd kind of enjoyed baiting the other bloke, too.
Moreover, if the Death Eaters really knew where in the woods they were, wasn't it better now that they knew it? If anything, Harry thought they'd gotten more out of the journal entry than the Death Eaters had, just like he often did - or had, once upon a time - when his scar prickled and he could see what Voldemort was doing.
Maybe he'd make him angry enough that it would happen again and he'd find out exactly how much of a problem he'd caused. Not that he should be thinking along those lines, he knew, but... it was possible.
"Works for me," was all he said, holding out a hand in readiness to Apparate. Unless there was going to be an argument about it, they should probably just get going.