The point is that I don't want any of them to take anything. They don't have the right. What if everyone started obliviating whoever had the memories they didn't want them to have? Obliviation is one of the most distasteful forms of magic I can think of. Censoring knowledge just because a few bad actors have misused it is barbaric.