From the amount of people they found in the pillar and the reaction of those who touched it, I'm guessing most of the first group to come here eventually ended up there. Maybe that's why the judges started bringing new people. They needed something to feed on, and the old ones had already been eaten by the pillar.