[Much as he hates the idea alone of his little brother being the Messiah... what would happen if he were killed is also a problem.]
And if the people have no power once the source of fear is gone, those who stand with the one with power will crush the masses utterly. They are as afraid of him as the masses are. Once that wall is gone, the world will be even worse than a hell on earth.