Innocence is holy material for fighting akuma. My hammer is made of Innocence. But his is his arm. It puts a strain on your body to host it like that. Its kind of like having a parasite.
And as for the Noah, he's constantly straining to keep that in check probably...