Hell yes, he can't be let run around. He'll be stopped soon. I'm sure we know plenty of magic ways to stop someone in cases like this. Just not killing, I'm not going to do any of
Or at the very least, a few of us can transport the other people to his location if it's found and then they deal with him, and maybe we can cover them while they do it.