It'll be a big risk, when we do take out one like Queen. The people under her influence are... irrational. Huntress could be another bad one, and Librarian's on our side, helping us. Hopefully, if Lacerta doesn't have Persona's by now they'll have it soon, too, since she's also on our side, and it's to our benefit to protect the keystones of those Judges as much as it is to break the ones belonging to the ones opposing us.
Counting the ones we don't know about yet, and considering that we haven't been the only ones to go out looking for them, we might actually be close to being able to truly fight back.