i'm not sure how that would work with mediumship/card magic, but the other idea was that it was somehow found out he was armsman and had caused some significant damage (probably while in cahoots with some villain or another), and things dissolved from there. that could possibly work if some ghost got to talking, lol.