Not directly a threat, I mean. He believed mutants were a higher form of life and targeted humans with terrorist attacks, he drove most of the anti-mutant sentiment. But he only fought other mutants when they were trying to stop him. I know he had a weird relationship with Xavier, he probably knew a lot of the others too.