The Controllers turn up almost constantly in the Legion of Super-Heroes era, so it's a safe bet that the ones who died (only around five of them, anyway) were only a portion of the whole race. Maybe Larfleeze crippled the Controllers, but he didn't wipe them out.