There is no way Norman could get away with doing anything to them.
Also consider that A) there is no way Norman would be able to get passed their anti-Doctor Doom defenses, and B) the FF probably has security cameras all over the place, so they just taped Norman's entire threat. They have a tape of the most powerful man on the planet threatening to murder children...