That's what gets me too. It makes very little sense, as I'd expect people in the Marvel Universe to be more concerned of random Skrulls still living among them than anything else.
But once again, the average Marvel Universe citizen is roughly less smart than a broken brick.