Back before the Chitauri invaded a lot of people used to say that any alien civilisation capable of reaching Earth, especially without us having already detected them, would necessarily be too advanced to actually want to bother with us. Guess it's about the same principle.