But here's what I see, and you tell me if I'm off base.
Loki. Here. Not challeneged. Two Avengers seemingly okay with this which is remarkably out of character for any SHIELD Agent, let alone Avengers. Loki is known for the ability to make people his bitch and has in fact gotten Barton once before. And the before thing, maybe he is, Simmons is from an earlier point than I am but by that logic, deal with him here and we save New York.
Again, I've been here two days, I could be wrong about how the seal works but there's evidance to support me. Even you have to see that