Good. Make a last ditch effort to convince them you were playing double agent and didn't tell anyone due to higher orders from the currently absent Director Fury before you arrived here. It's likely to fail, but worth planting a few seeds of doubt.
If anyone does come to find you, consider yourself authorized to be a killer, not an observer, now. I preferably want the Avengers alive, but if it cannot be avoided, death is a suitable alternative.