Thor/Loki.
Did you meet those who wielded these other sceptres? Did you see them with your eyes? For the power the Tesseract had over you did even perhaps corrupt your own vision.
However. With our doorway opened as it is, I would think that it would make us vulnerable to the power of the other sceptres. A great number of your compatriots from different worlds.