You tried to use magic to get us into MIT, but it made a lot of bad things happen, and you tried to make Peter do things he didn't want to do to fix it... uh... so he locked you away in idk kaleidoscope world. He probably feels guilty about that.
The Peters sort of saved the day but it wasn't enough.