Plus I imagine if you're flipping in and out of so many different 'verses, and getting to be so many different versions of you, stuff gets fuzzy along the way. It's a lot of memories in one noggin.
It's hard to get the Control stuff to appear - I guess if you have mind powers, it might be easier? Which is a weird connection.