Maybe it's a power thing. Just a lot of the time, people will remember the danger and doomy things, or stuff more close to they are now. With maybe the only occasional childhood memory.
Other than the one, seems like all of mine is after we met Quartz-kun, Mouri-san, and Ran-chan.