Depends on the circumstances. Also the box, possibly. I don't think I'd judge sanity on one or two memories, yet.
More importantly, insanity isn't an inherent thing. In my experience, the person you choose to be here is going to be as much of a factor as the person you remember being.