It's a dream, but it's as real as here. The thing is, the you in the dreams? Isn't actually you. Hold on to that. He might feel like you, sound like you, and you can feel and remember what he feels and remembers, but it's not you. You're you.
The other guy's memories are bleeding over from the other world and making your life harder, but don't let it make you other than you are.