"So far as Al is concerned, I'm still his brother. And so far as Mom's concerned, I'm still her son," Ed tells him. "I got away before she could do too much damage."
Envy was bringing up things Ed didn't want to think about too much, because he knew it wasn't good for his mental health or emotional stability.