Then he needs to get over it. It's my life. It's a part of me. Not talking about it doesn't make it go away. If he cares about me, he should care about my life whether he's in it or not.
Don't get me wrong I'm not angry at him. But it feels like if that is the case, there will always be a barrier between us.