It's what you need to do and he can sulk, but you kind of need to worry about you right now and your own mental state.
I don't think he knows how to handle you and the Cage. Which he should suck up and work with you but I don't see that happening anytime soon. I hate not knowing the future but at the same time maybe its better we don't.