People will leave. It's a fact of the Seal. We have to deal with it and it sucks and I'll never get used to it, but it's there. But if you isolate yourself, you'll be miserable until the day the Seal decides to take you, too.
It doesn't mean you love the ones who've left any less. It just means you have to focus on you, first.