No, I definitely get how that could frustrate you seeing as he is a version of you and a bad example at that. People can draw some shit conclusions about you from him.
Still, he's not you, because clearly you become a different person in a different timeline because of different circumstances. Something changes you and you are not him. Just like he is not you anymore.
It's your life man, alternate dick versions or not, if you hate him, don't become him. Simple as that.