Well... you do have a point. He's very honest, which isn't something you find very often these days. He's called you worse? Like what? I'm sure he didn't mean it in a bad way.
I know how that feels, but Having your brother can't be that bad. I used to wish I had a sibling, once-- but there are all kinds of people living here. You're bound to meet someone at one point or another.