I feel that way more with my boyfriend than my twin... but maybe that has something to do with not growing up with him again.
I think maybe it's easier to tell my brother and I apart because even if our faces are the same, I have black hair and brown eyes but he has white hair and green eyes. But I wouldn't think even twins who look exactly alike would be the same either. Everyone's different.