You must be reading my mind...
I've actually written a story with a background just like that! However, the protagonist found ways to get people to like him anyway.
I wasn't basing that on my own life at all, but maybe it's a subconscious thing. *shrugs* Anyway, I definitely see being clever as a blessing rather than a curse.
Though maybe I AM just getting by on being pretty...