Emma/Jefferson.
I can say no to helping people, I just don't see any lost causes around Storybrooke. Men who run out on their families, though.. I can hate them till the cows come home. I used to specialize in deadbeats on purpose.
Was your family... a portal jumpers? Or is that something you stumbled into on your own?