He can't look at her now. "I just... I don't want you hurt. That's all." He doesn't want her to fall in love with someone else, even though no doubt she will have to marry someone on a more equal level. Nobles are funny like that, always having to marry their children off to even richer people.