Re: "He hates the French..."
Well, after the 'stands for France' thing Fury was 'what the Hell was that' and Steve was 'I dunno, I wasn't really thinking'. And it's Fury who says it here.
I can buy Steve having general xenophobia of the 'all the food's foreign muck and you can't get a decent cup of tea anywhere' kind. It's not uncommon in people born at his time.