Hmm. This problem could be due to resizing larger than the actual image/video size (but I'm sure you know better), the Youtube quality itself (gifs are really only good from there if they're HD), or the gif settings itself.
If you have it on the setting with the most colors--and sometimes if it's 'dithered' it will come out better. You may even have to make it a bit smaller to hide the quality.