No, you don't need to do be stuck with other kids, but it does give you a chance to meet people your own age and maybe make some social connections. But that's not for everyone.
Well if you want sports with a ball, you definitely can't beat Baseball, Basketball, and Soccer. Oh, there's also kickball. I remember playing that as a kid in school actually. That was a pretty big favorite.