Not at all. Even if you knew exactly what you wanted to major in, you'll still have to fulfill your general education courses. Math, Science, Literature, & arts courses. All your basic Freshman 101 classes. They're required to graduate.
A lot of freshman start college as undeclared. I promise you're not the only incoming student who feels this way. But the best thing about college is that nothing is set in stone. Say you do declare a major and a few semesters down the line you realize that's not really what you want to do- you're not stuck with it forever. You can change your major as many times as you want. My friend Chelsea literally changed her major four times when we were in college together. She went from Education to Nursing to Psychology to English.