No, it isn't. There's absolutely time to gain a degree or simply indulge in classes. Although there's nothing to say you have to. Some people just naturally absorb information without proper classes.
A little bit of fun never hurt anyone. Besides, it's interesting, and that is preferable to the alternative.