As weird as it sounds (and believe me, it DOES sound weird, even to me), this 'infinity gem' is a mysitcal item of some kind. And it's gone a little haywire, which is what's causing all this.
The best I can do is assure you that you're as safe as possible here. The people in charge here (Cosmo, Rocket, and the other Guardians) are a bit odd... but they're good people. And... and animals, I guess.