That might actually be the reason why the Five seem not to be having a very good time - they came to the party, but they're still residents of Limbo, so no one can see or hear them. It'd be a bummer if you kept getting slammed into by random people who couldn't see you.