I have a theory it's because the existence of spirit guides can't be independently verified by spellcasters. So it could all be a vast conspiracy to make us appear more formidable than we are.
I'm not sure how spirit guides make us more formidable, but there you go.