If you're the sort of person that can enjoy a story even when you don't get half the allusions/references the writer is making, more power to you. And if you're the sort of person that can't even tell the writer is doing that, and don't mind scenes where half the point is a callback to some esoteric piece you're unaware of,... hey, cool.
But if you're like me, you can tell when Morrison is making references that are going over your head, and it's detrimental to enjoying the story.