Don't take this as gospel, because it's been years, but I seem to recall Peter being zonked out on a combination of veeeery strange drugs and several weeks of torture-brainwashing by the time Norman told him this story. So it was a bit more like:
Norman: And then spending the night in the creepy old house drove me BATSHIT. Peter: *terrified drooling*