It really depends. Usually it's nothing too serious... you'll suddenly lose your normal clothes or say something without realizing it. But other times it can be more serious, causing this place to change its landscape or to make people forget their memories...
It always wears off, eventually. But it can still be troublesome.