The Tesseract's secrets are not my own; I will happily tell you what I learn when I learn it.
What I do know is that the shades follow. I left the tower for the library thirty minutes ago and she-- remains. Different scene as well. So they do adapt, I suppose.