[he's worried, but he doesn't want to scare her. So, he stays silent for a few moments while thinking this over]
You said you don't know the details, so it might be too soon to make any sort of guess. It could be that the curse didn't have to do with just you leaving. We can look into solutions just to be on the safe side if it worries you. There are all sort of people here, after all.
Even taking that aside, it could be Oyashiro-sama's influence doesn't reach here. In a way, the judges are like gods, aren't they? So it stand to reason that they would be able to block an outside one's power. It could be that she didn't have the time to curse you at all, the moment you left to come here.