You just need to sweet talk them a little first. Then they settle.
It's been especially quirky lately with the disappearances. Sometimes there's only one, sometimes it's a whole list. Sometimes it doesn't happen for awhile and then there's a deluge - there's no predicting it.