Ahh - I am "the host"/the original/whatever you want to call it, I don't know how much that made a difference here - when the first person showed up on and off, I talked to him, when the first person showed up full time, I talked to him, and then when more people came, same.
You're right - you can't change the past, just work out where to go from here - what works best for your people.