"I don't think his children have the same luxury in ignoring him. You have some leeway. I'm going to end up in the bottom of the Hudson soon and now is the worst time for me to die." He had to dutifully fulfill his promise to Zoe or he'd lose her forever. She didn't have the same lifespan, so time was of the essence.