When Severus moves in with Harry and his children, the last to warm to him is James (and the feeling is entirely mutual). The year after James leaves Hogwarts, an accident/illness threatens Harry's life. James and Severus finally see each other clearly and come to an understanding. All is well. ;)