Look don't waste your time on thinking that, have your time with him, do kid stuff with him, play footie, take him to the pictures, be a Mum to a kid and then if he goes back, hopefully he'll have those memories forever.
Kids grow up fast, believe me I know. But you gotta understand love, this place, its giving you a kind of a chance, why not take it.