Taking the mindwipe off was probably a bad thing because since it was still in place, Tony's feelings for Pepper were still dampened down a bit considering he didn't remember her dying at all.
"We're keeping it a surprise, but I'm secretly hoping for a girl with hair as red as her mother's," he replied with a broad smile, letting Ant tug on his finger. He looked almost like Tony in his baby pictures aside from his eye color which was clearly his mother's. "Well, let's get out of here. I don't like to leave Pepper alone too long. Never know what'll happen these days with her pregnancy." Then he opened the door for Remy to get in before sliding in and driving them all back to the house.