Superman had absolute super recall in operation essentially from the time of his birth, the mind-probe helped him retreive memories he wasn't aware he had.
And Jor-El worked at home, so yes, Kal has a lot of memories of him, though like a good father he did take Kal with him on trips.