He was going to say that it wasn't safe to do those sorts of things these days - there were a lot of disturbed and/or perverse people out there who might use the opportunity for theft; or commit other sorts of crimes.
"I remember quite a few things from back then too. But things have changed now; everything has changed. Maybe it would be better to let go of those days."