Chances were, they weren't thinking of you specifically. It was probably more the fact they were caught at all that spooked them.
Also, be careful walking on your own too early. 'Stranger danger' was still alive and well in the 50s, it just wasn't sloganized and victim blaming didn't start in the 21st century.