There's no switch to turn it off, and it depends on how loud someone is broadcasting. If you're anxious or extremely emotional, odds are we hear you. It's like being in public. There's a general buzz of people talking, and then someone who yells or laughs or cries. Someone is close to you so you hear their normal talk. There's a whole etiquette that we usually follow. We don't bring it up unless you do. It makes people too uncomfortable.
Maybe your past is not private because of that, but your present is. You have veered off-course.