Considering I'm in a relationship with him, I'm bound to be a little defensive.
I get where you're coming from. I experienced what another version of him did back home, but I'm telling you without a shred of doubt that he isn't the same person that is back there. He's been through too much to be that person.
You know the answer to your question, though. Unless something major changed everyone would do something. The thing is that Loki has worked hard to be a different person here. You don't know him like everyone else does, and you don't have to as long as you don't start any conflicts with him he'll leave you alone and the two of you can mutually steer clear.