Erandur rose an eyebrow at Loki's confusion to the Soul Gem. Normally, if someone put thought in to it, it would activate. Even Ben knew that, he was able to surprise his friends during their camp out before this Higgs business started.
Erandur would take it that Loki did not want to know. Not yet, at least.
When he was offered the Gem back, Erandur took it gently. He understood. there was some information that may not should be shared. The look in Erandur's eyes would let Loki know, if he wanted the Gem again, it was his.
"Well... If words will do you better, my friend, then.." He then gave out a detailed explanation as to why and how the fight between himself and Higgs came to be. "... And then Dr. Cuddy took good care of me in the Med Bay, before Scarlet showed herself to tell me her husband had been taken.."