It wasn't unusual for most individuals to be uncomfortable with him. In many ways it was rather natural reaction. His kind brought misery and destruction wherever they went. Granted no one here knew exactly what he was yet, and he'd like to keep it that way as long as possible. If you could identify something and begin to define it, you could defeat it.
"Well I do have a great deal of experience in hunting down important items and individuals as I mentioned. Fighting is something I personally try to avoid as a rule, though I am not unfamiliar with it."