He knows all too well how they feel about him so I think anything to do with trust is unlikely. I tend to think that it's because Padme is notoriously stubborn and apparently had to have her arm twisted to accept Jedi protection in the first place so they just sent someone she was friendly with to keep her happy while you were busy.
I'm alright with it though, things are going pretty well between them and will get better if Padme's dreams are any indication.