When something has been caught, you don't truly let it go unless or until you have to. So far, that time hasn't come yet.
His expression changes to one of confusion at her words. "I am not upset. I remembered not to hurt you." Whether that would have upset him is her guess.