"No you don't. This is your apartment" he answered honestly. His tone didn't change though and neither did his facial expression. He wasn't going to cause any more problems for her. Obviously she wasn't interested in him, so he was going to pull away but that didn't stop him from caring about her. He wanted to make sure she was safe more than anything.
"I will be fine" he added, but there was no conviction in his words.