It's fine, I kind of love the suspense and all. :)
His shoulders slump just a moment when he realizes his pleas are essentially falling on deaf ears. That doesn't quite mean he's going to give up on the other though. He pulls back when he hears the door again, his body tensing slightly despite his best efforts to cover that up. He tucks his sonic away quickly before the young man grabs him again.
"Lovely offer, but sadly I think I may have to decline.", the Doctor sighed, his voice completely dead pan as he held his captor's gaze. "I told you that before of course and the answer hasn't changed. Only a mad man asks the same question over and over again expecting a different answer, you know."