Yeah, I'd say it's safe to say he and Hermione aren't really friends. He probably thought she looked fit at the Yule ball, but that's about it.
I kind of like the idea that he and Audrey dated but she doesn't remember. He could try to allude to something that happened and she'd be like um what? haha