Oliver just shared a rather intense look with Percy and then smiled at him. It was a bit vague but he was just flirting with Perce in front of his brother and Harry. It just embarrassed Percy and Percy knew that Oliver did it on purpose.
I was intending on sort of elaborating on that once the got back to Oliver's place but the story took so long to get to this point that I had to end it there.