He didn't know for sure, but he had the suspicion. Joe wasn't the smartest guy in the world, but he was observant at least.
She had wanted to see him, not the other way around, so Joe just took a sip of his drink and smiled, waiting for her to bring it up. Azula wasn't a woman you pushed.