[Yes, the instructions that he gave his sister were to ignore the Salvatores. It's not that he doesn't want to shatter their ankles and compel them to talk a nice long stroll through the park - and that would just be to start. But the back and forth gets him nowhere and there's no only dealing with just one of the two, so when a move finally has to be made it'll require taking most of them out at once - quickly and efficiently (he almost hears Elijah speaking at his side), before the Wardens catch on. While the punishments don't exactly fit the crime here, murdering a half dozen people and walking away slapped with gardening work sounds too far-fetched.
Of course it's incredibly difficult to remember that when Damon Salvatore stumbles into his path.]
Not me? [He points at his chest, as though mildly offended, but he makes no move to approach.] I can't imagine why.
[It's not playing completely dumb when there's a shit-eating grin tugging at the corners of his mouth.]