Then, something a little different that wouldn't catch everyone's attention easily. Like if we're being questioned, something for "Don't say anything, or lie" [moving a hand behind his neck], and "it's fine to talk about it" [and scratches the back of his ear].
... but I guess those suit me more than you, it'd look weird if you were the one to do it.