You shouldn't turn it down. Give 'em hell. It'll make you feel better and it'll make me laugh. Win/win.
Who cares what they say? If you hadn't done something to the loudmouth by now, they'd all be moaning on about how terrible of a person he is and how much they wish they could get rid of him.