How about that silly 'woo' noise that ghosts make when they know someone is afraid of them, but very, very quietly? It could start and stop, too, so people would think it was over but then the nuisance would begin again.
Of course if a fellow were really plotting such a trick he'd be very foolish to announce his intentions over a public telephone network. You're quite safe from it.