Mostly, I'll listen to Tool or Muse, because I can do that without letting the words distract me. Another one I really like for writing is Gregorian Chant...
Also, Redhill Rats 'My Father Was A Werewolf' is a brilliant thing for me as far as inspiring muse goes (it's Irish folk rock from Helsinki) - you can download it or listen to it here