I think this is one of those situations where someone will always be upset, so there isn't really a right answer.
For me, it depends on the PB and whether or not I was an actual fan of that person. I've used Ryan Dunn as a PB before, and I probably will again, but I couldn't imagine using him right now.