You're not making a great case for it not being offensive!
I mean, are you saying that it would be legitimate that "a woman not wanting to be called honey, sweety, baby, sugar" be dismissed out of hand? Because that's the only way I can see the comparison making sense, in this context.