It's largely for this reason that I generally try to make it clear early on in my interactions with my fellow males that I'm NOT the tough and macho type, and don't intend to pretend that I am. It works amazingly well - if someone says something like 'what's the matter - you chicken?', just say 'hell yeah, I am!' It kinda takes the wind out of their sails...