Of course cats care! They're sensitive creatures and one shouldn't run around trouserless traumatizing the creatures!
Have you stopped and thought what damage you're doing to them, running 'round in your pants with pale sickly legs sticking out for all the world to see?