Well, arguing with a Templar could probably have consequences. Comfort is one thing and well, I'm not really sure what the different colored robes mean as far as rank. But, you're a Warden now and doesn't that outrank anyone in the tower?
My clothes weren't very nice when I was a child either. It wasn't like my grandfather would have bought me something nice even if he could afford it. But now that I can buy my own I love to get myself pretty things.