If you had actually read Robert Heinlein's Beyond This Horizon, you would know that in the "Armed Society" which is considered "a polite society" that there is the custom of dueling to keep societal order. Someone can wear distinctive clothing to show an unwillingness to duel, but this results in a lower social status.
That may sound appealing to you, but it's science fiction and fantasy to everyone else.