This sounds familiar. Heinlein often made the point that a gun totin' society is a polite society, and in many of his futures, all adult males were packing. Of course, Hip Hop society is a fine example of how gun ownership increases politeness.
Eric Frank Russel wrote stories which, if not this, were like this.
Finally, clearly not the story you are thinking of, but along the same lines, is Van Vogt's The Weapon Shops of Ishar. "The right to own weapons is the right to be free."