Im the UK these are the best options I can think of;
Brassknuckles for a weapon that you can use without making it too obvious your using a weapon so any onlookers would see it as not as bad as it is
(apart from the noise on bone!)
I love Halberds long spear, axe head and armour peircing hook all in one. But thats guna be cumbersome.
Probably a good large knife like a bowie as well as a smaller stabbing one with a thin profile like the loverley fairbern sykes fighting knife which
would give huge penetrating ability. Or even better the cold steel Tai Pan I think it is is a wicked dagger. Thats your best bet to peirce armour in a
knife I think.
A good axe is also a great tool so having one of them would be good.
Obviously depends if your on the move or staying put. A claymore certainly would be intimidating tho!