We need crazier weapons, ones with severe drawbacks. Like… a fist like weapon with jackhammer parts strapped on it. Can bash through walls when activated, but gives a lot of encumbrance to the hands, and some dexterity loss, since it is more or less a jackhammer strapped on your hand. Or… a fist with an acetylene torch strapped on it. Can cut through enemies and doors with it’s torchy bits… and might cut you by accident. Or explode.
If fact, make a lot of things be able to be strapped on your arm. It’s the end of the world, and you should take the chance to go out as crazily as possible!