If u really want to go guns from the start - then you absolutely have to get hacksaw (from hardware store), “Under the hood” (from hw store or library) and any sort of knife. Then back at the shelter u can smash some lockers to get a pipe, slice some clothing into rags and after reading ur mechanics up to 1, craft yourself a silencer. Without it firing anything bigger than .22 in a city - should and will get u in big trouble.
I, personally, prefer an slow and nice archery start. Just spend 2 points on survival and archery when crating your character, then raid a hw store before 9:30. You need 2x 3" strings and a knife, combat one, preferably. Those are common at mil. surplus stores. If u manage to pull it before 9:30 - get outa fcking city asap, and find yourself a quiet place with water and some wildlife nearby. Craft shitload of arrows and spend some days to become rambo. Then u can pay those Z’s a visit, and have some tasty payback! As bows are silent - u can do it at daytime to, just be careful to always have retreat route and arrows. In my current game i raided megastore at day 2. Now there’s big morgue, nice and silent.