Nah it happens even with poor hearing. The problem is that decibels are computed multiplicatively, and the deafness duration is additive to infinity.
It also doesn’t take into account falloff or distance, and acts if everything in the reality bubble is right next to you.
As an example, a hulk taking a room down or a zombie dog chewing on a gas tank will usually deafen you no matter how far away, but the gas tank is only one high sound event and will have a lower chance of deafening you and have a much lower duration, whereas the hulk is a whole ton of crash events that all multiply against each other and make the duration super long.