It counts adjacent tiles. Every piece of adjacent furniture bumps up the door/window’s resistance by another point. You’d max out at five, but the two on the other side would just get smashed by zombies, so you’re practically limited to three. Still, even one extra point is nothing to sneeze at, especially since it’s way faster to shove furniture over than board something up.