Oh dear, how it would suck to have this trait given the large amount of spiders wandering the wilds.
That said… I am all for this. Although, might I suggest a decrease in stats happen only if one actually sees the spider?
A spider could be out of the player’s sight and, it wouldn’t really make sense for the penalties to apply then.