Think of it this way: if you were struck by lightning, a person 500 feet away may not be harmed by it, but if straight line winds cause your house to collapse, you can say with relative certainty that your neighbor will have some damage.
Another factor is the reliability of protection. Major hail can total a car. Strong straight line winds and tornadoes can collapse or remove your house. A lightning bolt will cause property damage, but you will be safe inside, provided you aren't touching metal.