How will morality questions be settled in the domain of self-driving cars?

Question

How will morality questions be settled in the domain of self-driving cars?

For example

1. If a dog is crossing the road, I'd expect the car to try to avoid it. But what if this leads to .00001% more risk for the driver? What is the 'risk cut-off'?

2. What if a cockroach is crossing the road? Will the car have a list of animals okay to run over?

3. What if a kid is crossing the street and avoiding it would kill the driver?

These questions seem to not really have an answer, yet self-driving cars are almost ready. What are they doing about all of this?

Answer 1

As far as I know, there is still a huge debate about this topic. I would say, that the main rule for every self-driving car is to avoid a crash if possible.

The question one should always ask is, in what situation would a crash really happen, and would a human react differently?

My answer is no. The point is, a human might try to avoid the child (3) but it would be out of instinct rather than "consideration". The driver might even harm others in this situation.

Since a self-driving car will normally follow the rules a critical situation will most of the time arise due to the other person, not the car. So I believe it is best to protect the driver at all costs.

The dog vs child problem could be solved via advanced animal recognition (human vs no human)

Regarding no (2): Too small = no human ==> car will ignore it.

Answer 2

I don't think these questions will need to be answered.

A self driving car will almost certainly avoid a situation like the ones described well before a human would have and hence would not have to choose.

For example it would slow down as soon as it sees a child close to the road. It will identify and react to the fact that the child starts moving towards the road and act before the situation requires the "drastic" scenarios that we invent.

If for some reason the car has to choose, it can also make the impact/avoidance have the highest chance of not killing the occupant of the vehicle considering how well designed cars are these days and that the speeds involved shouldn't be anything wild like 200mph.

Not to mention a network of cars along with street cameras and sensors would act/work together to resolve as a swarm intelligence so the car ahead or the traffic camera can warn/tell other cars that something they cannot see is a potential hazard. I can go on and on...

In my opinion, the bottom line is a self driving car will not road rage, drive at dangerous speeds in a residential area, get tired and fall asleep, text and drive or drink and drive, etc... I cannot wait.

Answer 3

The core issue with this question rests in probability. Specifically:

What if a kid is crossing the street and avoiding it would kill the driver?

How does the AI know for certain that avoiding it would kill the driver?

and certainty rears its head re:

1) If a dog is crossing the road, I'd expect the car to try to avoid it. But what if this leads to .00001% more risk for the driver? What is the 'risk cut-off'?

There would likely be no "hard cutoff". Earlier fuzzy logic systems have been implemented in automotive gear shifting and anti-lock breaking, but it is precisely the "fuzziness" that made them effective. Contemporary AI is far more sophisticated, and part of that sophistication rests in what might be though of as dynamic thresholds for decision-making. Because certainty only exists in special, limited cases (such as solved games), estimation must be used.

---

Regarding the cockroach, it would likely be too small to warrant a response, although a swarm of cicadas might affect the car's sensing ability and prompt poor-visibility navigational protocols. In general I'm sure pet-sized animals and bigger would be avoided, in the case of actual pets for humanitarian reasons, and for animals like deer, for reasons of driver risk (impaled by the horns at the worst, and at the least potentially costly damage to the vehicle.)

But I suspect the protocols for this would be breaking or swerving if there is a clear margin on either side of the animal (i.e. not a barrier, wall or cliff) and the direction change is controllable (i.e. hitting the animal is likely to result in less harm than an actual crash, and certainly less risk to the human, except in the case of the deer's horns.)

Answer 4

As others have said, your question is, and will continue to be a hot topic. I also agree that eventually self-driving cars will be able to handle your hypothetical situations better than many human drivers. I am not prepared to say when that "eventually" will eventuate.

However, I can also imagine some human drivers deliberately trying to cause self-driven cars to make poor decisions. For example, a "team" of three or more cars could easily confound a self-driven car's programming by co-ordinating their actions, especially once the actual program code used by the car is known. I'm thinking of situations where the self-driven car is boxed in by human-driven cars which indicate they are about to make a move and then do not, while others change speed and direction at the same time, or at slightly different times. Humans can be incredibly sneaky and unethical, and some are very good at finding exploits and weaknesses.