For questions regarding various parameters/methods of implementation/improvement/analyzing the safety of an Artificially Intelligent algorithm. A typical real world example is autonomous vehicles.
Questions tagged [ai-safety]
26 questions
31
votes
7 answers
Is artificial intelligence vulnerable to hacking?
The paper The Limitations of Deep Learning in Adversarial Settings explores how neural networks might be corrupted by an attacker who can manipulate the data set that the neural network trains with. The authors experiment with a neural network meant…
Surya Sg
- 495
- 4
- 13
20
votes
3 answers
Are Asimov's Laws flawed by design, or are they feasible in practice?
Isaac Asimov's famous Three Laws of Robotics originated in the context of Asimov's science fiction stories. In those stories, the three laws serve as a safety measure, in order to avoid untimely or manipulated situations from exploding in…
3442
- 768
- 4
- 11
11
votes
2 answers
What tools are used to deal with adversarial examples problem?
The problem of adversarial examples is known to be critical for neural networks. For example, an image classifier can be manipulated by additively superimposing a different low amplitude image to each of many training examples that looks like noise…
Ilya Palachev
- 299
- 2
- 11
10
votes
6 answers
Why does Stephen Hawking say "Artificial Intelligence will kill us all"?
This quote by Stephen Hawking has been in headlines for quite some time:
Artificial Intelligence could wipe out humanity when it gets too clever as humans will be like ants.
Why does he say this? To put it simply: what are the possible threats…
Soham
- 399
- 1
- 2
- 11
8
votes
2 answers
What are examples of techniques to prevent bias in artificial intelligence systems?
I recently read an article about how artificial intelligence replicates human stereotypes when applied to biased datasets.
What are examples of techniques to prevent bias (and stereotypes) in artificial intelligence (in particular, machine learning)…
user6698
7
votes
1 answer
What will happen when you place a fake speedsign on a highway?
I was wondering what will happen when somebody places a fake speedsign, of 10 miles per hour on a high way. Will a autonomous car slow down? Is this a current issue of autonomous cars?
Eddy
- 81
- 2
6
votes
4 answers
What are the reasons to belief AGI will not be dangerous?
We are in the middle of an ongoing debate about the safety of AGI and our current approach towards this technology. As summary, some quotes from a recent article from Time magazine:
Many researchers[...] expect that the most likely result of…
Martin
- 168
- 4
6
votes
1 answer
What is the relationship between robustness and adversarial machine learning?
I have been reading a lot of articles on adversarial machine learning and there are mentions of "best practices for robust machine learning".
A specific example of this would be when there are references to "loss of efficient robust estimation in…
boomselector
- 125
- 7
6
votes
3 answers
Why did a Tesla car mistake a truck with a bright sky?
Do we know why Tesla's autopilot mistaken empty sky with a high-sided lorry which resulted in fatal crash involving a car in self-drive mode? Was it AI fault or something else? Is there any technical explanation behind this why this happened?
The…
kenorb
- 10,423
- 3
- 43
- 91
5
votes
2 answers
Can artificial intelligence applications be hacked?
Can artificial intelligence (or machine learning) applications or agents be hacked, given that they are software applications, or are all AI applications secure?
ME.
- 115
- 1
- 6
5
votes
1 answer
Why is AI safety so much harder than Isaac Asimov's "Three Laws of Robotics"?
I understand that AI researchers are trying to create AI designs that allow for desired behavior without undesirable side-effects. A classic example of an attempt is Isaac Asimov's Three Laws of Robotics. This idea seems to have been debunked due to…
N00b101
- 191
- 1
- 5
5
votes
2 answers
Concrete examples of unintentional adversarial AI behaviour
Are there any real-world examples of unintentional "bad" AI behaviour? I'm not looking for hypothetical arguments of malicious AI (AI in a box, paperclip maximizer), but for actual instances in history where some AI directly did something bad due to…
k.c. sayz 'k.c sayz'
- 2,061
- 10
- 26
4
votes
1 answer
Is it necessarry to create theory/infrastructure to prevent people from creating AI incompatible with a safe model (if we create one)?
Nowadays we don't know how to create AI in a safe way (I think that we don't even know yet how to define a safe AI), but there is a lot of research in developing a model allowing it.
Let's say, that someday we discover such a model (maybe even it…
brzepkowski
- 141
- 4
4
votes
1 answer
What topologies support recognition of action sequences?
The ability to recognize an object with particular identifying features from single or multiple camera shoots with the temporal dimension digitized as frames has been shown. The proof is that the movie industry does face replacement to reduce…
Douglas Daseeco
- 7,423
- 1
- 26
- 62
3
votes
1 answer
Does Rice's theorem prove safe AI is undecidable?
According to Wikipedia
In computability theory, Rice's theorem states that all non-trivial,
semantic properties of programs are undecidable. A semantic property
is one about the program's behavior (for instance, does the program
terminate for…
Jesus is Lord
- 169
- 5