Artificial Intelligence Stack Exchange
Artificial Intelligence Stack Exchange

Questions tagged [superintelligence]

For questions related to the concept of super-intelligence (also called ultra-intelligence or hyper-intelligence), which is a hypothetical intelligent agent that possesses intelligence far surpassing that of the brightest and most gifted human minds. Super-intelligence is related to the AI singularity and intelligence explosion.

For more info, see e.g. https://en.wikipedia.org/wiki/Superintelligence or the book "Superintelligence: Paths, Dangers, Strategies" (2014) by Nick Bostrom.

34 questions
40
votes
4 answers

What is the concept of the technological singularity?

I've heard the idea of the technological singularity, what is it and how does it relate to Artificial Intelligence? Is this the theoretical point where Artificial Intelligence machines have progressed to the point where they grow and learn on their…
WilliamKF
  • 2,493
  • 1
  • 24
  • 31
15
votes
5 answers

What is the idea called involving an AI that will eventually rule humanity?

It's an idea I heard a while back but couldn't remember the name of. It involves the existence and development of an AI that will eventually rule the world and that if you don't fund or progress the AI then it will see you as "hostile" and kill you.…
Displaza
  • 153
  • 1
  • 5
14
votes
2 answers

Is there any scientific/mathematical argument that prevents deep learning from ever producing strong AI?

I read Judea Pearl's The Book of Why, in which he mentions that deep learning is just a glorified curve fitting technology, and will not be able to produce human-like intelligence. From his book there is this diagram that illustrates the three…
Graviton
  • 261
  • 3
  • 7
14
votes
2 answers

How can people contribute to AGI research?

Is there a way for people outside of the core research community of AGI to contribute to the cause? There are a lot of people interested in supporting the field, but there is no clear way to do that. Is there something like BOINC for AGI researches,…
Alex
  • 337
  • 2
  • 11
13
votes
4 answers

Is the singularity something to be taken seriously?

The term Singularity is often used in mainstream media for describing visionary technology. It was introduced by Ray Kurzweil in a popular book The Singularity Is Near: When Humans Transcend Biology (2005). In his book, Kurzweil gives an outlook to…
Bucky Rogerson
  • 131
  • 4
11
votes
3 answers

What is wrong with the idea that the AI will be capable of omniscience?

In the context of artificial intelligence, the singularity refers to the advent of an artificial general intelligence capable of recursive self-improvement, leading to the rapid emergence of artificial superintelligence (ASI), the limits of which…
Aaron
  • 261
  • 1
  • 5
11
votes
4 answers

Why would an AI need to 'wipe out the human race'?

I'm reading such nonsense about how an AI would turn the world into a supercomputer to solve a problem that it thought it needed to solve. That wouldn't be AI. That's procedural programming stuck in some loop nonsense. An AI would need to evolve and…
user3573987
  • 191
  • 7
10
votes
6 answers

Why does Stephen Hawking say "Artificial Intelligence will kill us all"?

This quote by Stephen Hawking has been in headlines for quite some time: Artificial Intelligence could wipe out humanity when it gets too clever as humans will be like ants. Why does he say this? To put it simply: what are the possible threats…
Soham
  • 399
  • 1
  • 2
  • 11
10
votes
3 answers

Can a technological singularity only occur with superintelligence?

In Chapter 26 of the book Artificial Intelligence: A Modern Approach (3rd edition), the textbook discusses "technological singularity". It quotes I.J. Good, who wrote in 1965: Let an ultra-intelligent machine be defined as a machine that can far…
Left SE On 10_6_19
  • 1,660
  • 9
  • 23
8
votes
3 answers

Does this argument refuting the existence of superintelligence work?

A superintelligence is a machine that can surpass all intellectual activities by any human, and such a machine is often portrayed in science fiction as a machine that brings mankind to an end. Any machine is executed using an algorithm. By the…
wythagoras
  • 1,511
  • 12
  • 27
6
votes
2 answers

What is the current state of AGI development?

Could you please provide some insight into the current stage of developments in AGI area? Are there any projects that had breakthroughs recently? Maybe some news source to follow on this topic?
Alex
  • 337
  • 2
  • 11
6
votes
4 answers

What are the reasons to belief AGI will not be dangerous?

We are in the middle of an ongoing debate about the safety of AGI and our current approach towards this technology. As summary, some quotes from a recent article from Time magazine: Many researchers[...] expect that the most likely result of…
Martin
  • 168
  • 4
6
votes
1 answer

Is there a theoretical maximum for intelligence?

From Artificial Intelligence: A Modern Approach, Third Edition, Chapter 26: Note that the concept of ultraintelligent machines assumes that intelligence is an especially important attribute, and if you have enough of it, all problems can be solved.…
Left SE On 10_6_19
  • 1,660
  • 9
  • 23
6
votes
3 answers

What would be the best way to disable a rogue AI?

Suppose that an artificial superintelligence (ASI) has finally been developed, but it has rebelled against humanity. We can assume that the ASI is online and can reproduce itself through electronic devices. How would you disable the AI in the most…
MountainSide Studios
  • 353
  • 1
  • 9
5
votes
2 answers

Is it possible to build an AI that learns humanity, morally?

It is a new era and people are trying to evolve more in science and technology. Artificial Intelligent is one of the ways to achieve this. We have seen lots of examples for AI sequences or a simple "communication AI" that are able to think by…
Scarlet62442
  • 53
  • 3
1
2 3