intelligence explosion

AI--

Imagine writing an AI (AI’) that is barely not smart enough to improve upon itself. Give it access to its own source code and tell it to rewrite itself. At first, it will make itself marginally stupider (AI-). But then, the mistakes that AI’ wiol have made in writing AI- will enable AI- to make even bigger mistakes, leading to a version AI–. These mistakes will add up. Within a few generations, AI– will become so stupid that no human being can understand it any more.

youtube

The Intelligence Explosion: A Short Sci Fi Film about AI Ethics

♛ THE TWISTED ♛

full name: lady sloan (born victoria janelle sloan)
age: 24
gender: cisgender
orientation: greyromantic pansexual
species: human
nationality: american
height: 5′6″
occupation: grocery store butcher
key notes:

  • eccentric, explosive, intelligent, reckless
  • has a passion for chemistry and love for explosions
  • more likely to butcher a human than a pig
  • changed her name after she became fixated with rich family friends calling her young lady
Let an ultraintelligent machine be defined as a machine that can far surpass all the intellectual activities of any man however clever. Since the design of machines is one of these intellectual activities, an ultraintelligent machine could design even better machines; there would then unquestionably be an intelligence explosion, and the intelligence of man would be left far behind. Thus the first ultraintelligent machine is the last invention that man need ever make.
—  Irving John Good
Let an ultraintelligent machine be defined as a machine that can far surpass all the intellectual activities of any man however clever. Since the design of machines is one of these intellectual activities, an ultraintelligent machine could design even better machines; there would then unquestionably be an ‘intelligence explosion,’ and the intelligence of man would be left far behind. Thus the first ultraintelligent machine is the last invention that man need ever make, provided that the machine is docile enough to tell us how to keep it under control.
—  I.J. Good