Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

51
Mind Is All That Matters: Reasons to Focus on Cognitive Technologies Eliezer Yudkowsky Singularity Institute for Artificial Intelligence singinst.org

description

from the Singularity Conference 2007

Transcript of Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Page 1: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Mind Is All That Matters:Reasons to Focus on Cognitive

Technologies

Eliezer YudkowskySingularity Institute for Artificial Intelligence

singinst.org

Page 2: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Eliezer Yudkowsky Singularity Institute for AI

Page 3: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)
Page 4: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Eliezer Yudkowsky Singularity Institute for AI

Page 5: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)
Page 6: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Eliezer Yudkowsky Singularity Institute for AI

(Image from Oak Ridge National Laboratory)

Page 7: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Eliezer Yudkowsky Singularity Institute for AI

Felleman, D.J. and Van Essen, D.C. (1991) Distributed hierarchical processing in primate visual cortex. Cerebral Cortex, 1: 1-47.

Page 8: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Eliezer Yudkowsky Singularity Institute for AI

Page 9: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)
Page 10: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Eliezer Yudkowsky Singularity Institute for AI

"Book smarts" vs. cognition:

"Book smarts" evokes images of:

• Calculus• Chess• Memorizing facts• Strict rules in well-

understood situations

Other stuff that happens in the brain:

• Persuasiveness• Enthusiasm• Empathy• Strategic thinking• Musical talent• Rationality

Page 11: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

The scale of intelligent minds:a parochial view.

Village idiot Einstein

Eliezer Yudkowsky Singularity Institute for AI

Page 12: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

The scale of intelligent minds:a parochial view.

Village idiot Einstein

A more cosmopolitan view:

Village idiot

Chimp Einstein

Mouse

Eliezer Yudkowsky Singularity Institute for AI

Page 13: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

"Supermen are superthinkers;anything else is a side issue."

-- SF author Robert Heinlein

Eliezer Yudkowsky Singularity Institute for AI

Page 14: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)
Page 15: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

©Marlo Steed

Page 16: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)
Page 17: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Eliezer Yudkowsky Singularity Institute for AI

Page 18: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Eliezer Yudkowsky Singularity Institute for AI

One of these technologies is not like the others...

Artificial Intelligence

Cancer cure

Interplanetary travel

Nanomanufacturing

Page 19: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

"The influence of animal or vegetable life on matter is infinitely beyond the range of any scientific inquiry hitherto entered on. Its power of directing the motions of moving particles, in the demonstrated daily miracle of our human free-will, and in the growth of generation after generation of plants from a single seed, are infinitely different from any possible result of the fortuitous concurrence of atoms... Modern biologists were coming once more to the acceptance of something and that was a vital principle."

-- Lord Kelvin

Eliezer Yudkowsky Singularity Institute for AI

Page 20: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Village idiot

Chimp Einstein

Mouse

Eliezer Yudkowsky Singularity Institute for AI

AI

Page 21: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Eliezer Yudkowsky Singularity Institute for AI

In Every Known Human Culture:

• tool making

• weapons

• grammar

• tickling

• meal times

• mediation of conflicts

• dance, singing

• personal names

• promises

• mourning

(Donald E. Brown, 1991. Human universals. New York: McGraw-Hill.)

Page 22: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

A complex adaptation must be universal within a species.

Eliezer Yudkowsky Singularity Institute for AI

(John Tooby and Leda Cosmides, 1992. The Psychological Foundations of Culture. In The Adapted Mind, eds. Barkow, Cosmides, and Tooby.)

Page 23: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

A complex adaptation must be universal within a species.

If: 6 necessary genes

Each at 10% frequency in population

Then: 1 in 1,000,000 have complete adaptation

Eliezer Yudkowsky Singularity Institute for AI

(John Tooby and Leda Cosmides, 1992. The Psychological Foundations of Culture. In The Adapted Mind, eds. Barkow, Cosmides, and Tooby.)

Page 24: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Incremental evolution of complexity:

1. [A] A is advantageous by itself.

2. [A←B] B depends on A.

3. [A'↔B] A' replaces A, depends on B.

4. [A'B←C] C depends on A' and B

...

Eliezer Yudkowsky Singularity Institute for AI

(John Tooby and Leda Cosmides, 1992. The Psychological Foundations of Culture. In The Adapted Mind, eds. Barkow, Cosmides, and Tooby.)

Page 25: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)
Page 26: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

The Psychic Unity of Humankind

Complex adaptations

must be universal in a species –

including cognitive machinery

in Homo sapiens!

Eliezer Yudkowsky Singularity Institute for AI

(John Tooby and Leda Cosmides, 1992. The Psychological Foundations of Culture. In The Adapted Mind, eds. Barkow, Cosmides, and Tooby.)

Page 27: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Must… not…

emote…

Page 28: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Eliezer Yudkowsky Singularity Institute for AI

The Great Failureof Imagination:

Anthropomorphism

Page 29: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)
Page 30: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Mind Projection Fallacy:

Eliezer Yudkowsky Singularity Institute for AI

If I am ignorant about a phenomenon,

this is a fact about my state of mind,

not a fact about the phenomenon.

(Jaynes, E.T. 2003. Probability Theory: The Logic of Science. Cambridge: Cambridge University Press.)

Page 31: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)
Page 32: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)
Page 33: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Minds-in-general

Eliezer Yudkowsky Singularity Institute for AI

Human minds

Page 34: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Minds-in-general

Eliezer Yudkowsky Singularity Institute for AI

Human minds

Transhuman mindspace

Page 35: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Minds-in-general

Eliezer Yudkowsky Singularity Institute for AI

Human minds

Posthuman mindspace

Transhuman mindspace

Page 36: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Minds-in-general

Eliezer Yudkowsky Singularity Institute for AI

Human minds

Gloopy AIs

Posthuman mindspace

Freepy AIs

Bipping AIs

Transhuman mindspace

Page 37: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Minds-in-general

Eliezer Yudkowsky Singularity Institute for AI

Human minds

Gloopy AIs

Posthuman mindspace

Freepy AIs

Bipping AIs

Transhuman mindspace

YOUARE

HERE

Page 38: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Fallacy of the Giant Cheesecake

• Major premise: A superintelligence could create a mile-high cheesecake.

• Minor premise: Someone will create a recursively self-improving AI.

• Conclusion: The future will be full of giant cheesecakes.

Power does not imply motive.

Eliezer Yudkowsky Singularity Institute for AI

Page 39: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Fallacy of the Giant Cheesecake

• Major premise: A superintelligence could create a mile-high cheesecake.

• Minor premise: Someone will create a recursively self-improving AI.

• Conclusion: The future will be full of giant cheesecakes.

Power does not imply motive.

Eliezer Yudkowsky Singularity Institute for AI

Page 40: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Minds-in-general

Eliezer Yudkowsky Singularity Institute for AI

Human minds

Page 41: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Eliezer Yudkowsky Singularity Institute for AI

Page 42: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Eliezer Yudkowsky Singularity Institute for AI

Minds-in-general

YOUARE

HERE

Page 43: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Minds-in-general

Eliezer Yudkowsky Singularity Institute for AI

YOUARE

HERE

Page 44: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Eliezer Yudkowsky Singularity Institute for AI

Intelligence

Technology

Page 45: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Eliezer Yudkowsky Singularity Institute for AI

IntelligenceIntelligenceTechnologyTechnology

Cognitive TechnologyCloses the Loop:

Page 46: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Eliezer Yudkowsky Singularity Institute for AI

I. J. Good's"Intelligence Explosion":

AIAI

(Good, I. J. 1965. Speculations Concerning the First Ultraintelligent Machine.)

Page 47: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Village idiot

Chimp Einstein

Mouse

Eliezer Yudkowsky Singularity Institute for AI

AI

Page 48: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Eliezer Yudkowsky Singularity Institute for AI

Friendly AI

Page 49: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Eliezer Yudkowsky Singularity Institute for AI

Friendly AI

Page 50: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Summary:

• Intelligence supports all human abilities

• Technology comes from intelligence

• Whatever impacts intelligence lifts the tree by its roots

• >H equals >H mind• Cognitive technology

opens vast new regions of mind design space

• Technology improving intelligence closes the loop - positive feedback!

Eliezer Yudkowsky Singularity Institute for AI

To grasp the future,focus on technologies

that impact upon the mind.

Page 51: Mind Is All That Matters (Eliezer Yudkowsky, Transvision 2007)

Mind Is All That Matters

Eliezer YudkowskySingularity Institute for Artificial Intelligence

singinst.org