Whole Brain Emulation, as a platform for creating safe AGI

90
Whole Brain Emulation, as a platform for creating safe AGI Anna Salamon and Carl Shulman

description

Whole Brain Emulation, as a platform for creating safe AGI. Anna Salamon and Carl Shulman. Outline. Background AGI volatility Why risky WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?. Outline. Background AGI volatility - PowerPoint PPT Presentation

Transcript of Whole Brain Emulation, as a platform for creating safe AGI

Page 1: Whole Brain Emulation, as a platform for creating safe AGI

Whole Brain Emulation, as a platform for creating safe AGI

Anna Salamon and Carl Shulman

Page 2: Whole Brain Emulation, as a platform for creating safe AGI

Outline Background

AGI volatility Why risky

WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?

Page 3: Whole Brain Emulation, as a platform for creating safe AGI

Outline Background

AGI volatility Why risky

WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?

Page 4: Whole Brain Emulation, as a platform for creating safe AGI

Outline Background

AGI volatility Why risky

WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?

Page 5: Whole Brain Emulation, as a platform for creating safe AGI

Outline Background

AGI volatility Why risky

WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?

Page 6: Whole Brain Emulation, as a platform for creating safe AGI

Outline Background

AGI volatility Why risky

WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?

Page 7: Whole Brain Emulation, as a platform for creating safe AGI

Outline Background

AGI volatility Why risky

WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?

Page 8: Whole Brain Emulation, as a platform for creating safe AGI

Outline Background

AGI volatility Why risky

WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?

Page 9: Whole Brain Emulation, as a platform for creating safe AGI

Outline Background

AGI volatility Why risky

WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?

Page 10: Whole Brain Emulation, as a platform for creating safe AGI

AGI: More change, faster

Page 11: Whole Brain Emulation, as a platform for creating safe AGI

AGIs can be copied

Page 12: Whole Brain Emulation, as a platform for creating safe AGI

AGIs can be copied

Page 13: Whole Brain Emulation, as a platform for creating safe AGI

Serial speedup

Page 14: Whole Brain Emulation, as a platform for creating safe AGI

Serial speedup

Page 15: Whole Brain Emulation, as a platform for creating safe AGI

Solving coordination problems

Page 16: Whole Brain Emulation, as a platform for creating safe AGI

Recursive self-improvement

Page 17: Whole Brain Emulation, as a platform for creating safe AGI

Recursive self-improvement

Page 18: Whole Brain Emulation, as a platform for creating safe AGI

Recursive self-improvement

Page 19: Whole Brain Emulation, as a platform for creating safe AGI
Page 20: Whole Brain Emulation, as a platform for creating safe AGI

Outline Background

AGI volatility Why risky

WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?

Page 21: Whole Brain Emulation, as a platform for creating safe AGI

Outline Background

AGI volatility Why risky

WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?

Page 22: Whole Brain Emulation, as a platform for creating safe AGI

Intelligence + Goals= Change

Page 23: Whole Brain Emulation, as a platform for creating safe AGI

More intelligence → More change

Page 24: Whole Brain Emulation, as a platform for creating safe AGI

More intelligence → more change

Page 25: Whole Brain Emulation, as a platform for creating safe AGI

Most ways of rearranging our world would kill us

Page 26: Whole Brain Emulation, as a platform for creating safe AGI

Values vary starkly

Page 27: Whole Brain Emulation, as a platform for creating safe AGI

Arbitrary, rewirable receptors

Page 28: Whole Brain Emulation, as a platform for creating safe AGI

Threading the needle

Page 29: Whole Brain Emulation, as a platform for creating safe AGI

Outline Background

AGI volatility Why risky

WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?

Page 30: Whole Brain Emulation, as a platform for creating safe AGI

Outline Background

AGI volatility Why risky

WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?

Page 31: Whole Brain Emulation, as a platform for creating safe AGI

Copying specific individuals

Page 32: Whole Brain Emulation, as a platform for creating safe AGI
Page 33: Whole Brain Emulation, as a platform for creating safe AGI

WBEs share our values

Page 34: Whole Brain Emulation, as a platform for creating safe AGI

WBEs share our values

Page 35: Whole Brain Emulation, as a platform for creating safe AGI

Outline Background

AGI volatility Why risky

WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?

Page 36: Whole Brain Emulation, as a platform for creating safe AGI

Outline Background

AGI volatility Why risky

WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?

Page 37: Whole Brain Emulation, as a platform for creating safe AGI

WBEs can also make AGIs. Faster.

Page 38: Whole Brain Emulation, as a platform for creating safe AGI

Eventually

WBEs

AGIstable

cessation of research

Page 39: Whole Brain Emulation, as a platform for creating safe AGI

WBEs can't rapidly self-improve

Page 40: Whole Brain Emulation, as a platform for creating safe AGI

But can try variations

Page 41: Whole Brain Emulation, as a platform for creating safe AGI

Copy what works

Page 42: Whole Brain Emulation, as a platform for creating safe AGI

Save states can improve work skills

SaveRestore

Page 43: Whole Brain Emulation, as a platform for creating safe AGI

... and stabilize goals

SaveRestore

Page 44: Whole Brain Emulation, as a platform for creating safe AGI

Single “upload clans” could take over

Page 45: Whole Brain Emulation, as a platform for creating safe AGI

Single “upload clans” could take over

Page 46: Whole Brain Emulation, as a platform for creating safe AGI

... or invent powerful AI

Page 47: Whole Brain Emulation, as a platform for creating safe AGI

... or invent powerful AI

Page 48: Whole Brain Emulation, as a platform for creating safe AGI

Values also lost through competition

See Nick Bostrom's "The Future of Human Evolution," http://www.nickbostrom.com/fut/evolution.html

Page 49: Whole Brain Emulation, as a platform for creating safe AGI

Fun

Happiness

Humangenes

Love

Play

Jobskills

Values also lost through competition

Page 50: Whole Brain Emulation, as a platform for creating safe AGI

business as usual

human extinction

stable totalitarianism

controlled intelligence explosion

uncontrolled intelligence explosion

Page 51: Whole Brain Emulation, as a platform for creating safe AGI

business as usual

human extinction

stable totalitarianism

controlled intelligence explosion

uncontrolled intelligence explosion

WBEs

Page 52: Whole Brain Emulation, as a platform for creating safe AGI

So: is our shot better or worse with WBE?

Page 53: Whole Brain Emulation, as a platform for creating safe AGI

Outline Background

AGI volatility Why risky

WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?

Page 54: Whole Brain Emulation, as a platform for creating safe AGI

Outline Background

AGI volatility Why risky

WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?

Page 55: Whole Brain Emulation, as a platform for creating safe AGI

WBE can ease coordination

Page 56: Whole Brain Emulation, as a platform for creating safe AGI

Races incentivize risk-taking

Page 57: Whole Brain Emulation, as a platform for creating safe AGI

Safety infrastructure could be designed ahead of time

Page 58: Whole Brain Emulation, as a platform for creating safe AGI

Arms races and time for precautions

1940 1950 1960 1970

Year of first nuclear testUS

1945USSR1949

UK1952

France1960

PRC1964

Page 59: Whole Brain Emulation, as a platform for creating safe AGI

Forever in a day

1940 1950 1960 1970

USSR1949

UK1952

France1960

PRC1964

July 16,1945

July 17,1945

July 18,1945

July 19,1945

Page 60: Whole Brain Emulation, as a platform for creating safe AGI

WBE as platform for further tech development

Page 61: Whole Brain Emulation, as a platform for creating safe AGI

The possibility of a highly-controlled structure

Page 62: Whole Brain Emulation, as a platform for creating safe AGI

Carefully chosen, tested components

Page 63: Whole Brain Emulation, as a platform for creating safe AGI

Safety infrastructure could be designed ahead of time

Page 64: Whole Brain Emulation, as a platform for creating safe AGI

... and stabilize goals

SaveRestore

Page 65: Whole Brain Emulation, as a platform for creating safe AGI

Moral objections?

Page 66: Whole Brain Emulation, as a platform for creating safe AGI

Even without “WBE systems”, advantages to WBEs

Page 67: Whole Brain Emulation, as a platform for creating safe AGI

Reduced coordination problems

Page 68: Whole Brain Emulation, as a platform for creating safe AGI

Taking the long view

Page 69: Whole Brain Emulation, as a platform for creating safe AGI

Existence proof

?

Page 70: Whole Brain Emulation, as a platform for creating safe AGI

WBE can ease the technical challenge

Page 71: Whole Brain Emulation, as a platform for creating safe AGI

Subjectively slower computers

Page 72: Whole Brain Emulation, as a platform for creating safe AGI

Moore's Law of Mad Science"Every eighteen months, the IQ required to destroy the world drops by one point." —Eliezer Yudkowsky

Page 73: Whole Brain Emulation, as a platform for creating safe AGI

WBE safety monitors: as fast and numerous as AIs

Page 74: Whole Brain Emulation, as a platform for creating safe AGI

WBE safety monitors: as fast and numerous as AIs

Page 75: Whole Brain Emulation, as a platform for creating safe AGI

Cognitive enhancement for WBEs

Page 76: Whole Brain Emulation, as a platform for creating safe AGI

But modified WBE can become inhuman fast

Page 77: Whole Brain Emulation, as a platform for creating safe AGI

Outline Background

AGI volatility Why risky

WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?

Page 78: Whole Brain Emulation, as a platform for creating safe AGI

Outline Background

AGI volatility Why risky

WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?

Page 79: Whole Brain Emulation, as a platform for creating safe AGI

Can we make WBE come first?

Page 80: Whole Brain Emulation, as a platform for creating safe AGI

Inputs to WBE

Hardware Brain imaging Computational neuroscience

Page 81: Whole Brain Emulation, as a platform for creating safe AGI

Hard to budge Moore's law And if we succeed, we accelerate AGI, too

Page 82: Whole Brain Emulation, as a platform for creating safe AGI

Could automate brain imaging

Page 83: Whole Brain Emulation, as a platform for creating safe AGI

Neuroscience models most likely bottleneck

Hardware Brain imaging Computational neuroscience

Page 84: Whole Brain Emulation, as a platform for creating safe AGI

But same inputs also speed up brain-like AI

Hardware Brain imaging Computational neuroscience

Page 85: Whole Brain Emulation, as a platform for creating safe AGI

How much boost each way?

?

Page 86: Whole Brain Emulation, as a platform for creating safe AGI

WBE from partially controlled AI

Page 87: Whole Brain Emulation, as a platform for creating safe AGI

So, what shall we do?

Page 88: Whole Brain Emulation, as a platform for creating safe AGI

business as usual

human extinction

stable totalitarianism

controlled intelligence explosion

uncontrolled intelligence explosion

Page 89: Whole Brain Emulation, as a platform for creating safe AGI

business as usual

human extinction

stable totalitarianism

controlled intelligence explosion

uncontrolled intelligence explosion

WBEs

Page 90: Whole Brain Emulation, as a platform for creating safe AGI

Thank you

[email protected]@singinst.org