Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures:...

35
John Doyle 道陽 Jean-Lou Chameau Professor Control and Dynamical Systems, EE, & BioE tech 1 # Ca Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, planes, docs, fire, bodies, fashion, earthquakes, turbulence, music, buildings, cities, art, running, throwing, Synesthesia, spacecraft, statistical mechanics

Transcript of Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures:...

Page 1: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

John Doyle 道陽 Jean-Lou Chameau Professor

Control and Dynamical Systems, EE, & BioE

tech 1 # Ca

Universal laws and architectures: Theory and lessons from

brains, bugs, nets, grids, planes, docs, fire, bodies, fashion,

earthquakes, turbulence, music, buildings, cities, art, running, throwing, Synesthesia, spacecraft, statistical mechanics

Page 2: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

A minimal prologue

Page 3: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

Diverse applications

Aerospace Robotics Biology Fluids Physics Medicine Internet Smartgrid Ecology Neuroscience

Tuesday

Wednesday

Thursday

Monday

Page 4: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

Diverse applications Diverse mathematics

Aerospace Robotics Biology Fluids Physics Medicine Internet Smartgrid Ecology Neuroscience

ODE/PDE Automata Analysis Optimization Prob&Stats Operator Th Diff Geom Alg Geom Cmp Cplxty

Details are not serious

Page 5: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

CDS

Diverse applications (not just engineering)

Diverse mathematics (not just “applied”)

ODE/PDE Automata Analysis Optimization Prob&Stats Operator Th Diff Geom Alg Geom Cmp Cplxty “Universal

laws and architectures”

Aerospace Robotics Biology Fluids Physics Medicine Internet Smartgrid Ecology Neuroscience

Page 6: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

CDS

Diverse applications

Domain experts have “core”

interface to diverse math and tools

Aerospace Robotics Biology Fluids Physics Medicine Internet Smartgrid Ecology Neuroscience

Page 7: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

CDS

Diverse mathematics

Math (not just applied) has “core” interface to diverse application drivers

ODE/PDE Automata Analysis Optimization Prob&Stats Operator Th Diff Geom Alg Geom Cmp Cplxty

Page 8: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

CDS as architecture • Architecture= “constraints that deconstrain”

– Constraint = CDS core concepts and math – Deconstraint = connections between new applications

and (also possibly new) math

• How to explain this? • Laws: Universal constraints on achievable robust

performance and efficiency • Architectures: Universal organizational strategies

to flexibly achieve what is possible • Case studies: concrete and familiar examples to

illustrate “universals” 8

Page 9: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

Core protocols

• From Architecture slides, understanding the “OS” is difficult and essential

• But term “OS” seems to confuse • Replace with “core protocols”? • Highly conserved/constrained core (knot) • Highly diverse/deconstrained edges

• What is “CDS” in this context? 9

Page 10: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

Fast

Slow

Flexible Inflexible

General Special

Apps

OS

HW

Horizontal App

Transfer

Horizontal Hardware Transfer

Page 11: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

Fast

Slow

Flexible Inflexible

General Special

Apps

OS

HW

Tradeoffs

Page 12: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

Fast

Slow

Flexible Inflexible

General Special

Apps

OS

HW

Tradeoffs = “laws?”

Page 13: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

Slow

Fast

Flexible Inflexible General Special

Apps OS HW Dig. Lump. Distrib.

OS HW Dig. Lump. Distrib.

Digital Lump. Distrib.

Lumped Distrib. Distrib.

HGT DNA repair Mutation DNA replication Transcription

Translation Metabolism

Signal

Sense Motor

Prefrontal

Fast

Reflex

vision

VOR

Layered architectures

Page 14: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

OS

Horizontal App

Transfer

Horizontal Hardware Transfer

Constrained

Deconstrained

Deconstrained

Architecture = Constraints that deconstrain

Page 15: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

Horizontal Transfer

Horizontal Transfer

Constrained

Deconstrained

Deconstrained

“Hourglass” Universal architectures

Page 16: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

Con

stra

ined

Dec

onst

rain

ed

Dec

onst

rain

ed

“Bowtie”

Horizontal versus vertical is an arbitrary convention.

Page 17: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

CDS

Diverse applications (not just engineering)

Diverse mathematics (not just “applied”)

ODE/PDE Automata Analysis Optimization Prob&Stats Operator Th Diff Geom Alg Geom Cmp Cplxty “Universal

laws and architectures”

Aerospace Robotics Biology Fluids Physics Medicine Internet Smartgrid Ecology Neuroscience

Page 18: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

“Pasteur’s quadrant?” (Donald Stokes)

Typically poor choice of colors and font sizes

Page 19: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

“Pasteur’s quadrant?” (Donald Stokes)

Low

High

Edison

Bohr

Practical use

Fundamental Understanding

Low

High Relative emphasis

Use inspired basic research

(Pasteur)

Page 20: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

Low

High

Edison

Pasteur Bohr

Practical use

Fundamental Understanding

Low

High

“Pasteur’s quadrant?” Redrawn

Relative emphasis

Pasteur aimed for

both

Page 21: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

Apps CDS Math

Practical use

Fundamental Understanding

Page 22: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

Later

Deep, Universal

Apps

CDS Math

Practical impact

Specific

Now

CDS’ quadrant?

Scope

Page 23: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

Later

Deep, Universal

Apps

CDS Math

Practical impact

Specific

Now

Fast

Slow

Flexible Inflexible General Special

SW Apps

OS

HW

Related but somewhat flipped

Scope

Page 24: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

Later

Deep, Universal

Apps

Math

Specific

Now

Circa 1975

Modern control theory

Practical impact

Scope

Page 25: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

Later

Deep, Universal

Apps

Math

Specific

Now

Circa 1990 Complexity science

Robust control

theory

Modern control theory

Practical impact

Scope

Page 26: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

Later

Deep, Universal

Apps

Math

Specific

Now

2014

CDS

Complexity science

Network science

Never

Nothing

Practical impact

Scope

Page 27: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

Later

Deep, Universal

Specific

Now

Complexity science

Network science

Never

Nothing

Practical impact

Scope

Humans love this corner!

Page 28: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

CMS

Later

Deep, Universal

Apps

Math

Practical impact

Specific

Now

Near future?

CDS

Complexity science

Network science

Page 29: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

Later

Deep, Universal

Apps

Math

Practical impact

Specific

Now

The dream?

CDS

Complexity science

Network science

Page 30: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

Horizontal Transfer

Horizontal Transfer

Constrained

Deconstrained

Deconstrained

Universal architectures

Universal laws

Fast

Slow

Flexible Inflexible General Special

SW Apps

OS

HW

Page 31: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

Slow

Fast

Flexible Inflexible General Special

Apps OS HW Dig. Lump. Distrib.

OS HW Dig. Lump. Distrib.

Digital Lump. Distrib.

Lumped Distrib. Distrib.

HGT DNA repair Mutation DNA replication Transcription

Translation Metabolism

Signal

Sense Motor

Prefrontal

Fast

Reflex

vision

VOR

Layered architectures

Page 32: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

CDS

Diverse applications

“core” interface to

minimal math and tools

Aerospace Robotics Biology Fluids Physics Medicine Internet Smartgrid Ecology Neuroscience

Morning

Universal laws and

architectures

Undergrad math

Page 33: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

CDS

Diverse mathematics

Networks, Distributed

Cutting edge theory foundations

ODE/PDE Automata Analysis Optimization Prob&Stats Operator Th Diff Geom Alg Geom Cmp Cplxty

Afternoon

Page 34: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

Later

Deep, Universal

Apps

Math

Practical impact

Specific

Now

The dream?

CDS

Complexity science

Network science

Page 35: Universal laws and architecturescds20.caltech.edu/pdf/CDS1.pdf · Universal laws and architectures: Theory and lessons from brains, bugs, nets, grids, ... spacecraft, statistical

Caveats

• Many ideas are classic “robust control”, but much of the organization (the architecture) is fairly new

• Motivating case studies also new

• Many rough edges • Nobody is working on it quite like this • We want to change that