Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical...

113
Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech

Transcript of Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical...

Page 1: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Architecture, networks, and complexity

John Doyle

John G Braun Professor

Control and dynamical systemsBioEngineering, Electrical Engineering

Caltech

Page 2: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

NRC theory report: Bad news and good news

Bad: Attempts to connect with theory• Topology, modularity, information,…Good: Biology motivation• Diversity• Metabolism• Cell interior• Architecture (is not topology)• Robustness• Decision• Behavior

Page 3: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Alternative: Essential ideas• Listening to physicians, biologists, and

engineers

• Robust yet fragile (RYF)• “Constraints that deconstrain” (G&K)• Unity creating diversity

• Network architecture • Layering• Control and dynamics (C&D)• Hourglasses and Bowties

Page 4: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Collaborators and contributors(partial list)

Biology: Csete,Yi, El-Samad, Khammash, Tanaka, Arkin, Savageau, Simon, AfCS, Kurata, Smolke, Gross, Kitano, Hucka, Sauro, Finney, Bolouri, Gillespie, Petzold, F Doyle, Stelling, Caporale,…

Theory: Parrilo, Carlson, Murray, Vinnicombe, Paganini, Mitra Papachristodoulou, Prajna, Goncalves, Fazel, Liu, Lall, D’Andrea, Jadbabaie, Dahleh, Martins, Recht, many more current and former students, …

Web/Internet: Li, Alderson, Chen, Low, Willinger, Kelly, Zhu,Yu, Wang, Chandy, …

Turbulence: Bamieh, Bobba, McKeown, Gharib, Marsden, …Physics: Sandberg, Mabuchi, Doherty, Barahona, Reynolds,Disturbance ecology: Moritz, Carlson,…Finance: Martinez, Primbs, Yamada, Giannelli,…

Current Caltech Former Caltech OtherLongterm Visitor

Page 5: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Thanks to you for inviting me, and

• NSF ITR• AFOSR • NIH/NIGMS • ARO/ICB• DARPA• Lee Center for Advanced Networking (Caltech)• Boeing • Pfizer• Hiroaki Kitano (ERATO)• Braun family

Page 6: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

MultiscalePhysics

SystemsBiology & Medicine

Network Centric,Pervasive,Embedded,Ubiquitous

Core theory

challenges

My interests

Sustainability?

Page 7: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

SystemsBiology & Medicine

Bacterial networks• Necessity in chemotaxis• Design principles in heat shock response• Architecture of metabolism• Origin of high variability and power laws• Architecture of the cell• Control of core metabolism and glycolytic oscillations

SBML/SBWSOSTOOLSWildfire ecologyPhysiology and medicine (new)

Publications: Science, Nature, Cell, PNAS, PLOS, Bioinfo., Trends, IEEE Proc., IET SysBio, FEBS, PRL,…

Page 8: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Wilbur Wright on CWilbur Wright on Control,ontrol, 1901 1901• “We know how to construct airplanes.” (lift and drag)• “Men also know how to build engines.” (propulsion)• “Inability to balance and steer still confronts students of the flying problem.” (control)• “When this one feature has been worked out, the age of flying will have arrived, for all other difficulties are of minor importance.”

Page 9: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Feathers and

flapping? Or lift, drag, propulsion, and control?

Page 10: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Recommendations

• (Obviously…) More and better theory

• Need an “architecture” for research that is as networked as biology and our best technologies

• Create the right “waist” of the research hourglass

• E.g. find the constraints that deconstrain

Page 11: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Robust Yet Fragile

Human complexity

Efficient, flexible metabolism Complex development and Immune systems Regeneration & renewal Complex societies Advanced technologies

Obesity and diabetes Rich microbe ecosystem Inflammation, Auto-Im. Cancer Epidemics, war, … Catastrophic failures

• Evolved mechanisms for robustness allow for, even facilitate, novel, severe fragilities elsewhere

• often involving hijacking/exploiting the same mechanism• There are hard constraints (i.e. theorems with proofs)

Page 12: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

food intake

Glucose

Oxygen

Amino acids

Fatty acids

Organs

Tissues

Cells

Molecules

Universal metabolic system

Blood

Peter Sterling and Allostasis

Page 13: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

VTA

Prefrontalcortex

Accumbensdopamine

Universal reward systemssportsmusicdancecrafts arttoolmaking sexfood

Dopamine,

Ghrelin,

Leptin,…

Page 14: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

VTA

Prefrontalcortex

Accumbensdopamine

Universal reward systemssportsmusicdancecrafts arttoolmaking sexfood

Glucose

Oxygen

Organs

Tissues

Cells

Molecules

Universal metabolic system

Bloodfood

Page 15: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

VTA

Prefrontalcortex

Accumbensdopamine

workfamily communitynature

Universal reward systems

Robust and adaptive, yet …

food sextoolmakingsportsmusicdancecrafts art

Page 16: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

sexfoodtoolmakingsportsmusicdancecrafts art

VTA

Prefrontalcortex

Accumbensdopamine

workfamily communitynature

Page 17: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

workfamily communitynature

sexfoodtoolmakingsportsmusicdancecrafts art

VTA

Prefrontalcortex

Accumbensdopamine

Vicarious

money

saltsugar/fatnicotinealcohol

industrialagriculture

market/consumerculture

Page 18: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

workfamily communitynature

sextoolmakingsportsmusicdancecrafts art

VTA

Prefrontalcortex

Accumbensdopamine

Vicarious

money

saltsugar/fatnicotinealcohol

cocaineamphetamine

Page 19: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Vicarious

money

saltsugar/fatnicotinealcohol

high sodium

obesity

overwork

smoking

alcoholism

drug abuse

hyper-tension

athero-sclerosis

diabetes

inflammation

immunesuppression

coronary,cerebro-vascular,reno-vascular

cancer

cirrhosis

accidents/homicide/suicide

Page 20: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Vicarious

money

saltsugar/fatnicotinealcohol

high sodium

obesity

overwork

smoking

alcoholism

drug abuse

hyper-tension

athero-sclerosis

diabetes

inflammation

immunesuppression

coronary,cerebro-vascular,reno-vascular

cancer

cirrhosis

accidents/homicide/suicide

VTA dopamine

Glucose

Oxygen

Page 21: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Robust Yet Fragile

Human complexity

Efficient, flexible metabolism Complex development and Immune systems Regeneration & renewal Complex societies Advanced technologies

Obesity and diabetes Rich microbe ecosystem Inflammation, Auto-Im. Cancer Epidemics, war, … Catastrophic failures

• Evolved mechanisms for robustness allow for, even facilitate, novel, severe fragilities elsewhere

• often involving hijacking/exploiting the same mechanism• There are hard constraints (i.e. theorems with proofs)

Page 22: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Robust yet fragileSystems can have robustness of

– Some properties to– Some perturbations in – Some components and/or environment

Yet fragile to other properties or perturbations.

Many issues are special cases, e.g.:• Efficiency: robustness to resource scarcity• Scalability: robustness to changes in scale• Evolvability: robustness of lineages on long times

to possibly large perturbations

Page 23: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Case studies

Today (primary):• Cell biology

Today (secondary):• Internet• Toy example: Lego• Wildfire ecology• Physiology• Power grid• Manufacturing• Transportation

Other possibilities:• Turbulence• Statistical mechanics• Physiology (e.g. HR

variability, exercise and fatigue, trauma and intensive care)

• RYF physio (e.g. diabetes, obesity, addiction, …)

• Disasters statistics (earthquakes)

Page 24: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Bio and hi-tech nets

Exhibit extremes of

• Robust Yet Fragile

• Simplicity and complexity

• Unity and diversity

• Evolvable and frozen

• Constrained and deconstrained

What makes this possible and/ or inevitable?

Architecture

Page 25: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

• We use this word all the time.• What do we really mean by it?• What would a theory look like?

Architecture

Page 26: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Robust Yet Fragile

Human complexity

Efficient, flexible metabolism Complex development and Immune systems Regeneration & renewal Complex societies Advanced technologies

Obesity and diabetes Rich microbe ecosystem Inflammation, Auto-Im. Cancer Epidemics, war, … Catastrophic failures

• It is much easier to create the robust features than to prevent the fragilities.

• There are poorly understood “conservation laws” at work

Page 27: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Robust yet fragile

Most essential challenge in technology, society, politics, ecosystems, medicine, etc:

• Managing spiraling complexity/fragility

• Not predicting what is likely or typical

• But understanding what is catastrophic (though perhaps rare)

What community will step up and be central in this challenge?

Page 28: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Components and materials

Systems requirements: functional, efficient,robust, evolvable,

scalable

Robust yet fragile

System and architecture

Perturbations

Perturbations

Page 29: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Component

System-level

Emergent Protocols

Architecture= Constraints

Aim: a universal taxonomy of complex systems and theories

• Describe systems/components in terms of constraints on what is possible

• Decompose constraints into component, system-level, protocols, and emergent

• Not necessarily unique, but hopefully illuminating nonetheless

Contraints that deconstrain

Page 30: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

fan-in of diverse

inputs

fan-out of diverse

outputs

universal carriers

Diversefunction

Diversecomponents

UniversalControl

Universal architectures

• Hourglasses for layering of control

• Bowties for flows within layers

Page 31: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Evolution of theory

• Verbal arguments (stories, cartoons, diagrams)• Data and statistics (plots, tables)• Modeling and simulation (dynamics, numerics)• Analysis (theorems, proofs)• Synthesis (hard limits on the achievable, reverse

engineering good designs, forward engineering new designs)

All levels interact and iterate

Page 32: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Example: Theory of planetary motion

• Verbal (Ptolemy, Copernicus)• Data & stats (Brahe, Galileo, Kepler)• Model & sim (Newton, Einstein)• Analysis (Lagrange, Hamilton,

Poincare)• Synthesis (NASA/JPL)

All levels interact and iterate

Page 33: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Drill down

• Describe theory• Show some math• Just to give a flavor• You can ignore details• Always return to verbal

descriptions and hand-waving summaries

Verbal

Data/stat

Mod/sim

Analysis

Synthesis

Page 34: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Synthesis theories: Limits and tradeoffs

On systems and their components

• Thermodynamics (Carnot)

• Communications (Shannon)

• Control (Bode)

• Computation (Turing/Gödel)

Assume different architectures a priori.

No networks

Page 35: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Hard limits and tradeoffs

On systems and their components• Thermodynamics (Carnot)• Communications (Shannon)• Control (Bode) • Computation (Turing/Gödel)

• Fragmented and incompatible• Cannot be used as a basis for

comparing architectures• New unifications are encouraging

No dynamics or feedback

Page 36: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Hard limits and tradeoffs

On systems and their components• Thermodynamics (Carnot)• Communications (Shannon)• Control (Bode) • Computation (Turing/Gödel)

• Include dynamics and feedback• Extend to networks• New unifications are encouraging

Robust/fragile

is unifyingconcept

Page 37: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Why glycolytic oscillations?

• Various answers depend on meaning of “why”• Will go deeper into “why” using stages…• Start with simplest possible models• Motivate generalizable and scalable methods• Extremely familiar and “done” problem in biology

and dynamics at the small circuit level• Convenient to introduce new theory and thinking

using the most familiar possible examples

Page 38: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Basics of glyc-oscillations

• Verbal arguments (stories, cartoons, diagrams)• Data and statistics (plots, tables)

Result: Cells and extracts show oscillatory behavior.

Why?

Page 39: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Why? Modeling and simulation

• Verbal arguments (stories, cartoons, diagrams)• Data and statistics (plots, tables)• Modeling and simulation (dynamics, numerics)

• Why = propose mechanism, model, simulate, compare with data

• Has been done extensively for this problem• What’s new? Simplicity and robustness

Page 40: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

1 1

q

h

q Vx

x

1

1 y

qk y

y

x

Control

1

0 xk x Autocatalytic

reaction reactionmetabolite

consumption

1 1

1 1 01

q

y xh

x q qVxk y k x

y x

Page 41: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Catabolism

Pre

curs

ors

Carriers

Co-factors

Fatty acids

Sugars

NucleotidesAmino Acids

Core metabolism

Page 42: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Catabolism

Pre

curs

ors

Carriers

Page 43: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Catabolism

TCAPyr

Oxa

Cit

ACA

Gly

G1P

G6P

F6P

F1-6BP

PEP

Gly3p

13BPG

3PG

2PG

ATP

NADH

Page 44: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

TCAPyr

Oxa

Cit

ACA

Gly

G1P

G6P

F6P

F1-6BP

PEP

Gly3p

13BPG

3PG

2PG

Pre

curs

ors

Page 45: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

TCAPyr

Oxa

Cit

ACA

Gly

G1P

G6P

F6P

F1-6BP

PEP

Gly3p

13BPG

3PG

2PG

ATP

Autocatalytic

NADH

Pre

curs

ors

Carriers

Page 46: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

TCA

Gly

G1P

G6P

F6P

F1-6BP

PEP Pyr

Gly3p

13BPG

3PG

2PG

ATP

NADH

Oxa

Cit

ACA

Regulatory

Page 47: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

TCAPyr

Oxa

Cit

ACA

Gly

G1P

G6P

F6P

F1-6BP

PEP

Gly3p

13BPG

3PG

2PG

Page 48: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

TCA

Gly

G1P

G6P

F6P

F1-6BP

PEP Pyr

Gly3p

13BPG

3PG

2PG

ATP

NADH

Oxa

Cit

ACA

If we drew the feedback loops the diagram would be unreadable.

Page 49: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

( )

Mass &Reaction

Energyflux

Balance

dxSv x

dt

Stoichiometry or mass and energy balance

Nutrients Products

Internal

Biology is not a graph.

Page 50: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

( )

Mass &Reaction

Mass&Energy Energyflux

Balance

dxSv x

dt

d

dt

Stoichiometry plus regulation

Matrix of integers “Simple,” can be

known exactly Amenable to high

throughput assays and manipulation

Bowtie architecture

Vector of (complex?) functions Difficult to determine and

manipulate Effected by stochastics and

spatial/mechanical structure Hourglass architecture Can be modeled by optimal

controller (?!?)

Page 51: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

TCA

Gly

G1P

G6P

F6P

F1-6BP

PEP Pyr

Gly3p

13BPG

3PG

2PG

ATP

NADH

Oxa

Cit

ACA

( )

Mass &Reaction

Energyflux

Balance

dxSv x

dt

Stoichiometry matrix

S

Page 52: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Regulation of enzyme levels by transcription/translation/degradation

TCA

Gly

G1P

G6P

F6P

F1-6BP

PEP Pyr

Gly3p

13BPG

3PG

2PG

Oxa

Cit

ACA

( )

Mass &Reaction

Energyflux

Balance

dxSv x

dt

Page 53: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

TCA

Gly

G1P

G6P

F6P

F1-6BP

PEP Pyr

Gly3p

13BPG

3PG

2PG

ATP

NADH

Oxa

Cit

ACA

( )

Mass &Reaction

Energyflux

Balance

dxSv x

dt

Allosteric regulation of enzymes

Page 54: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

TCA

Gly

G1P

G6P

F6P

F1-6BP

PEP Pyr

Gly3p

13BPG

3PG

2PG

ATP

NADH

Oxa

Cit

ACA

Mass &Reaction

( ) Energyflux

Balance

dxSv x

dt

Allosteric regulation of enzymes

Regulation of enzyme levels

Page 55: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

TCA

Gly

G1P

G6P

F6P

F1-6BP

PEP Pyr

Gly3p

13BPG

3PG

2PG

ATP

NADH

Oxa

Cit

ACA

Allosteric regulation of enzymes

Regulation of enzyme levels

Fast response

Slow

Page 56: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

TCA

Gly

G1P

G6P

F6P

F1-6BP

PEP Pyr

Gly3p

13BPG

3PG

2PG

ATP

NADH

Oxa

Cit

ACA

Page 57: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

F6P

F1-6BP

Gly3p

13BPG

3PG

ATP

1 1

q

h

q Vx

x

1

1 y

qk y

1

0 xk x

y

x

Control

Autocatalytic

Page 58: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

F6P

F1-6BP

Gly3p

13BPG

3PG

ATP

1 1

q

h

q Vx

x

1

1 y

qk y

1

0 xk x

y

x

Control

Autocatalytic

Page 59: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

F6P

F1-6BPGly3p

13BPG

3PG

ATP

1 1

q

h

q Vx

x

1

1 y

qk y

1

0 xk x

y

x

Control

Autocatalytic

Page 60: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

1

0 xk x

1 1

q

h

q Vx

x

1

1 y

qk y

y

x

Control

Autocatalytic

1 1

1 1 01 y x

q

h

x q qVxk y k x

y x

Autocatalytic

Page 61: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

1

0 xk x

1 1

q

h

q Vx

x

1

1 y

qk y

y

x

Control

11 1

1 1 0

q

h

y

x

Vx

xx q q

k yy

k x

Autocatalytic

( )

Mass &Reaction

Energyflux

Balance

dxSv x

dt

1 1

1 1 01

q

y xh

x q qVxk y k x

y x

Page 62: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

1

0 xk x

1 1

q

h

q Vx

x

1

1 y

qk y

y

x

1 1

1 1 01 1

q

h

x q qVxky x

y V x

WOLOG normalize concentration and time

1 1

1 1 01 y x

q

h

x q qVxk y k x

y x

Page 63: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

1

0 xk x

1 1

q

h

q Vx

x

1

1 y

qk y

y

x

1 1

1 1 01 1

q

h

x q qVxky x

y V x

Linearization:

1 1

1 1 0

11

x q qx ky x

y

q hV

st

nd

NominalVariable Process

Value?

autocatalysis 1

inhibition 2.5

1 enzyme 3

2 enzyme .3

q

h

V

k

Page 64: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

0 1

0 1

x

y

Steady state: 1x

time10 15 20

-1

-0.5

0

0.5

1x error

Linearization:

1 1

1 1 0

11

x q qx ky x

y

q hV

st

nd

NominalVariable Process

Value?

autocatalysis 1

inhibition 2.5

1 enzyme 3

2 enzyme .3

q

h

V

k

Page 65: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

x error

time0 5 10 15 20

-1

-0.5

0

0.5

1

V=3

V=10

V=1.1

Linearization:

1 1

1 1 0

11

x q qx ky x

y

q hV

st

nd

NominalVariable Process

Value?

autocatalysis 1

inhibition 2.5

1 enzyme 3

2 enzyme .3

q

h

V

k

Page 66: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Why? Modeling and simulation

• Why = propose mechanism, model, simulate, compare with data

• Scalable to larger systems? Yes• Nonlinear? Yes• Explore parameter space? Awkward• Explore sets of uncertain models? Awkward

Page 67: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Why: Analysis

• Verbal arguments (stories, cartoons, diagrams)• Data and statistics (plots, tables)• Modeling and simulation (dynamics, numerics)• Analysis (theorems, proofs)

• Why = parameter regimes of instability, global results with nonlinearities

Page 68: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Linearization:

1 1

1 1 0

11

x q qx ky x

y

q hV

st

nd

NominalVariable Process

Value?

autocatalysis 1

inhibition 2.5

1 enzyme 3

2 enzyme .3

q

h

V

k

Stable iff

11

1 11 1

k

q

kq h q

V q

• Explicit regions of (in)stability• Easy to compare with experiments• Oscillations caused by

• nonzero q (autocatalytic)• small k (low enzyme)• large V (high flux)• large h (strong inhibition)

• Slow response caused by• large q (autocatalytic)• small V (low flux)• small h (weak inhibition)

oscillationsslow

Page 69: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Linearization:

1 1

1 1 0

11

x q qx ky x

y

q hV

st

nd

NominalVariable Process

Value?

autocatalysis 1

inhibition 2.5

1 enzyme 3

2 enzyme .3

q

h

V

k

Stable iff

11

1 11 1

k

q

kq h q

V q

.1 6k V 1 1

1k

h qV q

0 5 10 15 20-1

-0.5

0

0.5

1

oscillations

Page 70: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Stable iff

11

1 11 1

k

q

kq h q

V q

.1 6k V 1 1

1k

h qV q

0 5 10 15 20-1

-0.5

0

0.5

1

0 10 20 30 40 50 600

0.5

1

1.5Nonlinear

Page 71: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Linearization:

1 1

1 1 0

11

x q qx ky x

y

q hV

st

nd

NominalVariable Process

Value?

autocatalysis 1

inhibition 2.5

1 enzyme 3

2 enzyme .3

q

h

V

k

Stable iff

11

1 11 1

k

q

kq h q

V q

11 1q h

V 0 5 10 15 20

-1

-0.5

0

0.5

1

1.1V

.1h

Page 72: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Linearization:

1 1

1 1 0

11

x q qx ky x

y

q hV

st

nd

NominalVariable Process

Value?

autocatalysis 1

inhibition 2.5

1 enzyme 3

2 enzyme .3

q

h

V

k

0 5 10 15 20-1

-0.5

0

0.5

1

1h

3.3h

Conservation law?

Page 73: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Analysis issues

• Why = parameter regimes of instability, global results with nonlinearities

• Scalable to larger systems? Less than sim• Nonlinear? Yes• Explore parameter space? Better than sim• Explore sets of uncertain models? Better than sim• Prove what models can’t do? Yes

• Major research frontier

Page 74: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Why: Synthesis

• Are there intrinsic tradeoffs or is this a “frozen accident”? (The former.)

• What are the relevant engineering principles? • How to separate necessity from accident? • Are there hard limits or conservation laws that

apply? (Yes)• Is biology near these limits? (Apparently)• Why does autocatalysis and other efficiency issues

aggravate regulation? (Stay tuned)

Page 75: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

0 5 10 15 20-1

-0.5

0

0.5

1

1h

3.3h

x

time

)

Fourier

Transform

of error

h hS x = F(

ln lnh nomS S

Spectrum

freq

3.3h

1h 0 1 2 3 4 5

-2

-1

0

1

2

3

Page 76: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

0 5 10 15 20-1

-0.5

0

0.5

1

1h

3.3h

x

time

ln

ln

h

nom

S

S

freq

3.3h

1h 0 1 2 3 4 5

-2

-1

0

1

2

3

0

1ln

10

S j d

Vh

V

Theorem:

Page 77: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

x

time

ln

ln

h

nom

S

S

freq

0

1ln

10

S j d

Vh

V

Theorem:

5V 1k

0 5 10 15 20-1

-0.5

0

0.5

1

0 1 2 3 4 5-2

-1

0

1

2

3

.3k .1k

Page 78: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Why: Synthesis

• There are too many hard limits on achievable performance to show in one hour…

• Most are aggravated by – large q (more autocatalysis)

– small V and k (less enzyme)

• Thus tradeoffs between control response and efficiency

• Can summarize with hand-waving argument.• Why = it’s an inevitable consequence of

engineering tradoffs.

Page 79: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

1

0 xk x

1 1

q

h

q Vx

x

1

1 y

qk y

y

x

1 1

1 1 01 1

q

h

x q qVxky x

y V x

Page 80: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Why: Synthesis (to do)

• There are hard contraints and tradeoffs• Biology is hard up against these limits• Yet there remains “design freedom”• Why these particular “choices”?

• What has evolution optimized?

• Robustness (and evolvability)?

Page 81: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

0 5 10 15 200.8

0.85

0.9

0.95

1

1.05

Time (minutes)

[AT

P]

h = 3

h = 0

0 2 4 6 8 10-0.8

-0.6

-0.4

-0.2

0

0.2

0.4

0.6

0.8

Frequency

Lo

g(S

n/S

0)

h = 3

h = 0

Spectrum

Time response

Robust

Yet fragile

Page 82: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

0 2 4 6 8 10-0.8

-0.6

-0.4

-0.2

0

0.2

0.4

0.6

0.8

Frequency

Lo

g(S

n/S

0)

h = 3

h = 0 Robust

Yet fragile

Page 83: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

0 2 4 6 8 10-0.8

-0.6

-0.4

-0.2

0

0.2

0.4

0.6

0.8

Frequency

Lo

g(S

n/S

0)

h = 0 Robust

Yet fragile

log ) ?nx d constant F(

Page 84: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

0 2 4 6 8 10-0.8

-0.6

-0.4

-0.2

0

0.2

0.4

0.6

0.8

Frequency

Lo

g(S

n/S

0)

h = 3

h = 2

h = 1

h = 0

log )nxF(

Tighter steady-stateregulation

Transients, Oscillations

log )nx d constant F(

Theorem

Page 85: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

log )nx d constant F(

log|S |

Tighter regulation

Transients, Oscillations

Biological complexity is dominated by the evolution of

mechanisms to more finely tune this robustness/fragility tradeoff.

This tradeoff is a law.

Page 86: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

log S d

log S d

benefits costs

log S d

log S d

• benefits = attenuation of disturbance• goal: make this as negative as possible

cost = amplificationgoal: make this small

Constraint:

Page 87: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

-e=d-u

Control

uPlant

d

delay

u

log 0S d

Bode

ES

D

• What helps or hurts this tradeoff?• Helps: advanced warning, remote sensing• Hurts: instability, remote control

Page 88: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

-e=d-u

Control

uPlant

d

delay

u

log S dL

/ L

ES

D

L

Freudenberg and Looze, 1984

Page 89: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

a

-e=d-u

Control

uPlant

d

delay

u

log S d

Bode

a

ES

D

log S d

benefits costs stabilize

Page 90: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

a

-e=d-u

Control

uPlant

d

delay

u

log S d

Bode

a

ES

D

log S d

benefits costs stabilize

Negative is good

Page 91: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Disturbance-e=d-u

ControlSensor

ChannelEncode

PlantRemoteSensor

dd

r

ControlChannel SC

u

CC

log S d

log S d

SC

CClog( )a

http://www.glue.umd.edu/~nmartins/

Nuno C Martins and Munther A Dahleh, Feedback Control in the Presence of Noisy Channels: “Bode-Like” Fundamental Limitations of Performance.Nuno C. Martins, Munther A. Dahleh and John C. Doyle Fundamental Limitations of Disturbance Attenuation in the Presence of Side Information(Both in IEEE Transactions on Automatic Control)

Page 92: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Variety of producers

Electric powernetwork

Variety ofconsumers

• Good designs transform/manipulate energy• Subject to hard limits

Page 93: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Variety ofconsumers

Variety of producers

Energy carriers

• 110 V, 60 Hz AC• (230V, 50 Hz AC)• Gasoline• ATP, glucose, etc• Proton motive force

Standard interface

Constraint that deconstrains

Page 94: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

• Good designs transform/manipulate robustness• Subject to hard limits• Unifies theorems of Shannon and Bode (1940s)• Claim: This is the most crucial (known) limit

against which network complexity must cope

Disturbance-e=d-u

ControlSensor

ChannelEncode

PlantRemoteSensor

dd

r

ControlChannel

log S d

log S d

benefits

feedback

SC

CCstabilizeremotesensing

remote control

log( )a

costs

Robust

log( )a

Fragile

Page 95: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

a

-e=d-u

Control

uPlant

d

delay

u

log S d

Bode

a

ES

D

log S d

benefits costs stabilize

log S d a

Page 96: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

a

-e=d-u

Control

uPlant

d

delay

u

log S d

Bode

log S d

benefits costs stabilize

Negative is good

a

ES

D

log S d a

Page 97: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

log( )alog S d

log S d

benefits costs

Robust

log( )a Yet fragile

Bode’s integral formula

Page 98: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

log( )alog S d

log( )a

log S d

benefits costs

Disturbance-e=d-u

Control

u

Plant

d delayd

delay

u

Cost of control

Cost of stabilization

Page 99: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

-e=d-u

Control

Plant ControlChannel

u

CC Cost of remote control

log( )alog S d

log S d

benefits costs

log( )alog S d

CC

Page 100: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Disturbance-e=d-u

Control

Plant

dd

ControlChannel

u

CC

log S d

log S d

benefits

feedback

CCstabilize remote control

log( )a

costs

Page 101: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Disturbance-e=d-u

ControlSensor

ChannelEncode

PlantRemoteSensor

dd

r

ControlChannel

SC

u

CC

log S d

log S d

benefits

feedback

SC

CCstabilize

remotesensing

remote control

log( )a

costs

Page 102: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Benefit of remote sensing

log( )alog S d

log S d

benefits costs

C

log( )alog S d

CC

Disturbance-e=d-u

ControlSensor

ChannelEncode

PlantRemoteSensor

dd

r

ControlChannel

SC

u

CC

Page 103: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Disturbance-e=d-u

ControlSensor

ChannelEncode

PlantRemoteSensor

dd

r

ControlChannel

SC

u

CC

log S d

log S d

benefits

feedback

SC

CCstabilize

remotesensing

remote control

log( )a

costs

Page 104: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Disturbance-e=d-u

ControlSensor

ChannelEncode

PlantRemoteSensor

dd

r

ControlChannel SC

u

CC

Bode/Shannon is likely a better p-to-p comms theory to serve as a foundation for networks than either Bode or Shannon alone.

log S d

log S d

SC

CClog( )a

Page 105: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Variety of producers

Electric powernetwork

Variety ofconsumers

• Good designs transform/manipulate energy• Subject to hard limits

Page 106: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

• Good designs transform/manipulate robustness• Subject to hard limits• Unifies theorems of Shannon and Bode (1940s)• Claim: This is the most crucial (known) limit

against which network complexity must cope

Disturbance-e=d-u

ControlSensor

ChannelEncode

PlantRemoteSensor

dd

r

ControlChannel

log S d

log S d

benefits

feedback

SC

CCstabilizeremotesensing

remote control

log( )a

costs

Robust

log( )a

Fragile

Page 107: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

[a system] can have[a property] robust for [a set of perturbations]

Yet be fragile for

Or [a different perturbation]

[a different property]Robust

Fragile

Page 108: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

[a system] can have[a property] robust for [a set of perturbations]

Robust

Fragile

• But if robustness/fragility are conserved, what does it mean for a system to be robust or fragile?

• Some fragilities are inevitable in robust complex systems.

Page 109: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

• But if robustness/fragility are conserved, what does it mean for a system to be robust or fragile?

Robust

Fragile

• Robust systems systematically manage this tradeoff.• Fragile systems waste robustness.

• Some fragilities are inevitable in robust complex systems.

Emergent

Page 110: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Variety of producers

Electric powernetwork

Variety ofconsumers

• Good designs transform/manipulate energy• Subject (and close) to hard limits

Page 111: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

• Robust designs transform/manipulate robustness• Subject (and close) to hard limits• Fragile designs are far away from hard limits and

waste robustness.

Disturbance-e=d-u

ControlSensor

ChannelEncode

PlantRemoteSensor

dControlChannel

log S d

log S d

SC

CClog( )a

Robust

log( )a

FragileControl

ControlChannel

Page 112: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Cat

abol

ism

Genes

Co-factorsFatty acidsSugars

Nucleotides

Amino Acids Proteins

Pre

curs

ors

DNA replication

Trans*

Carriers

Components and materials:Energy, moieties

Systems requirements: functional, efficient,

robust, evolvable

Hard constraints:Thermo (Carnot)Info (Shannon)Control (Bode)Compute (Turing)

Protocols

Constraints

Diverse

Diverse

UniversalControl

Page 113: Architecture, networks, and complexity John Doyle John G Braun Professor Control and dynamical systems BioEngineering, Electrical Engineering Caltech.

Questions?

End of part 1