Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler...

60
Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico, USA Università di Roma “La Sapienza” 18-21 October 2010 Slides pulled from presentations posted at: http:// www.sandia.gov/nisac/amti.html http://www.sandia.gov/casos

Transcript of Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler...

Page 1: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering

Robert Glass and Walt Beyeler

Sandia National Laboratories, Albuquerque, New Mexico, USA

Università di Roma “La Sapienza”18-21 October 2010

Slides pulled from presentations posted at:http://www.sandia.gov/nisac/amti.html http://www.sandia.gov/casos

Page 2: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Course Outline

Day 1: Overview (Bob) CASoS and CASoS Engineering Complexity primer (SOC, HOT, Networks) Conceptual lens and application to simple infrastructure

examples (power grids, payment systems, congestive failure) and other ongoing investigations

Day 2: Payment systems (Walt)

Day 3: Infectious diseases (Bob)

Day 4: Applying the process (Walt) Demonstration problem, get Repast and Vensim

Page 3: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Homework

Peruse CASoS web site: www.sandia.gov/casos/ , find errors, give comments to “webmaster” or to Bob and WaltLook at readings in Our course of study within “Defining Research and Development Directions for Modeling and Simulation of Complex, Interdependent Adaptive Infrastructures” on CASoS web siteFind links to other material on the web (presentations, groups doing similar work, papers, etc.) and send them to the group; we will make a compilationDefining examples: look at those on the website, write one for a system of interest to youDay 2 and Day 3 readings Repast and Vensim: down load and make sure that they run by Day 2: http://repast.sourceforge.net/ http://www.vensim.com/

Independent project that extends or applies the concepts presented in the lectures (e.g., the day 4 demonstration problem)

Page 4: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Reading for Payment Systems

The Topology of Interbank Payment Flows, Kimmo Soramaki, Morten L. Bech, Jeffrey Arnold, Robert J. Glass, Walter E. Beyeler, Physica A: Statistical Mechanics and Its Applications, June 2007; vol.379, no.1, p.317-33.(also available from Elsevier B.V. /Physica A) (SAND2006-4136 J) Congestion and cascades in payment systems, Walter E. Beyeler, Robert J. Glass, Morten Bech and Kimmo Soramäki, Physica A, 15 Oct. 2007; v.384, no.2, p.693-718, accepted May 2007 (also available from Elsevier B.V. /Physica A) (SAND2007-7271)Congestion and Cascades in Interdependent Payment Systems, Fabian Renault, Walter E. Beyeler, Robert J. Glass, Kimmo Soramaki, and Morten L. Bech, , March 2009 (SAND 2009-2175J)

Page 5: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Reading for Infectious Diseases

Targeted Social Distancing Design for Pandemic Influenza, Robert J. Glass, Laura M. Glass, Walter E. Beyeler, H. Jason Min, CDC Journal, Emerging Infectious Diseases, Vol 12, #14, November 2006 (SAND2006-6728 C) Rescinding Community Mitigation Strategies in an Influenza Pandemic, Victoria J. Davey, Robert J. Glass, Emerging Infectious Diseases, Volume 14, Number 3, March 2008. (SAND2007-4635 J)Robust Design of Community Mitigation for Pandemic Influenza: A Systematic Examination of Proposed U.S. Guidance, Robert J. Glass, Victoria J. Davey, H. Jason Min, Walter E. Beyeler, Laura M. Glass, PLoS ONE 3(7): e2606 doi:10.1371/journal.pone.0002606 (SAND2008-0561 J)Social contact networks for the spread of pandemic influenza in children and teenagers, Laura M. Glass, Robert J. Glass, BMC Public Health, 8:61, doi:10.1186/1471-2458-8-61, February 14, 2008 (SAND2007-5152 J)

Page 6: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Requests to Send Messages

Sent Message

Acknowledgment

Questions we'll be asking: How does a system composed of these elements behave? How does it respond to disruptions? How can we minimize disruption effects?

Day 4: Demonstration Model

Repast and Vensim: down load and make sure that they run by Day 4: http://repast.sourceforge.net/ http://www.vensim.com/

Page 7: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Many Examples of CASoS

• Tropical Rain forest

• Agro-Eco system

• Cities and Megacities (and their network on the planet)

• Interdependent infrastructure (local to regional to national to global)

• Government and political systems, educational systems, health care systems, financial systems, economic systems and their supply networks (local to regional to national to global)… Global Energy System and Green House Gasses

Page 8: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

EXAMPLE SYSTEM: Core Economy

Households

Commerce

Nonfossil Power

FossilPower

Farming

Industry

Refining

Oil Production

Mining

Financing

Government

Explanation

PowerFoodConsumer GoodsIndustrial GoodsMineralsOilLaborSecuritiesDepositsEmission CreditsMotor Fuel

Broker

Entity type

“Stuff”

Labor

Finance

Page 9: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

SYSTEM OF SYSTEMS: Trading Blocks composed of Core Economies

Region A

Households

Commerce

NonfossilPower

FossilPower

FarmingFinancing

Industry

Refining

Oil Production

Mining

Government

Households

Commerce

NonfossilPower

FossilPower

FarmingFinancing

Industry

Refining

Oil Production

Mining

Government

Region C

Households

Commerce

NonfossilPower

FossilPower

FarmingFinancing

Industry

Refining

Oil Production

Mining

Government

Households

Commerce

NonfossilPower

FossilPower

FarmingFinancing

Industry

Refining

Oil Production

Mining

Government

Region B

Households

Commerce

NonfossilPower

FossilPower

FarmingFinancing

Industry

Refining

Oil Production

Mining

Government

Households

Commerce

NonfossilPower

FossilPower

FarmingFinancing

Industry

Refining

Oil Production

Mining

Government

Explanation

Food

Consumer Goods

Industrial Goods

Minerals

Oil

DepositsEmission Credits

Motor Fuel

InterregionalBroker

USA

Canada

Mexico

Page 10: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

SYSTEM OF SYSTEM of SYSTEMS: Global Energy System

Explanation

Resources

InterregionalBroker

Information/Control

MultiregionalEntities

North America

Europe

East Asia

Page 11: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

NETWORKS within NETWORKS Region A

Households

Commerce

NonfossilPower

FossilPower

FarmingFinancing

Industry

Refining

Oil Production

Mining

Government

Households

Commerce

NonfossilPower

FossilPower

FarmingFinancing

Industry

Refining

Oil Production

Mining

Government

Page 12: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Illustrations of natural and constructed network systems from Strogatz [2001].

Food WebFood Web

New York state’sNew York state’sPower GridPower Grid

MolecularMolecularInteractionInteraction

COMPLEX: Emergent Structure

Page 13: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

RandomRandom ““Blended”Blended”

RegularRegular Fully Fully connectedconnected

““Scale-free”Scale-free”

Idealized Network Topology

Illustrations from Strogatz [2001]. “small world” “clustering”

+

DegreeDistributionHeavy-tailed

“small world”Erdos–Renyi

Page 14: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

1999 Barabasi and Albert’s “Scale-free” network

Simple Preferential attachment model:“rich get richer”

yieldsHierarchical structure

with “King-pin” nodes

Properties:tolerant to random

failure… vulnerable to

informed attack

Page 15: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

log(Size)

log(

Fre

quen

cy)

“Big” events are not rare in such systems

COMPLEX: Emergent behavior with power-laws & “heavy tails”

Earthquakes: Guthenburg-Richter

Wars, Extinctions, Forest fires Power Blackouts ?

Telecom outages ? Traffic jams ? Market crashes ?

… ???“heavy tail”

region

normal

Power law

Page 16: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Dissipation

External Drive

Temperature

Cor

rela

tion

Power Laws - Critical behavior - Phase transitions

Tc

What keeps a non-equilibrium system at a phase boundary?

Equilibrium systems

Page 17: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Drive

1987 Bak, Tang, Wiesenfeld’s “Sand-pile” or “Cascade” Model

“Self-Organized Criticality”power-laws

fractals in space and timetime series unpredictable

Cascade fromLocal Rules

RelaxationLattice

Page 18: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

BTW Results

Time Series of Events Power-Law Behavior(Frequency vs. Size)

Cascade Behavior

Event within SOC

field

Self-organized field at Critical point

Slope~ -1

“Self-Organized Criticality”power-laws

fractals in space and timetime series unpredictable

Page 19: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Generalization

Systems composed of many interacting parts often yield behavior that is not intuitively obvious at the outset… ‘the whole is greater than the sum of the parts’

Generalized Example:

Node State: Consider the simplest case where the state of a node has only two values. For a physical node (computer, relay, etc.), the node is either on/off, untripped/tripped, etc. For a human node, the state will represent a binary decision, yes/no, act/acquiesce, buy/sell, or a state such as healthy/sick.

Node interaction: When one node changes state, it influences the state of its neighbors, i.e., sends current its way, influences a decision, infects it, etc…

Concepts:•System self-organizes into a ‘critical state’ where events of all sizes can occur at any time and thus are, in some sense, unpredictable. •In general, the details underlying whether a node is in one state or another often don’t matter. What matters is that the ultimate behavior of a node is binary and it influences the state of its neighbors.

Page 20: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

ADAPTIVE: Adaptation occurs at multiple scales

Adaptive: The system’s behavior changes in time. These changes may be within entities or their interaction, within sub-systems or their interaction, and may result in a change in the overall system’s behavior relative to its environment.

TemporalSpatialRelational

Grow and adapt in response to local-to-global policy

Page 21: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

1999 Carson and Doyle’s Highly Optimized Tolerance “HOT”

Robust yet Fragile

Structure

Power laws

External spark distribution

designed adapted

Simple forest fire example

Page 22: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Conceptual Lens for Modeling/Thinking

• Nodes (with a variety of “types”)• Links or “connections” to other nodes (with a variety of “modes”)• Local rules for Nodal and Link behavior• Local Adaptation of Behavioral Rules• “Global” forcing, Local dissipation

Take any system and Abstract as:

Connect nodes appropriately to form a system (network)

Connect systems appropriately to form a System of Systems

GrowthEvolutionAdaptation

NodeState

NeighborState

PropagationRules

TransitionRules

NetworkTopology

Node / LinkModifications

PerceivedNode

Performance

PerceivedGlobal

NetworkProperty

RuleModifications

Page 23: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Towards a Complexity Science Basis for Infrastructure Modeling and Analysis

Systematically consider:Local rules for nodes and links (vary physics) Networks (vary topology)Robustness to perturbationsRobustness of control measures (mitigation strategies)Feedback, learning, growth, adaptationEvolution of resilienceExtend to multiple networks with interdependency

Study the behavior of models to develop a theory of infrastructures

Page 24: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Initial Study: BTW sand-pile on varied topology

Fish-netor Donut

Scale-free

BTW Sand-pile

0

20000

40000

60000

80000

100000

120000

1 59 117 175 233 291 349 407 465 523 581 639 697 755 813 871 929 987

time steps

Cas

cad

e S

ize

(no

des

)

Square Lattice "Fish-net" Scale-free

time

size

BTW Sand-pile

-6

-4

-2

0

2

4

6

0 1 2 3 4 5 6

log(size)lo

g(f

req

uen

cy)

Square Lattice "Fish-net" Scale-Free

Roll-off points Roll-off points

Linear (Scale-Free) Linear (Square Lattice "Fish-net")

log(size)log(

freq

)Random sinksSand-pile rules and drive10,000 nodes

Page 25: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Initial Study: Abstract Power Grid Blackouts

Fish-netor Donut

Scale-free

Sources, sinks, relay stations, 400 nodes

Power-Grid: Scale-Free

0

50

100

150

200

250

300

350

0 1000 2000 3000 4000 5000 6000 7000

time steps

size

(n

od

es)

timesi

ze

Scale-free

Power-Grid: Square Lattice "Fish-net"

0

50

100

150

200

250

300

350

400

450

0 50000 100000 150000 200000

time steps

size

(n

od

es)

time

size

Fish-net

DC circuit analogy, load, safety factorsRandom transactions between sources and sinks

Page 26: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

August 2003 Blackout…

Albert et al., Phys Rev E, 2004, Vulnerability of the NA Power Grid

Page 27: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

1) Every node talks to every other along shortest path2) Calculate load as the betweeness centrality given by the number of paths that go through a node3) Calculate Capacity of each node as

(Tolerance * initial load)

Attack: Choose a node and remove (say, highest degree)

Redistribute: if a node is pushed above its capacity, it fails, is removed, and the cascade continues

Applications from power to transportation to telecon

Generalized Congestive Cascading

Page 28: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Western Power Grid (WECC) 69 kev lines and above

Highest load

Highest degree

Initial Study: Congestive Failure of the WECC?

Betweeness + Tolerance

Page 29: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Abstract: Generalized Congestive Cascading

Network topology: Random networks with power law degree distribution Exponent of powerlaw systematically varied Rolloff at low and high values and truncation at high values

controlled systematically Rules:

Every node talks to every other along shortest path Calculate load as the betweeness centrality given by the

number of paths that go through a node Calculate Capacity of each node as (Tolerance * initial load) Attack: Choose a node and remove (say, highest degree) Redistribute: if a node is pushed above its capacity, it fails, is

removed, and the cascade continues

For Some Details see:LaViolette, R.A., W.E. Beyeler, R.J. Glass, K.L. Stamber, and H.Link, Sensitivity of the resilience of congested random networks to rolloff and offset in truncated power-law degree distributions, Physica A; 1 Aug. 2006; vol.368, no.1, p.287-93.

Page 30: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Initial Study: Cascading Liquidity Loss within Payment Systems

Trading Day

0Openingbalance

adapts tocontrol risk

0

Pay

Training Period

Cascading PeriodB

alan

ce

Time

Bal

ance

0

Bal

ance

Time

banks

payments

Scale-free network

# Transactions/period

Patterning

Perturbations

Page 31: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Cascading Liquidity in Scale-free Network

Random removal vs Attack of the Highest Degree node

Fedwire

0

5000

10000

15000

20000

25000

30000

35000

0 200000 400000 600000 800000 1000000 1200000

Time

Ava

ilab

le L

iqu

idit

y

Realization 6 Realization 7 Realization 4, Directed Realization 6, Directed

time

liqu

idit

y

Fedwire

0

5000

10000

15000

20000

25000

30000

0 100000 200000 300000 400000 500000 600000 700000 800000 900000

Time

Av

aila

ble

Liq

uid

ity

1000 Nodes,50K Transactions 100 Nodes, 500K Transactions

Increasing Transactions

time

liqu

idit

y

Fedwire

0

100

200

300

400

500

600

700

800

900

1000

0 100000 200000 300000 400000 500000 600000 700000 800000 900000 1000000

Time

Nu

mb

er o

f F

ailu

res

Realization 1, No Predictability Realization 1, 50% Predictability

Patterned Transactions

time

bank

def

ault

s

Page 32: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

32

Everyone

me

Nuclear Family

me

Classes (There are 6 of these)

me

Extended Family

me

Teen Extra

me

Initial Study: Cascading Flu

KidsTeensAdultsSeniors

Agent classes

•Infectivity•Mortality•Immunity•Etc.

Class Specific Parameters

Teen Laura Glass’s Groups

Links&

Frequency

Page 33: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

0

500

1000

1500

2000

2500

3000

3500

0 50 100 150 200 250 300

time (days)

Nu

mb

er I

nfe

cted

0

500

1000

1500

2000

2500

3000

3500

0 50 100 150 200 250 300

time (days)

Nu

mb

er I

nfe

cted

0

500

1000

1500

2000

2500

3000

3500

0 50 100 150 200 250 300

time (days)

Nu

mb

er I

nfe

cted

0

500

1000

1500

2000

2500

3000

3500

0 50 100 150 200 250 300

time (days)

Nu

mb

er I

nfe

cted

33

Without Immunity

With Immunity & Mortality

Behavioral Changes when Symptomatic

Agent differentiation

Flu Epidemic in Structured Village of 10,000

Increasing Realism beginning with Average agents…

Page 34: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Flu Epidemic Mitigation: Vaccination Strategies

0

500

1000

1500

2000

2500

3000

0 20 40 60 80 100 120

time (days)

nu

mb

er

infe

cte

d

Kids & Teens!

Current policy

Seniors only (yellow)

<60% required

Page 35: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Complex Adaptive Systems of Systems (CASoS) Engineering

Many CAS or CASoS research efforts focus on system characterization or model-building

“Butterfly collecting”

However, we have national/global scale problems within CASoS that we aspire to solve

Aspirations are engineering goals

CASoS Engineering:Engineering within CASoS and Engineering of CASoS

Page 36: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Chickens being burned in Hanoi

Pandemic now.

No Vaccine, No antiviral. What could we do?

Five years ago on Halloween, NISAC got a call from DHS. Public health officials worldwide were afraid that the H5NI “avian flu” virus would jump species and become a pandemic like the one in 1918 that killed 50M people worldwide.

Engineering within a CASoS: Example

Page 37: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Definition of the CASoS

System: Global transmission network composed of person to person interactions beginning from the point of origin (within coughing distance, touching each other or surfaces…)System of Systems: People belong to and interact within many groups: Households, Schools, Workplaces, Transport (local to regional to global), etc., and health care systems, corporations and governments place controls on interactions at larger scales…Complex: many, many similar components (Billions of people on planet) and groupsAdaptive: each culture has evolved different social interaction processes, each will react differently and adapt to the progress of the disease, this in turn causes the change in the pathway and even the genetic make-up of the virus

HUGE UNCERTAINTY

Page 38: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Analogy with other Complex Systems

Simple analog:Forest fires: You can build fire breaks based on where people throw cigarettes… or you can thin the forest so no that matter where a cigarette is thrown, a percolating fire (like an epidemic) will not burn.

Aspirations:Could we target the social network within individual communities and thin it? Could we thin it intelligently so as to minimize impact and keep the economy rolling?

Page 39: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Application of Networked Agent Method to Influenza

Everyone Random

Household

Extended Family

or Neighborhood

Teen Random

School classes

6 per teen

T1

T1

T1

T1

T1

Social Networks for Teen 1

ExampleTeen

Everyone Random

Household

Extended Family

or Neighborhood

Teen Random

School classes

6 per teen

T1

T1

T1

T1

T1

Social Networks for Teen 1

ExampleTeen

LatentMean duration 1.25

days

Infectious presymptomatic

Mean duration 0.5 days

IR 0.25

Infectious symptomaticCirculate

Mean duration 1.5 daysIR 1.0 for first 0.5 day,

then reduced to 0.375 for final day

Infectious symptomaticStay home

Mean duration 1.5 daysIR 1.0 for first 0.5 day,

then reduced to 0.375 for final day

Infectious asymptomaticMean duration 2 days

IR 0.25

Dead

Immune

Transition Probabilities

pS = 0.5pH = 0.5pM = 0

LatentMean duration 1.25

days

Infectious presymptomatic

Mean duration 0.5 days

IR 0.25

Infectious presymptomatic

Mean duration 0.5 days

IR 0.25

Infectious symptomaticCirculate

Mean duration 1.5 daysIR 1.0 for first 0.5 day,

then reduced to 0.375 for final day

Infectious symptomaticStay home

Mean duration 1.5 daysIR 1.0 for first 0.5 day,

then reduced to 0.375 for final day

Infectious asymptomaticMean duration 2 days

IR 0.25

Dead

Immune

Transition Probabilities

pS = 0.5pH = 0.5pM = 0

Stylized Social Network(nodes, links, frequency of interaction)

Disease manifestation(node and link behavior)

+

Page 40: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Adults (black) Children (red) Teens (blue)Seniors (green)

Network of Infectious Contacts

Children and teens form the Backbone of the Epidemic

Page 41: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Closing Schools and Keeping the Kids Home

ID Factor 1.0

0

500

1000

1500

2000

2500

0 20 40 60 80 100 120 140 160

time (days)

nu

mb

er i

nfe

cted

unmitigated closing schools 50% compliance 100% compliance

ID Factor 1.5

0

500

1000

1500

2000

2500

0 20 40 60 80 100 120 140 160

time (days)

nu

mb

er i

nfe

cted

unmitigated closing schools 50% compliance 100% compliance

1958-like

1918-like

Page 42: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Connected to White House Pandemic Implementation Plan writing team and VA OPHEH

They identified critical questions/issues and worked with us to answer/resolve them

• How sensitive were results to the social net? Disease manifestation?

• How sensitive to compliance? Implementation threshold? Disease infectivity?

• How did the model results compare to past epidemics and results from the models of others?

• Is there any evidence from past pandemics that these strategies worked?

• What about adding or “layering” additional strategies including home quarantine, antiviral treatment and prophylaxis, and pre-pandemic vaccine?

We extended the model and put it on Sandia’s 10,000 node computational cluster… 10’s of millions of runs later we had the answers to:

• What is the best mitigation strategy combination? (choice)• How robust is the combination to model assumptions? (robustness of choice)• What is required for the choice to be most effective? (evolving towards

resilience)

Page 43: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Worked with the White House to formulate Public Policy

A year later… For Details see:Local Mitigation Strategies for Pandemic Influenza, RJ Glass, LM Glass, and WE Beyeler, SAND-2005-7955J (Dec, 2005).

Targeted Social Distancing Design for Pandemic Influenza, RJ Glass, LM Glass, WE Beyeler, and HJ Min, Emerging Infectious Diseases November, 2006.

Design of Community Containment for Pandemic Influenza with Loki-Infect, RJ Glass, HJ Min WE Beyeler, and LM Glass, SAND-2007-1184P (Jan, 2007).

Social contact networks for the spread of pandemic influenza in children and teenagers, LM Glass, RJ Glass, BMC Public Health, February, 2008.

Rescinding Community Mitigation Strategies in an Influenza Pandemic, VJ Davey and RJ Glass, Emerging Infectious Diseases, March, 2008.

Effective, Robust Design of Community Mitigation for Pandemic Influenza: A Systematic Examination of Proposed U.S. Guidance, VJ Davey, RJ Glass, HJ Min, WE Beyeler and LM Glass, PLoSOne, July, 2008.

Pandemic Influenza and Complex Adaptive System of Systems (CASoS) Engineering, Glass, R.J., Proceedings of the 2009 International System Dynamics Conference, Albuquerque, New Mexico, July, 2009.

Health Outcomes and Costs of Community Mitigation Strategies for an Influenza Pandemic in the U.S, Perlroth, Daniella J., Robert J. Glass, Victoria J. Davey, Alan M. Garber, Douglas K. Owens, Clinical Infectious Diseases, January, 2010.

Page 44: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Summarizing the main points

We were dealing with a large complex adaptive system, a CASoS: a global pandemic raging across the human population within a highly connected world (social, economic, political)By similarity with other such systems, their problems, their solutions, we

defined THE CRITICAL PROBLEM for the pandemic applied a GENERIC APPROACH for simulation and analysis came up with a ROBUST SOLUTION that would work with minimal

social and economic burden independent of decisions made outside the local community (e.g., politics, borders, travel restrictions).

Through recognition that the GOVERNMENT’s global pandemic preparation was a CASoS, we

used CASoS concepts (social net, influence net, people) to INFLUENCE PUBLIC POLICY in short time. These concepts continued to be used by the HSC folks over the past 4.5 years to implement the policy that we identified. And work continues…

Page 45: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

CASoS Engineering

Harnessing the tools and understanding of Complex Systems, Complex Adaptive Systems, and Systems of Systems to Engineer solutions for some of the worlds biggest, toughest problems:

The CASoS Engineering Initiative See:

Sandia National Laboratories: A Roadmap for the Complex Adaptive Systems of Systems CASoS) Engineering Initiative

, SAND 2008-4651, September 2008.

Current efforts span a variety of Problem Owners: DHS, DoD, DOE, DVA, HHS, and others

Page 46: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Application: Congestion and Cascades in Payment Systems

Bank i

Central Bank

Balance Bi

Productive Agent

Instructions Ii

Submitted

Payment S

i

Balance BjProcessed Payment Rj

1 Productive agent instructs bank to send a payment

2 Depositor account is debited

4 Payment account is debited

5 Payment account is credited

Queue Qi Deposits DiIi-Si

3 Payment is submitted or queued

Ii

Bank j

Queue QjDeposits Dj

7 Queued payment is submitted if there is one

6 Depositor account is credited

Released

Payment

Bi > 0 ? Qj > 0 ?

Bank i

Central Bank

Balance Bi

Productive Agent

Instructions Ii

Submitted

Payment S

i

Balance BjProcessed Payment Rj

1 Productive agent instructs bank to send a payment

2 Depositor account is debited

4 Payment account is debited

5 Payment account is credited

Queue Qi Deposits DiIi-Si

3 Payment is submitted or queued

Ii

Bank j

Queue QjDeposits Dj

7 Queued payment is submitted if there is one

6 Depositor account is credited

Released

Payment

Bi > 0 ? Qj > 0 ?

US EURO

FXPayment system network

Networked Agent Based Model

Global interdependencies

For Details see:The Topology of Interbank Payment Flows, Soramäki, et al, PhysicaA, 1 June 2007; vol.379, no.1, p.317-33.Congestion and Cascades in Payment Systems, Beyeler, et al, PhysicaA, 15 Oct. 2007; v.384, no.2, p.693-718.Congestion and Cascades in Coupled Payment Systems, Renault, et al, Joint Bank of England/ECB Conference on Payments and monetary and financial stability, Nov, 12-13 2007.

Page 47: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Application: Community Containment for Pandemic Influenza

For Details see:Local Mitigation Strategies for Pandemic Influenza, RJ Glass, LM Glass, and WE Beyeler, SAND-2005-7955J (Dec, 2005).

Targeted Social Distancing Design for Pandemic Influenza, RJ Glass, LM Glass, WE Beyeler, and HJ Min, Emerging Infectious Diseases November, 2006.

Design of Community Containment for Pandemic Influenza with Loki-Infect, RJ Glass, HJ Min WE Beyeler, and LM Glass, SAND-2007-1184P (Jan, 2007).

Social contact networks for the spread of pandemic influenza in children and teenagers, LM Glass, RJ Glass, BMC Public Health, February, 2008.

Rescinding Community Mitigation Strategies in an Influenza Pandemic, VJ Davey and RJ Glass, Emerging Infectious Diseases, March, 2008.

Effective, Robust Design of Community Mitigation for Pandemic Influenza: A Systematic Examination of Proposed U.S. Guidance, VJ Davey, RJ Glass, HJ Min, WE Beyeler and LM Glass, PLoSOne, July, 2008.

Health Outcomes and Costs of Community Mitigation Strategies for an Influenza Pandemic in the U.S, Perlroth, Daniella J., Robert J. Glass, Victoria J. Davey, Alan M. Garber, Douglas K. Owens, Clinical Infectious Diseases, January, 2010.

Everyone Random

Household

Extended Family

or Neighborhood

Teen Random

School classes

6 per teen

T1

T1

T1

T1

T1

Social Networks for Teen 1

ExampleTeen

Everyone Random

Household

Extended Family

or Neighborhood

Teen Random

School classes

6 per teen

T1

T1

T1

T1

T1

Social Networks for Teen 1

ExampleTeen

LatentMean duration 1.25

days

Infectious presymptomatic

Mean duration 0.5 days

IR 0.25

Infectious symptomaticCirculate

Mean duration 1.5 daysIR 1.0 for first 0.5 day,

then reduced to 0.375 for final day

Infectious symptomaticStay home

Mean duration 1.5 daysIR 1.0 for first 0.5 day,

then reduced to 0.375 for final day

Infectious asymptomaticMean duration 2 days

IR 0.25

Dead

Immune

Transition Probabilities

pS = 0.5pH = 0.5pM = 0

pHpS

(1-pS)

(1-p

H)pM

pM

(1-pM)

(1-pM)

LatentMean duration 1.25

days

Infectious presymptomatic

Mean duration 0.5 days

IR 0.25

Infectious presymptomatic

Mean duration 0.5 days

IR 0.25

Infectious symptomaticCirculate

Mean duration 1.5 daysIR 1.0 for first 0.5 day,

then reduced to 0.375 for final day

Infectious symptomaticStay home

Mean duration 1.5 daysIR 1.0 for first 0.5 day,

then reduced to 0.375 for final day

Infectious asymptomaticMean duration 2 days

IR 0.25

Dead

Immune

Transition Probabilities

pS = 0.5pH = 0.5pM = 0

pHpS

(1-pS)

(1-p

H)pM

pM

(1-pM)

(1-pM)

Social Contact Network

Disease Manifestation

Page 48: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Each process/product link has a populationof associated producing firms

Capacity

What if an average firm fails?What if the largest fails?Scenario Analysis: What if a natural disaster strikes a region?

Application: Petrol-Chemical Supply chains

materials

process

Page 49: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Application: Industrial Disruptions

Disrupted Facilities Reduced Production Capacity

Diminished Product Availability

Page 50: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Explanation

Low Availability

High Availability

Page 51: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Application: Petrochemical & Natural Gas

Hurricane

EP Outage Storm Surge

DisruptedRefineries

DisruptedPetrochemical Plants

ServiceTerritories

IndirectlyDisrupted

PetrochemicalPlants

Disrupted NGCompressors/Stations

GasNetworkModel

IndirectlyDisrupted

PetrochemicalPlants

PetrochemicalShortfalls

PetrochemicalNetworkModel

12

3

Page 52: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Application: Group Formation and Fragmentation

Step 1: Opinion dynamics: tolerance, growing together, antagonismStep 2: Implementation of states with different behaviors (active, passive)Consider self organized extremist group formation, activation, dissipationApplication: Initialization of network representative of community of interest

Everyone Random

Household

Extended Family

or Neighborhood

Teen Random

School classes

T1

T1

T1

T1

T1

Social Networks for Teen 1

Everyone Random

Household

Extended Family

or Neighborhood

Teen Random

School classes

T1

T1

T1

T1

T1

Social Networks for Teen 1

Page 53: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Application: Engineering Corporate Excellence

Step 1: Render the Corporation as a set of networks:

Individuals Organizations Projects Communication (email,

telephone, meetings Products (presentations,

reports, papers)Investigate structure and statistics in timeDevelop network measures of organizational Health

Step 2:Conceptual modeling…

Sandia Systems Center

Page 54: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Loki Toolkit: Modeling and Analysis

Modeling and analysis of multiple interdependent networks of agents,

e.g., Physical+SCADA+Market+Policy Forcing

Polynet 2004

Loki 2005

Opinion

Infect

Payment Social

Contract

Re-Past & Jung2003

Power

Net Generator

Gas

Applications VERY Important

Generalized behavior

Net Analyzer

Page 55: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

CASoS Engineering Web site

Explore the web site at: http://www.sandia.gov/casos/

Look at

Defining examples

Roots and Our course of study

Page 56: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Integration: Finding the right model

There is no general-purpose model of any system

A model describes a system for a purpose

System

What to we care about? What can we do?

Additional structure and details added as needed

Model

Page 57: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Integration: Uncertainty

Aspects of Complex systems can be unpredictable (e.g., Bak, Tang, and Wiesenfield [BTW] sandpile)

Adaptation, Learning and Innovation

Conceptual model or Structural uncertainty Beyond parameters Beyond ICs/BCs

· Initial Conditions

· Boundary Conditions

Page 58: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Aspirations

Define Analysis

Evaluate Performance

Define and EvaluateAlternatives

Define Conceptual Model

Satisfactory? Done

Action A

PerformanceRequirement

Action B

PerformanceRequirement

Decision to refine the modelCan be evaluated on the sameBasis as other actions

Model uncertainty permits distinctions

Action A

PerformanceRequirement

Action B

PerformanceRequirement

Model uncertainty obscures important distinctions, and reducing uncertainty has value

Integration: Model development: an iterative process that uses uncertainty

Page 59: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Integration: Pragmatic Detail : More can be less

Model Detail

Am

ount

Coverage of ModelParameter Space

1. Recognize the tradeoff2. Characterize the uncertainty with every model3. Buy detail when and where its needed

Chance ofError

Cost

Understanding

Page 60: Complex Adaptive Systems of Systems (CASoS) Modeling and Engineering Robert Glass and Walt Beyeler Sandia National Laboratories, Albuquerque, New Mexico,

Integration: Challenges

Building understanding and problem solving capability that is generic across the wide range of domain and problem space

Finding the SIMPLE within the COMPLEX

Building appropriate models/solutions for the problem at hand

Incorporating Uncertainty, Verification and Validation Models? Solution!

CASoS Engineering