Pramod Khargonekar

Assistant Director for Engineering

National Science Foundation

Presentation at the JST Symposium

February 21, 2014

“to promote the progress of science; to advance the national health, prosperity, and welfare; to secure the national defense…” NSF Act, 1950

2

3

NATIONAL SCIENCE FOUNDATION

DIRECTORATE FOR

BIOLOGICAL

SCIENCES

(BIO)

John C. Wingfiel d,

Assistant Director

Joann P. Roskoski,

Deputy AD

703.292.8400

DIRECTORATE FOR

EDUCATION & HUMAN

RESOURCES

(EHR)

Joan Ferrini-Mundy,

Assistant Director

James Lightbourne,

Acting Deputy AD

703.292.8600

DIVISION OF BIOLOGICAL

INFRASTRUCTURE (DBI)

Scott Edwards,

Division Director

703.292.8470

DIVISION OF ENVIRONMENTAL

BIOLOGY (DEB)

Penelope Firth,

Division Director

703.292.8480

DIVISION OF INTEGRATIVE

ORGANISMAL SYSTEMS (IOS)

Jane Silverthorne,

Division Director

703.292.8420

DIVISION OF MOLECULAR &

CELLULAR BIOSCIENCES (MCB)

Parag Chitnis,

Division Director

703.292.8440

OFFICE OF EMERGING

FRONTIERS (EF)

Charles Liarakos,

Acting Division Director

703.292.8508

DIRECTORATE FOR

COMPUTER &

INFORMATION SCIENCE &

ENGINEERING (CISE)

Farnam Jahanian,

Assistant Director

Suzanne Iacono,

Deputy AD

703.292.8900

DIVISION OF CHEMICAL,

BIOENGINEERING, ENVIRONMENTAL &

TRANSPORT SYSTEMS (CBET)

JoAnn Lighty,

Division Director

703.292.8320

DIVISION OF CIVIL,

MECHANICAL & MANUFACTURING

INNOVATION (CMMI)

Steven McKnight,

Division Director

703.292.8360

DIVISION OF ELECTRICAL,

COMMUNICATIONS & CYBER

SYSTEMS (ECCS)

Samir El-Ghazaly,

Division Director

703.292.8339

DIVISION OF ENGINEERING

EDUCATION & CENTERS (EEC)

Theresa Maldonado,

Division Director

703.292.8380

DIVISION OF INDUSTRIAL

INNOVATION & PARTNERSHIPS (IIP)

Grace Wang,

Division Director

703.292.8050

OFFICE OF EMERGING

FRONTIERS IN RESEARCH &

INNOVATION (EFRI)

Sohi Rastegar,

Senior Advisor

703.292.8301

DIRECTORATE FOR

GEOSCIENCES

(GEO)

Roger Wakimoto,

Assistant Director

Margaret Cavanaugh,

Deputy AD

703.292.8500

DIRECTORATE FOR

MATHEMATICAL &

PHYSICAL SCIENCES

(MPS)

Fleming Crim,

Assistant Director

Celeste M. Rohlfin

g

,

Deputy AD

703.292.8800

DIVISION OF ASTRONOMICAL

SCIENCES (AST)

James Ulvestad,

Division Director

703.292.8820

DIVISION OF CHEMISTRY (CHE)

Jacquelyn Gervay-Hague,

Division Director

703.292.8840

DIVISION OF MATERIALS

RESEARCH (DMR)

Mary Galvin-Donoghue,

Division Director

703.292.8810

DIVISION OF MATHEMATICAL

SCIENCES (DMS)

Michael Vogelius,

Division Director

703.292.8870

DIVISION OF PHYSICS (PHY)

Denise Caldwell,

Division Director

703.292.8890

OFFICE OF MULTIDISCIPLINARY

ACTIVITIES (OMA)

Clark Cooper,

Offic

e

He ad

703.292.8800

DIRECTORATE FOR

SOCIAL, BEHAVIORAL, &

ECONOMIC SCIENCES

(SBE)

Joanne Tornow,

Acting Assistant

Director

Fae Korsmo,

Acting Deputy AD

703.292.8700

DIVISION OF BEHAVIORAL &

COGNITIVE SCIENCES (BCS)

Mark Weiss,

Division Director

703.292.8740

DIVISION OF SOCIAL &

ECONOMIC SCIENCES (SES)

Jeryl Mumpower,

Division Director

703.292.8760

NATIONAL CENTER FOR

SCIENCE AND ENGINEERING

STATISTICS (NCSES)

John Gawalt,

Division Director

703.292.8780

National Science Foundation

4201 Wilson Boulevard

Arlington, Virginia 22230

TEL: 703.292.5111 | FIRS: 800.877.8339 | TDD: 800.281.8749 February 2014

DIRECTORATE FOR

ENGINEERING

(ENG)

Pramod P.

Khargonekar,

Assistant Director

Kesh Narayanan,

Deputy AD

703.292.8300

DIVISION OF GRADUATE

EDUCATION (DGE)

James Lightbourne,

Division Director

703.292.8630

DIVISION OF HUMAN RESOURCE

DEVELOPMENT (HRD)

Sylvia James,

Division Director

703.292.8640

DIVISION OF RESEARCH ON

LEARNING IN FORMAL &

INFORMAL SETTINGS (DRL)

Richard Duschl,

Division Director

703.292.8620

DIVISION OF UNDERGRADUATE

EDUCATION (DUE)

Susan Singer,

Division Director

703.292.8670

DIVISION OF ATMOSPHERIC &

GEOSPACE SCIENCES (AGS)

Michael Morgan,

Division Director

703.292.8520

DIVISION OF EARTH

SCIENCES (EAR)

Paul Cutler

Acting Division Director

703.292.8550

DIVISION OF OCEAN

SCIENCES (OCE)

David Conover,

Division Director

703.292.8580

DIVISION OF

POLAR PROGRAMS (PLR)

Kelly Falkner,

Division Director

703.292.8030

DIVISION OF COMPUTER &

NETWORK SYSTEMS (CNS)

Keith Marzullo,

Division Director

703.292.8950

OFFICE OF INFORMATION

& RESOURCE

MANAGEMENT

(OIRM)

Gene Hubbard,

Head / Chief Human

Capital Offic

e

r

Amy Northcutt,

Chief Information Offic

e

r

703.292.8100

OFFICE OF BUDGET,

FINANCE, & AWARD

MANAGEMENT

(BFA)

Martha A. Rubenstein,

Head / Chief Financial

Offic

e

r

Joanna E. Rom ,

Deputy Head

703.292.8200

BUDGET DIVISION (BUD)

Michael Sieverts,

Division Director

703.292.8260

DIVISION OF ACQUISITION AND

COOPERATIVE SUPPORT (DACS)

Jeffery Lupis,

Division Director

703.292.8240

DIVISION OF FINANCIAL

MANAGEMENT (DFM)

Shirl Ruffin

,

Division Director / Deputy CFO

703.292.8280

DIVISION OF ADMINISTRATIVE

SERVICES (DAS)

Mercedes Eugenia,

Division Director

703.292.8190

DIVISION OF INFORMATION

SYSTEMS (DIS)

Dorothy Aronson,

Division Director

703.292.8150

DIVISION OF HUMAN RESOURCE

MANAGEMENT (HRM)

Judy Sunley,

Division Director

703.292.8180

DIVISION OF GRANTS &

AGREEMENTS (DGA)

Karen Tiplady,

Division Director

703.292.8210

DIVISION OF INSTITUTION &

AWARD SUPPORT (DIAS)

Mary Santonastasso,

Division Director

703.292.8230

LARGE FACILITIES OFFICE

Scott Horner,

Acting Deputy Director

703.292.4416

DIVISION OF COMPUTING &

COMMUNICATION

FOUNDATIONS (CCF)

Rao Kosaraju,

Division Director

703.292.8910

DIVISION OF ADVANCED

CYBERINFRASTRUCTURE (ACI)

Irene Qualters,

Acting Division Director

703.292.8970

DIVISION OF INFORMATION &

INTELLIGENT SYSTEMS (IIS)

Howard Wactlar,

Division Director

703.292.8930

OFFICE OF THE GENERAL COUNSEL (OGC)

Lawrence Rudolph, General Counsel

Peggy Hoyle, Deputy GC703.292.8060

OFFICE OF DIVERSITY &

INCLUSION (ODI)

Claudia J. Postell, Head

703.292.8020

OFFICE OF LEGISLATIVE & PUBLIC

AFFAIRS (OLPA)

Judy Gan, Head

703.292.8070

OFFICE OF INTERNATIONAL &

INTEGRATIVE ACTIVITIES (OIIA)

Wanda Ward, Head

703.292.8040

OFFICE OF INSPECTOR GENERAL (OIG)

Allison C. Lerner, Inspector General

703.292.7100

NATIONAL SCIENCE BOARDOFFICE

Michael Van WoertExecutive Offic

e

r

703.292.7000

OFFICE OF THE

DIRECTOR

Cora B. MarrettDeputy Director

andActing Director

703.292.8000

NATIONAL SCIENCE BOARD (NSB)

Dan E. ArvizuChair

Kelvin K. DroegemeierVice Chair

703.292.7000

NSF ENG: Investing in transformative research and education to foster

innovations for benefits to society

4

Societal Benefits

Research

Education Innovation

Translational Fundamental

IIP

•Academic Partnerships

•Small Business Partnerships

EEC

•Engineering Research Centers

•Engineering Education

•Engineering Workforce

EFRI CBET

•Chemical, Biochemical, and Biotechnology Systems

•Biomedical Engineering and Engineering Healthcare

•Environmental Engineering and Sustainability

•Transport and Thermal Fluids Phenomena

CMMI

•Advanced Manufacturing

•Mechanics and Engineering Materials

•Resilient and Sustainable Infrastructure

•Systems Engineering and Design

ECCS

•Electronics, Photonics, and Magnetic Devices

•Communications, Circuits, and Sensing Systems

•Energy, Power, and Adaptive Systems

Directorate for Engineering

5

ENG and SBIR/STTR Budgets ($M)

$0

$200

$400

$600

$800

$1,000

$1,200

ENG ENG ARRA SBIR/STTR SBIR/STTR ARRA

6

7

System Set of connected things or parts forming a complex whole, in particular

A set of things working together as parts of a mechanism or an interconnecting network A set of organs in the body with a common structure or function Human or animal body as a whole A group of related hardware units or programs or both, especially when dedicated to a single

application Geology (in chronostratigraphy) a major range of strata that corresponds to a period in time,

subdivided into series Astronomy a group of celestial objects connected by their mutual attractive forces, especially

moving in orbits about a center Each of seven categories of crystals (cubic, tetragonal, orthorhombic, trigonal, hexagonal,

monoclinic, and triclinic) classified according to the possible relations of the crystal axes

Set of principles or procedures according to which something is done; an organized scheme or method: Orderliness - method Method of choosing one’s procedure in gambling Set of rules used in measurement or classification The prevailing political or social order, especially when regarded as oppressive and intransigent

From Oxford English Dictionary

8 One of 1000 most used words

Technological Evolution and Systems

9

Zina D

eretsky, NSF

GFD

L, NO

AA

Current Activities in Systems at NSF

Systems is a common theme in all divisions in ENG CBET, CMMI, ECCS, EEC, and IIP

Systems oriented work is supported in CISE: Computer and Network Systems

Information and Intelligent Systems

Systems in other NSF directorates: Social and Behavioral Sciences

Biological Sciences

Mathematical and Physical Sciences

Geological Sciences

10

Many ENG programs invest in systems:

Bio-process Systems (CBET)

Chemical Process Systems (CBET)

Environmental Systems (CBET)

Operations Research (CMMI)

Engineering Systems and Design (CMMI)

Control Systems (CMMI)

Dynamical Systems (CMMI)

Civil Infrastructure Systems (CMMI)

Communications, Circuits, and Sensing Systems (ECCS)

Energy, Power and Adaptive Systems (ECCS)

Engineering Research Centers (EEC)

11

12

Operations Research Program

Research Goal: To enable optimization of larger, more complex systems accounting for uncertainty

Large-scale, nonlinear optimization for large engineered systems

Modeling, simulation and optimization under uncertainty

Heuristics for large problems

CMMI 13

Engineering Systems and Design Program

Research Goal: To create and implement a framework for rational design decision making

Mathematically rigorous framework for optimal design decision

making Proper treatment of uncertainty Incorporation of decision theory into engineering design Life cycle view—includes design of the organization, manufacture,

distribution/sales, operation, maintenance, warranty, liability, reliability, disposal, etc.

Unique design challenges—compliant structures, origami

14

CMMI

Control Systems Program

Research Goal: To integrate control theory and decision/design theory.

Integrate engineering design theory and control theory

Account properly for uncertainty

Integration of control, communication and signal processing for sensing and/or actuation

Leverage feedback, feedforward, uncertainty, communication, signal processing, and machine learning

Cyber-physical Systems

Emerging areas:

Non-engineered or data-driven systems

Systems with probabilistic or stochastic behavior or characteristics

Leverage system and/or computational structure or dynamics – coupled design and control

15

CMMI

Dynamical Systems Program

Research Goal: Improve modeling and simulation of large-scale systems

Expand modeling capabilities to include large-scale systems

Emergent behaviors and complex systems theory

Incorporate game theory and uncertainty into system modeling and simulation

16

CMMI

Civil Infrastructure Systems Program

Research Goal: To enable good decision making in an interdependent systems context where people are a part of the system

Fundamental research for resilient and sustainable

infrastructure systems Focus on performance management, risk analysis, life-cycle

analysis, social and behavioral impacts Emphasis areas:

constructions engineering infrastructure systems and management transportation systems

17

CMMI

Energy, Power and Adaptive Systems

Control theory & hybrid dynamical systems

Distributed & mobile networked control

Networked sensing & imaging systems

Control aspects of cyber-physical Systems

Energy storage, collection & harvesting Systems

Power and electric grid control systems

Adaptive & intelligent systems

18

ECCS

Challenges Development of imaging systems with high efficiency, resolution,

discrimination, dynamic range, and acquisition time Systems integration and design

Opportunities

New approaches to signal generation Efficient sources and detectors RF nanotechnology Miniaturizing integrated systems Time/Frequency-domain imaging methods Current investments include THz signal generation, integrated

electronics, fabrication, imaging applications.

Terahertz Systems

19

ECCS

Systems Biotechnology – Metabolic Systems

20

Input (nutrients)

Output/Products (biofuels, amino acids, antibiotics, drugs, etc.)

The metabolic pathways within a cell represent a complex system which “connects” inputs and outputs; by understanding & representing this system, we can design and construct “cell factories” which produce valuable products

CBET Image courtesy Roche

Environmental Systems Program

Images courtesy Auckland City Council

The “environment”, a complex system, requires understanding/managing the complex system dynamics between engineered and natural systems. Example: for watershed management and safety, water quality and quantity are important considerations within the larger context of the systems.

21

Stochastic Systems-Based Watershed Management and Safety research

Ultimately, this research will impact the design of environmental monitoring for watersheds and aid in sustainable watershed management strategies.

CAREER Award to L. Yeghiazarian

22

First-Order and Second-Order Reliability Methods to compute the reliability, resilience, and vulnerability metrics and sustainability index for a watershed used for drinking water

CBET

Resilient Interdependent Infrastructure Processes and Systems (RIPS) Program

Explore new multidisciplinary engineering approaches to increase: resilience, interoperability, performance, and readiness of ICIs

Create conceptual frameworks or theories from a multi-disciplinary perspective (computer science, social and behavioral science and engineering)

Understand organizational, social, psychological, legal, political and economic barriers

Understand human responses to the predicted performance of interdependent infrastructures

Explore the economics and governance of ICIs

Expand the design space of alternatives, leveraging new interdependencies to increase resiliency to extreme conditions and future events

Create the knowledge that leads to innovative new ICI services and markets, facilitating transition to practice

23

Engineering Complex Systems

It’s not enough to observe emergent behaviors and patterns

Engineering seeks

Desired behavior and performance

Robustness/resilience/redundancy/reliability

Adaptation, learning, reconfigurability

Self-assembly/self-organization

24

Towards Service Systems Innovation

Picture taken by Project Manhattan, at Cold Storage Singapore, Creative Commons License, , Dec 2013,

25

Established in 1985, the Engineering Research Centers program was launched with the GOAL:

“to further the development of fundamental knowledge in engineering fields that will

• Enhance the competitiveness of the U.S. and

• Prepare engineers to contribute through better engineering practice.”

26 Image courtesy NSF

Distinguishing Features of an ERC

Compelling vision for an engineered system at the cusp of discovery and innovation for societal impact

Integrated program from exciting fundamentals research to proof-of-concept systems test beds

A 10-year strategic plan that is driven by engineered systems barriers and powerful fundamental insights

Innovative plan to develop engineering graduates with the skills set to be highly effective in industrial practice and creative innovators in a global economy throughout their careers

Innovative plan to accelerate the use of ERC-generated technology and processes in industry/practice

27 EEC

ERC 3-Plane Strategic Research Plan

Rests on critical engineered systems goals

Motivates and guides the research

Identifies significant fundamental research and technical barriers at all levels

Organizes research into integrated thrusts of interdependent projects to address challenging barriers

Includes societal, environmental and other non-technical barriers as appropriate to vision

28 EEC

29

QoLT 3-plane chart

Barriers

Enabling Technologies Technology Base

Barriers

Fundamental Knowledge Knowledge Base

Systems Technology Integration

Requirements

Stakeholders

Barriers

Technology Elements

Fundamental Insights

Technology Elements

Products & Outcomes

ERC (Research) Strategic Framework

Sys

tem

Req

uir

emen

ts

Testbeds Systems Research

Systems Research

Testbeds

Enabling Technology Research

Enabling Technology Research

Fundamental Research Fundamental Research

Fundamental Research Fundamental Research

Fundamental Research Fundamental Research

Testbeds

Testbeds

Testbeds

Testbeds

EEC Images courtesy NSF

Biomimetic Microelectronic Systems ERC Vision: to develop the science and engineering of novel biomimetic

microelectronic systems based on fundamental principles of biology

30 EEC Images courtesy BMES

Technology commercialized Second Sight Medical Products

Argus II

60 Electrodes

Thin film, microfabricated electrode array

CE Mark in Europe, 2011

FDA approval in US 2013

History of NSF funding since 1996

Letter recognition, word reading, improved mobility, object localization, motion detection

Retinal Prosthesis

Video camera mounted on external glasses, signal sent wirelessly to receiver mounted intracranially (on eye), receiver decodes signals, calculates stimulation signals to epiretinal implant mounted on retina surface

31 EEC Images courtesy BMES

ReNUWIt ERC Strategic Research Plan Vision: Safe, sustainable, urban water infrastructures enabled by technological

advances in natural and engineered systems and informed by a deeper understanding

of institutional frameworks.

32 EEC Images courtesy ReNUWIt

Re-inventing the Nation’s Urban Water Infrastructure (ReNUWIt) ERC

33 EEC Images courtesy ReNUWIt

Data

Numerous

inexpensive,

closely-

spaced

radars

ERC for Collaborative Adaptive Sensing of the Atmosphere (CASA)

Problem

Weather

hazards

gap

Multiple

end users

Tasking

Solution

“Sample the atmosphere where & when the user need is greatest” 34 EEC

Credit: Science Nation, National Science Foundation

Credit: NSF Central Arizona-Phoenix LTER Site

CASA ERC Strategic Concept

DCAS System Attributes Selected Outcomes

Fundamental

Understanding

em wave-

atmosphere

interaction Small-scale atmosphere

Cross-layer

resource allocation

Response

to hazards

System Attributes • Achieve high temporal & spatial resolution

mapping throughout the troposphere.

• Support multiple simultaneous end-users.

• Resource allocation optimized for decision-

support and response to hazardous weather

Demonstrated improvements to hazard • Sensing

• Detecting

• Forecasting

• Warning

• Responding

Technology

Research

Low-cost radar nodes

MC&C

Networked radar waveforms

Cal & test facilities

Vulnerability assmt tool

Data assimilation

user interfaces System emulator

Policy-steering protocol Min resource nets

Systems

Integration

weather & user

requirements

Very short-range forecast

Sm scale detection

System Test Beds

35 EEC Images courtesy CASA

CASA – Innovative Radar System Saves Lives “The life-saving implications … were on dramatic display during the May

24, 2011, tornado outbreak in southwestern Oklahoma … emergency management officials relied on the CASA imagery to follow the twister and move people out of its direct path … Officials noted that CASA information was critical for their decision-making during the event as they worked to shelter 1,200 people.” http://www.raytheon.com/newsroom/technology_today/2011_i2/storm_trackers.html

CASA’s fast updating, high resolution radar data showed the EF4 tornado making a northerly turn.

EF 4 Tornado

Track CASA

Tornado

Image

36 EEC Images courtesy CASA

Nanosystems Engineering Research Centers

Three NSF awards of $55.5 million for 5 years in 2012 Advanced Self-Powered Systems of Integrated Sensors and

Technology, North Carolina State University: self-powered wearable systems that simultaneously monitor a person’s environment and health; links exposure to pollutants and chronic diseases.

Nanomanufacturing Systems for Mobile Computing and Mobile Energy Technologies, UT-Austin: high-throughput, reliable, and versatile nanomanufacturing process systems to be demonstrated through the manufacture of mobile nanodevices.

Transformational Applications of Nanoscale Multiferroic Systems, UCLA: reduce the size and increase the efficiency of components and systems whose functions rely on the manipulation of either magnetic or electromagnetic fields.

37 EEC

Transformational Applications of Nanoscale Multiferroic Systems (TANMS)

38

Two fundamental discoveries:

- Fundamentally new approach to control electromagnetism by electric switch

- New class of nanoscale multiferroic materialselements

~1-100 nm

Novel Memory

Novel Antenna

Novel Motors

UCLA Cornell UCB CSUN ETH

Leading to fundamentally new systems including novel devices:

EEC Images courtesy TANMS

TANMS Value Chain

Kinetic Ceramics

Maritime App Physics

Magzor

Active Signal Tech

Aneeve

Magsil

Intelligent Optical

Optofluidics

NextGen

Panera Tech

Bennet Aerospace

System Integrator

10 Corporations Proof of Concept

5 Universities

Material/Fabrication

Component Supplier

11 Small Business

Innovation to Commercial Concept

39 EEC

Wellness Tracking Exposure Tracking

1. Energy harvesting/storage

3. Nanobiosensors

2. Nanoelectronics

Wellness management system: Portable, wireless

New nanophysics for bio-detection

Center for Advanced Self-Powered Systems of Integrated Sensors and Technologies (ASSIST)

40

ASSIST (NCSU) - Nanosystem to monitor medical condition and exposure to environment using nanobio- and eco-sensors EEC

Images courtesy ASSIST

• Nanoscale Piezo MEMS (Thrust I)

• Thermoelectric Integration (Thrust I)

• Low-voltage MUQFETs/TFETs (Thrust II)

• Multifunctional nanoengineered surfaces (Thrust III)

• Integration Technologies (Thrust V)

• Heterogeneous Integration (Thrusts II and III)

• Ultra-low-power EKG and Wireless (Thrust IV)

• Integration Technologies (Thrust V)

41

0.2 0.4 0.6 0.8 1 1.2 1.4 1.6 1.8

0.4

0.6

0.8

1

0.2 0.4 0.6 0.8 1 1.2 1.4 1.6 1.8

0

0.5

1

0.2 0.4 0.6 0.8 1 1.2 1.4 1.6 1.8

0

0.5

1

1.798 1.7981 1.7982 1.7983 1.7984 1.7985 1.7986

0

0.5

1

1.7979 1.798 1.7981 1.7982 1.7983 1.7984 1.7985 1.7986 1.7987

0

0.5

1

655 ms

650 µs

Header Data CRC

VBoost

sample

ASSIST ERC: Nanosystem technology goals

EEC Images courtesy ASSIST

Systems Science and Engineering – Key Issues

Very broad concept that cuts across a wide variety of domains, technologies, and applications

Systems integration is becoming increasingly critical in realizing societal benefits from fundamental research advances

Cost, performance, time to market, …

Very large economic implications

Overarching and encompassing theory does not exist

Practical and domain considerations become primary drivers

Insufficient leveraging of “systems knowledge” across application areas

42

Engineering Complex Systems

It’s not enough to observe emergent behaviors and patterns

Engineering seeks:

Desired performance and behavior

Resiliency/robustness/redundancy

Adaptation, reconfigurability

Self-assembly/self-organization

Reliability

43

Components of Systems Science and Engineering

Specification of desired system level requirements

Modeling, simulation, estimation, prediction

Analysis and verification techniques and computer aided tools

Concepts needing formal development: architecture, modularity, adaptability, evolvability, …

Efficient exploration of design space

Dealing with uncertainty

Human behavior aspects in engineering of systems

Game theory to account for multiple decision makers (designers)

Connections and interactions with natural (biological) systems

44

Towards Systems Science and Engineering

Integrate extant theories towards a science of systems: Decision theory

Game theory

Control theory

Estimation and prediction theory

Adaptation and learning

Robustness and resilience

Networks and distributed computing

Economics

Social choice theory

Develop a composite theory, define the limitations of the theory

Mitigate poor decision making where the theory fails

45

Systemize Learning from Experience

Large, complex systems being designed in many application domains

It would be very useful to learn from these experiences in the development of systems science and engineering

Requires an intentional approach

Integrate into engineering education

46

Closing Thoughts

Systems – a very broad and increasingly important concept

Critical to realize valuable innovations from fundamental scientific and engineering advances

Systematic development of systems science and engineering is necessary and will be beneficial

Deep interconnection between real world applications critical to guide the development of fundamental systems knowledge and tools

47

48

pkhargon@nsf.gov