S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of...
Transcript of S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of...
![Page 1: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/1.jpg)
S&T Stakeholders Conference
Dr. Charles HutchingsDeputy Director, Modeling and SimulationTest and Standards DivisionScience and Technology Directorate
June 2-5, 2008
Modeling and Simulation (M&S) Guidelines
PARTNERING FOR A SAFER NATION
![Page 2: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/2.jpg)
2
Abstract
M&S is an important tool for operations analysis, experimentation, system acquisition, and training. This tutorial outlines guidance for program managers, M&S developers, and decision makers on the judicious use of M&S, which incorporates guidelines from reference material and standards, policies, processes, and “best practice” developed in Federal departments, agencies, and entities. Focus areas include examples of departmental M&S capabilities and approaches to M&S development, management, and evaluation.
![Page 3: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/3.jpg)
3
Draft M&S Course OutlineWhat is a “Model”, “Simulation”, etc.?
How is M&S used for homeland security? National Infrastructure Simulation and Analysis Center (NISAC)National Atmospheric Release Advisory Center (NARAC)/Inter-Agency Modeling and Atmospheric Analysis Center (IMAAC)Emerging Capabilities in DHS S&T Directorate
Who in DHS should consider using M&S?
When and where in DHS is M&S useful?
What are some considerations in acquiring M&S capabilities?EconomicsDevelopmentDataEvaluation
Why are M&S guidelines, standards, and “best practice” important for DHS?
How do other Federal agencies/organizations approach M&S?
![Page 4: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/4.jpg)
4
Draft M&S Course OutlineWhat is a “Model”, “Simulation”, etc.?
How is M&S used for homeland security? National Infrastructure Simulation and Analysis Center (NISAC)National Atmospheric Release Advisory Center (NARAC)/Inter-Agency Modeling and Atmospheric Analysis Center (IMAAC)Emerging Capabilities in DHS S&T Directorate
Who in DHS should consider using M&S?
When and where in DHS is M&S useful?
What are some considerations in acquiring M&S capabilities?EconomicsDevelopmentDataEvaluation
Why are M&S guidelines, standards, and “best practice” important for DHS?
How do other Federal agencies/organizations approach M&S?
![Page 5: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/5.jpg)
5
Definitions
Model
(1) An approximation, representation, or idealization of selected aspects of the structure, behavior, operation, or other characteristics of a real-world process, concept, or system. Note: Models may have other models as components.(2) To serve as a model as (1).(3) To develop or use as a model as in (1).
Simulation
(1) A model that behaves or operates like a given system when provided a set of controlled in-puts. (Synonymous with: Simulation model)(2) The process of developing or using a model as in (1).
Source: IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD 610.3 - 1989)
Lists 33 different types of models (e.g., computational, descriptive, discrete, iconic, mathematical) and 20 different types of simulations (e.g., continuous, discrete, event-oriented, Monte Carlo, process-oriented).
![Page 6: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/6.jpg)
6
Definitions from DoD and EPAModel
DoD: A physical, mathematical, or otherwise logical representation of a system, entity, phenomenon, or process.
EPA: A representation of the behavior of an object or process, often in mathematical or statistical terms. Models can also be physical or conceptual.
SimulationDoD: A method for implementing a model over time. Also, a technique for testing, analysis, or training in which real-world systems are used, or where real-world and conceptual systems are reproduced by a model.
EPA: One complete execution of the computer program, including input and output.
Sources: M&S Management. DoD Directive 5000.59.
Guidance for Quality Assurance Project Plans for Modeling. EPA QA/G-5M
Draft Guidance on the Development, Evaluation, and Application of Regulatory Environmental Models. EPA Council for Regulatory Environmental Modeling
![Page 7: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/7.jpg)
7
DoD/Live, Virtual, Constructive (LVC)
Live simulations are simulated operations of real systems using real people in realistic situations.
Virtual simulations put the human-in-the-loop (HITL)
Constructive Simulationsare computer simulations that are strictly mathematical representations of systems and do not employ any actual hardware
![Page 8: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/8.jpg)
8
A “Model” for M&S
Source: R. G. Sargent, “Validation and Verification of Simulation Models”, Proceedings of the 2004 Winter Simulation Conference, 2004
![Page 9: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/9.jpg)
9
Draft M&S Course OutlineWhat is a “Model”, “Simulation”, etc.?
How is M&S used for homeland security? National Infrastructure Simulation and Analysis Center (NISAC)National Atmospheric Release Advisory Center (NARAC)/ Inter-Agency Modeling and Atmospheric Analysis Center (IMAAC)Emerging Capabilities in DHS S&T Directorate
Who in DHS should consider using M&S?
When and where in DHS is M&S useful?
What are some considerations in acquiring M&S capabilities?EconomicsDevelopmentDataEvaluation
Why are M&S guidelines, standards, and “best practice” important for DHS?
How do other Federal agencies/organizations approach M&S?
![Page 10: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/10.jpg)
1010
![Page 11: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/11.jpg)
1111
![Page 12: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/12.jpg)
1212
![Page 13: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/13.jpg)
13
![Page 14: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/14.jpg)
1414
![Page 15: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/15.jpg)
1515
![Page 16: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/16.jpg)
1616
![Page 17: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/17.jpg)
1717
![Page 18: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/18.jpg)
1818
![Page 19: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/19.jpg)
1919
![Page 20: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/20.jpg)
2020
![Page 21: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/21.jpg)
2121
![Page 22: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/22.jpg)
2222
![Page 23: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/23.jpg)
23
![Page 24: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/24.jpg)
2425
![Page 25: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/25.jpg)
2526
![Page 26: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/26.jpg)
26
![Page 27: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/27.jpg)
2727
Secure Border Initiative Systems Engineering and Modeling & Simulation Project
Foreign Animal Diseases Modeling Project
Joint Modeling Operations Center (JMOC)
Visual Analytic and Physics-based Simulation Program
Group Violent Intent Modeling Project
Open Source Modeling Applicability Project
Integrated Modeling, Mapping and Simulation Program
Computational models to predict aircraft vulnerability to Explosive threats
M&S is integral to analysis and supports decision making at manylevels
Emerging M&S Capabilities in DHS S&T Directorate
![Page 28: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/28.jpg)
28
Draft M&S Course OutlineWhat is a “Model”, “Simulation”, etc.?
How is M&S used for homeland security? National Infrastructure Simulation and Analysis Center (NISAC)National Atmospheric Release Advisory Center (NARAC)/Inter-Agency Modeling and Atmospheric Analysis Center (IMAAC)Emerging Capabilities in DHS S&T Directorate
Who in DHS should consider using M&S?
When and where in DHS is M&S useful?
What are some considerations in acquiring M&S capabilities?EconomicsDevelopmentDataEvaluation
Why are M&S guidelines, standards, and “best practice” important for DHS?
How do other Federal agencies/organizations approach M&S?
![Page 29: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/29.jpg)
29
M&S in Perspective
Skilledanalysts
match theright M&S and data
to answer the question at hand
![Page 30: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/30.jpg)
30
Draft M&S Course OutlineWhat is a “Model”, “Simulation”, etc.?
How is M&S used for homeland security? National Infrastructure Simulation and Analysis Center (NISAC)National Atmospheric Release Advisory Center (NARAC)/ Inter-Agency Modeling and Atmospheric Analysis Center (IMAAC)Emerging Capabilities in DHS S&T Directorate
Who in DHS should consider using M&S?
When and where in DHS is M&S useful?
What are some considerations in acquiring M&S capabilities?EconomicsDevelopmentDataEvaluation
Why are M&S guidelines, standards, and “best practice” important for DHS?
How do other Federal agencies/organizations approach M&S?
![Page 31: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/31.jpg)
31
Framework For Incident Management (FIM)
Civilian Population
Critical Infrastructure
Environment
Government Agencies
Private Sector
Other
DO
MA
IN
Prevention
Preparedness
Response
Recovery
LIFECYCLE PHASE
Mitigation
INCIDENTMAN-MADE NATURAL
--Conve
ntional
bomb
Conventio
nal bomb
-Hija
cking
-……
-Hurri
cane
-……
-Flood
-Wild
fire
-Tornad
o
- NBC bomb-Fire
Cells Represent Potential M&S Applications:Many potential uses for Incident Management!
Source: An Integrated Gaming and Simulation Architecture for Incident Management Training, NISTIR 7295, March 2006
![Page 32: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/32.jpg)
32
# dead, # injured, behavior
-Damaged at a junction-Water dept. technicians on way
-# floors, # sq. ft. damaged-Traffic jam
Units dispatchedArriving in 3 mins.Units dispatched
Arrived 1 min. agoCapacity available, performance
Arriving in 2 mins.
Capacity available, performance
Framework – Examples of Incident Data D
OM
AIN
(& E
ntiti
es)
CIVILIAN POPULATION- Residential- Commuters
CRITICAL INFRASTR.-Water line
-Utility Repair-Public Bldgs.
-Road Network
GOVT. AGENCIES-Police Dept.-Police cars
-Fire Dept.-Fire Engines
-Hospitals-Ambulances
Modeling, simulation & visualization capabilities can be used to understand current and future impact and plan response
For LIFECYCLE PHASE:Response
INCIDENT: MAN-MADE
-NBC
-bom
b
-Con
vent
ional
bomb
-Fire
PRIVATE SECTOR- Hospital
![Page 33: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/33.jpg)
33
System Reference Architecture Concept
Source: An Integrated Gaming and Simulation Architecture for Incident Management Training, NISTIR 7295, March 2006
![Page 34: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/34.jpg)
34
M&S in Systems Engineering
![Page 35: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/35.jpg)
35
M&S in Systems Engineering (continued)
Source: “System Acquisition Manager’s Guide for the use of Models and Simulations”, Defense Systems Management College Press, Fort Belvoir, VA, 1994
The HW/SWIL simulations are often described as engineering level simulations. They typically consist of multiple classes of simulations. The HW/SWIL includes actualhardware and software, mathematical models,and external stimuli used together to demonstrate the capability of a system or subsystem to operate within an environment simulating actual conditions. A HW/SWIL simulation has proven to be an important tool in system development, test and operational support.
![Page 36: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/36.jpg)
36
M&S in Systems Engineering (continued)
Source: “Guidelines: Use of Modeling and Simulation (M&S) to Support Test and Evaluation (T&E)”, U. S. Army T&E Management Agency, Washington, DC, 2000
![Page 37: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/37.jpg)
37
Draft M&S Course OutlineWhat is a “Model”, “Simulation”, etc.?
How is M&S used for homeland security? National Infrastructure Simulation and Analysis Center (NISAC)National Atmospheric Release Advisory Center (NARAC)/ Inter-Agency Modeling and Atmospheric Analysis Center (IMAAC)Emerging Capabilities in DHS S&T Directorate
Who in DHS should consider using M&S?
When and where in DHS is M&S useful?
What are some considerations in acquiring M&S capabilities?EconomicsDevelopmentDataEvaluation
Why are M&S guidelines, standards, and “best practice” important for DHS?
How do other Federal agencies/organizations approach M&S?
![Page 38: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/38.jpg)
38
Economics of M&S
Source: Value Measuring Methodology: A How-to-Guide, Federal CIO Council, Best Practices Committee, 2004
![Page 39: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/39.jpg)
39
Development
![Page 40: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/40.jpg)
40
Development
![Page 41: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/41.jpg)
41
Data
System & Process Data
Input Data
Test Data
Output Data
DevelopingThe Model
OperatingThe Model
Verifying&Validating The Model
How Data Affects Modeling
Source: Applied Modeling and Simulation: An Integrated Approach to Development and Operation, David J. Cloud, Larry B. Rainy (editors), McGraw Hill, 1998
Source: A Discussion of Data Quality forVerification, Validation, and Certification, Jeff Rothenberg, Rand Corp., 1997
Source: The Office of Science Data-Management Challenge, Report from DOE Workshop, March – May 2004
![Page 42: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/42.jpg)
42
Data (continued)
![Page 43: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/43.jpg)
43
Evaluation‘All models are wrong, but some are useful.’
Source: Guide for Verification and Validation in Computational Solid Mechanics, ASME V&V 10-2006
Source: Guidelines for Model Evaluation, GAO PAD-79-17, 1979
Source: Box, G.E.P., Robustness in the strategy of Scientific Model Building, in Robustness in Statistics, R.L. Launer and G.N. Wilkinson, Editors. 1979, Academic Press: New York
![Page 44: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/44.jpg)
44
Draft M&S Course OutlineWhat is a “Model”, “Simulation”, etc.?
How is M&S used for homeland security? National Infrastructure Simulation and Analysis Center (NISAC)National Atmospheric Release Advisory Center (NARAC)/ Inter-Agency Modeling and Atmospheric Analysis Center (IMAAC)Emerging Capabilities in DHS S&T Directorate
Who in DHS should consider using M&S?
When and where in DHS is M&S useful?
What are some considerations in acquiring M&S capabilities?EconomicsDevelopmentDataEvaluation
Why are M&S guidelines, standards, and “best practice” important for DHS?
How do other Federal agencies/organizations approach M&S?
![Page 45: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/45.jpg)
45
Five Phases Model Development
1. Problem definition2. Preliminary Design3. Detail Design4. Evaluation5. Maintenance
Importance of Guidelines
![Page 46: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/46.jpg)
46
M&S is an integral tool to support the DHS mission. Guidelines should:
Enhance Decision Maker confidence in M&S resultsEnsure M&S results meet requirementsPromote integration and interoperability of toolsEnable private sector and commercial involvement in developing homeland security toolsPromulgate “best practice” from government and private sector experienceAdvance the maturity of M&S as a field of technology
Importance of Guidelines (continued)
![Page 47: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/47.jpg)
47
Importance of Guidelines (continued)
![Page 48: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/48.jpg)
48
Draft M&S Course OutlineWhat is a “Model”, “Simulation”, etc.?
How is M&S used for homeland security? National Infrastructure Simulation and Analysis Center (NISAC)National Atmospheric Release Advisory Center (NARAC)/ Inter-Agency Modeling and Atmospheric Analysis Center (IMAAC)Emerging Capabilities in DHS S&T Directorate
Who in DHS should consider using M&S?
When and where in DHS is M&S useful?
What are some considerations in acquiring M&S capabilities?EconomicsDevelopmentDataEvaluation
Why are M&S guidelines, standards, and “best practice” important for DHS?
How do other Federal agencies/organizations approach M&S?
![Page 49: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/49.jpg)
49
Some Federal Guidelines for M&S
XXUSGS
XXXNRC
XXNOAA
XXXNASA
XXXGAO
XXXFederal HighwayAdministration
XFDA
XXXEPA
XXXDOE/NNSA
XXXDoDUseEvaluationDevelopment
M&S Guideline or PolicyFederalActivity
![Page 50: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/50.jpg)
50
DoDObjectives• Provide necessary policy and guidance• Enhance the technical framework for M&S• Improve model and simulation capabilities• Improve model and simulation use• Shape the workforce
![Page 51: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/51.jpg)
51
DOE/NNSA
![Page 52: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/52.jpg)
52
EPA
![Page 53: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/53.jpg)
53
EPA
![Page 54: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/54.jpg)
54
GAO
![Page 55: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/55.jpg)
55
FHWA
![Page 56: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/56.jpg)
56
NASA
![Page 57: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/57.jpg)
57
NRC
![Page 58: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/58.jpg)
58
USGS
![Page 59: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/59.jpg)
![Page 60: S&T Stakeholders Conference · S&T Stakeholders Conference Dr ... IEEE Standard Glossary of Modeling and Simulation Terminology (IEEE STD ... One complete execution of the computer](https://reader034.fdocuments.in/reader034/viewer/2022042708/5ae0a1257f8b9a6e5c8da9ba/html5/thumbnails/60.jpg)
Back-Up Slides