Digital System Models - Massachusetts Institute of...
Transcript of Digital System Models - Massachusetts Institute of...
![Page 1: Digital System Models - Massachusetts Institute of …seari.mit.edu/documents/presentations/CSER16_Reid_MIT.pdfDigital System Models: An Investigation of the Non-Technical Challenges](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0ec5f57e708231d440de30/html5/thumbnails/1.jpg)
Digital System Models: An Investigation of the Non-Technical Challenges
and Research Needs
Jack B. Reid and Donna H. Rhodes
14th Annual Conference on Systems Engineering Research
March 22-24, 2016
Von Braun Center
Huntsville, Alabama
![Page 2: Digital System Models - Massachusetts Institute of …seari.mit.edu/documents/presentations/CSER16_Reid_MIT.pdfDigital System Models: An Investigation of the Non-Technical Challenges](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0ec5f57e708231d440de30/html5/thumbnails/2.jpg)
Motivation
• Non-technical challenges have not been
investigated to the extent of technical ones
• Exploration of the topic intended to raise
awareness of non-technical challenges
– Focus on intellectual property and knowledge
assessment
• Paper provides some illustrative examples of
possible ways forward and seeks suggestions for
additional ideas and research
seari.mit.edu © 2016 Massachusetts Institute of Technology 2
Not to suggest that vision for digital system models is critically flawed
Not to suggest that all of the challenges are easily overcome
![Page 3: Digital System Models - Massachusetts Institute of …seari.mit.edu/documents/presentations/CSER16_Reid_MIT.pdfDigital System Models: An Investigation of the Non-Technical Challenges](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0ec5f57e708231d440de30/html5/thumbnails/3.jpg)
seari.mit.edu © 2016 Massachusetts Institute of Technology 3
Digital Thread (DTh), Digital Twin (DTw), and
Digital System Model (DSM)
![Page 4: Digital System Models - Massachusetts Institute of …seari.mit.edu/documents/presentations/CSER16_Reid_MIT.pdfDigital System Models: An Investigation of the Non-Technical Challenges](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0ec5f57e708231d440de30/html5/thumbnails/4.jpg)
Overview of Intent
seari.mit.edu 4
(Zimmerman, MBSE, 2015)
© 2016 Massachusetts Institute of Technology
![Page 5: Digital System Models - Massachusetts Institute of …seari.mit.edu/documents/presentations/CSER16_Reid_MIT.pdfDigital System Models: An Investigation of the Non-Technical Challenges](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0ec5f57e708231d440de30/html5/thumbnails/5.jpg)
Digital Twin
seari.mit.edu 5© 2016 Massachusetts Institute of Technology
• Integrated model of an as-built system
• Updated to reflect changes to system
• Used to predict performance and required
maintenance
(Glaessgen, 2012)
![Page 6: Digital System Models - Massachusetts Institute of …seari.mit.edu/documents/presentations/CSER16_Reid_MIT.pdfDigital System Models: An Investigation of the Non-Technical Challenges](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0ec5f57e708231d440de30/html5/thumbnails/6.jpg)
Digital System Model and
Digital Thread
Digital System Model
• Concrete, integrated
model
• “A digital representation
of a defense system”
– (Zimmerman, MBSE, 2015)
Primary focus of this
investigation
Digital Thread
• The “enterprise-level
analytical framework…
based on the DSM”
• Term for the general
design and acquisition
process that uses a DSM
seari.mit.edu 6© 2016 Massachusetts Institute of Technology
![Page 7: Digital System Models - Massachusetts Institute of …seari.mit.edu/documents/presentations/CSER16_Reid_MIT.pdfDigital System Models: An Investigation of the Non-Technical Challenges](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0ec5f57e708231d440de30/html5/thumbnails/7.jpg)
DSM Challenges
seari.mit.edu 7
Obstacles in a variety of fields need to be overcome
• Computational processing
power (West, 2015)
• Model integration software
• Model precision & accuracy
• Change log upkeep
• Protection of intellectual
property
• Cybersecurity
• Inter-model comparisons
• Acceptance by stakeholders
These challenges will not be addressed
by technical solutions alone.
© 2016 Massachusetts Institute of Technology
![Page 8: Digital System Models - Massachusetts Institute of …seari.mit.edu/documents/presentations/CSER16_Reid_MIT.pdfDigital System Models: An Investigation of the Non-Technical Challenges](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0ec5f57e708231d440de30/html5/thumbnails/8.jpg)
seari.mit.edu © 2016 Massachusetts Institute of Technology 8
Intellectual Property
![Page 9: Digital System Models - Massachusetts Institute of …seari.mit.edu/documents/presentations/CSER16_Reid_MIT.pdfDigital System Models: An Investigation of the Non-Technical Challenges](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0ec5f57e708231d440de30/html5/thumbnails/9.jpg)
Intellectual Property (IP)
Concerns
DSM seeks to integrate all “authoritative
data and associated artifacts”
• IP is valuable
– Would firms share?
– Who owns IP and at what stages?
• Cybersecurity
– The better the DSM is, the more enticing
a target
– The more locked down, the harder to use
seari.mit.edu © 2016 Massachusetts Institute of Technology 9
![Page 10: Digital System Models - Massachusetts Institute of …seari.mit.edu/documents/presentations/CSER16_Reid_MIT.pdfDigital System Models: An Investigation of the Non-Technical Challenges](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0ec5f57e708231d440de30/html5/thumbnails/10.jpg)
IP Protection Tools
seari.mit.edu © 2016 Massachusetts Institute of Technology 10
Trade SecretsCopyrightPatents
• Could protect jointly
developed technologies
• Requires publication
(contrary to
classification
requirements)
• Primarily useful for
protecting structure of
DSM (modeling
packages, data
exchange methods,
computational devices)
• Not as useful for
specific designs,
experimental data, etc.
• Limited application to
DSM
• Can protect specific
software packages
• Cannot protect
technical underpinnings
of software packages
• Cannot protect
experimental data
• DSM will require
sharing between firms
(unless DoD is sole
holder of DSM)
• NDAs are commonly
used tool
• Time-consumptive
• Limitations on
enforceability
• Excessive NDA use
could limit reusability of
project materials
![Page 11: Digital System Models - Massachusetts Institute of …seari.mit.edu/documents/presentations/CSER16_Reid_MIT.pdfDigital System Models: An Investigation of the Non-Technical Challenges](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0ec5f57e708231d440de30/html5/thumbnails/11.jpg)
Comparison:
FDA Sentinel Initiative
seari.mit.edu © 2016 Massachusetts Institute of Technology 11
(OMP, 2010)
![Page 12: Digital System Models - Massachusetts Institute of …seari.mit.edu/documents/presentations/CSER16_Reid_MIT.pdfDigital System Models: An Investigation of the Non-Technical Challenges](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0ec5f57e708231d440de30/html5/thumbnails/12.jpg)
Comparison:
FDA Sentinel Initiative
• HIPAA restrictions on sharing similar to
firms wanting to protect IP
• Decentralized system
– Treat modeling software and models
generated as black boxes
– Could protect IP of firms involved with DSM
seari.mit.edu © 2016 Massachusetts Institute of Technology 12
Component 1
Model
Component 2
Model
Component 3
Model
DSM
![Page 13: Digital System Models - Massachusetts Institute of …seari.mit.edu/documents/presentations/CSER16_Reid_MIT.pdfDigital System Models: An Investigation of the Non-Technical Challenges](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0ec5f57e708231d440de30/html5/thumbnails/13.jpg)
seari.mit.edu © 2016 Massachusetts Institute of Technology 13
Knowledge Assessment
Knowledge assessment (KA) is defined in this context as the assignment
of validity to any particular piece of information or expertise.
![Page 14: Digital System Models - Massachusetts Institute of …seari.mit.edu/documents/presentations/CSER16_Reid_MIT.pdfDigital System Models: An Investigation of the Non-Technical Challenges](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0ec5f57e708231d440de30/html5/thumbnails/14.jpg)
Generating Digital Model Buy-In
• Trust and Willingness
• Access to examples, assumptions, methods,
proof
– DoD Metadata Registry
– DoD Modeling & Simulation Catalog
• Visualization: Not just aesthetics
– Can affect risk aversion, ability to negotiate,
willingness to use a tool, etc. (Park, 2007)
– If no standard exists, differences can cause
misinterpretations of data
seari.mit.edu © 2016 Massachusetts Institute of Technology 14
![Page 15: Digital System Models - Massachusetts Institute of …seari.mit.edu/documents/presentations/CSER16_Reid_MIT.pdfDigital System Models: An Investigation of the Non-Technical Challenges](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0ec5f57e708231d440de30/html5/thumbnails/15.jpg)
seari.mit.edu © 2016 Massachusetts Institute of Technology 15
Potential DSM Structures
![Page 16: Digital System Models - Massachusetts Institute of …seari.mit.edu/documents/presentations/CSER16_Reid_MIT.pdfDigital System Models: An Investigation of the Non-Technical Challenges](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0ec5f57e708231d440de30/html5/thumbnails/16.jpg)
Model Package Development
seari.mit.edu © 2016 Massachusetts Institute of Technology 16
Pros Cons
DoD
Developed
Reduces IP disputes
Can maintain access
Eliminates inter-model
comparisons
Based on CREATE (Kraft, 2015)
Does not utilize industry
expertise
Requires DoD to maintain and
update
Heterogeneous,
Privately-
Developed
Fully leverages competitive
industry
Minimizes DoD effort
Does not resolve IP disputes
directly
Requires inter-model
comparison
Potential lack of continued
access
Homogenous,
Privately-
Developed
Reduces IP disputes
Partially leverages industry
Reduces DoD effort
Eliminates inter-model
comparisons
Introduces miniature
monopolies
Potential lack of continued
access
Does not minimize DoD effort
![Page 17: Digital System Models - Massachusetts Institute of …seari.mit.edu/documents/presentations/CSER16_Reid_MIT.pdfDigital System Models: An Investigation of the Non-Technical Challenges](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0ec5f57e708231d440de30/html5/thumbnails/17.jpg)
Model Use
seari.mit.edu © 2016 Massachusetts Institute of Technology 17
Pros Cons
Centralized –
Single Copy
Reduces security risk Difficulty in updating
Hampers iterative design
Centralized –
Multiple Copies
Allows for iterative design Few firms can host full DSM
Increases security risk
Does not address IP disputes
Requires syncing
Distributed
Reduces IP disputes
Allows for iterative design
Requires transition to centralized
during hand-off to DoD
Potentially technically difficult
Increases simulation-run times
Increases security risk
![Page 18: Digital System Models - Massachusetts Institute of …seari.mit.edu/documents/presentations/CSER16_Reid_MIT.pdfDigital System Models: An Investigation of the Non-Technical Challenges](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0ec5f57e708231d440de30/html5/thumbnails/18.jpg)
Discussion
• Additional investigation and consideration of non-technical
challenges is important
• New technological tools may give us additional ways of addressing
these non-technical issues
• DoD has to play multiple roles in the development of DSM
1. Customer: Financial incentive
2. Standards Enforcer: Regulatory incentive
3. Neutral Mediator: A non-competing party with whom information can be shared
• Other potential DSM structures need to be explored and compared
seari.mit.edu 18
Some of the decisions made regarding these non-technical issues can
profoundly impact the technical aspects of DSM
© 2016 Massachusetts Institute of Technology
![Page 19: Digital System Models - Massachusetts Institute of …seari.mit.edu/documents/presentations/CSER16_Reid_MIT.pdfDigital System Models: An Investigation of the Non-Technical Challenges](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0ec5f57e708231d440de30/html5/thumbnails/19.jpg)
References
seari.mit.edu 19
Zimmerman, P. (2015). MBSE in the Department of Defense. Washington, DC: Office of the
Deputy Assistant Secretary of Defense for Systems Engineering (ODASD[SE])
Glaessgen, E.H., Stargel, D.S. (2012). The Digital Twin Paradigm for Future NASA and U.S.
Air Force Vehicles. Honolulu, HA: 53rd Structures, Structural Dynamics and Materials
Conference
West, T.D., Pyster, A. (2015). Untangling the Digital Thread: The Challenge and Promise of
Model-Based Engineering in Defense Acquisition. INSIGHT, 18, 45-55.
Office of Medical Policy (OMP). (2010). The Sentinel Initiative: A Progress Report. White
Oak, MD: U.S. Food and Drug Administration, Center for Drug Evaluation and
Research (FDA CDER).
Park, S., Rothrok, L. (2007). Systematic analysis of framing bias in missile defense:
Implications towards visualization design. European Journal of Operational Research,
182, 1383-1398.
Kraft, E.M. (2015). HPCMP CREATE TM-AV and the Air Force Digital Thread. AIAA SciTech.
.
© 2016 Massachusetts Institute of Technology
![Page 20: Digital System Models - Massachusetts Institute of …seari.mit.edu/documents/presentations/CSER16_Reid_MIT.pdfDigital System Models: An Investigation of the Non-Technical Challenges](https://reader033.fdocuments.in/reader033/viewer/2022052723/5f0ec5f57e708231d440de30/html5/thumbnails/20.jpg)
Questions?
seari.mit.edu 20© 2016 Massachusetts Institute of Technology
This material is based upon work supported, in whole or in part, by the U.S. Department
of Defense through the Systems Engineering Research Center (SERC) under Contract
HQ0034-13-D-0004. SERC is a federally funded University Affiliated Research Center
managed by Stevens Institute of Technology. Any opinions, findings and conclusions or
recommendations expressed in this material are those of the authors and do not
necessarily reflect the views of the United States Department of Defense.