System Requirements Traceability and System … · 1 Approved for Public Release, PAO #675-12, 24...
Transcript of System Requirements Traceability and System … · 1 Approved for Public Release, PAO #675-12, 24...
![Page 1: System Requirements Traceability and System … · 1 Approved for Public Release, PAO #675-12, 24 August 2012 120mm Tank Ammunition M395 APMI Accelerated Precision Mortar Initiative](https://reader036.fdocuments.in/reader036/viewer/2022062909/5b8a5f7f7f8b9ac1328c0822/html5/thumbnails/1.jpg)
1 Approved for Public Release, PAO #675-12,
24 August 2012 M395 APMI Accelerated Precision Mortar Initiative
PGK Precision Guidance Kit
Volcano Anti-Tank Mine 120mm Tank Ammunition
XM7 Spider Anti-Personnel Force Protection
120mm Tank Ammunition
ISAAS Individual Semi-Automatic
Airburst System
15th Annual Systems Engineering Conference Hyatt Regency Mission Bay San Diego, California 22-25 October 2012
System Requirements Traceability and System Verification Rigor and Planning
Approved for Public Release, PA 675-12, dated 24 August 2012
ISAAS Individual Semi-Automatic Airburst System
Joel Feigum Chief Engineer ATK Advanced Weapons
![Page 2: System Requirements Traceability and System … · 1 Approved for Public Release, PAO #675-12, 24 August 2012 120mm Tank Ammunition M395 APMI Accelerated Precision Mortar Initiative](https://reader036.fdocuments.in/reader036/viewer/2022062909/5b8a5f7f7f8b9ac1328c0822/html5/thumbnails/2.jpg)
2 Approved for Public Release, PAO #675-12,
24 August 2012
Agenda
Problem Statement
Program Summary
Process
Implementation Details
Conclusions
![Page 3: System Requirements Traceability and System … · 1 Approved for Public Release, PAO #675-12, 24 August 2012 120mm Tank Ammunition M395 APMI Accelerated Precision Mortar Initiative](https://reader036.fdocuments.in/reader036/viewer/2022062909/5b8a5f7f7f8b9ac1328c0822/html5/thumbnails/3.jpg)
3 Approved for Public Release, PAO #675-12,
24 August 2012
Problem Statement
Program Summary
Process
Implementation Details
Conclusions
![Page 4: System Requirements Traceability and System … · 1 Approved for Public Release, PAO #675-12, 24 August 2012 120mm Tank Ammunition M395 APMI Accelerated Precision Mortar Initiative](https://reader036.fdocuments.in/reader036/viewer/2022062909/5b8a5f7f7f8b9ac1328c0822/html5/thumbnails/4.jpg)
4 Approved for Public Release, PAO #675-12,
24 August, 2012
Problem Statement (The Perfect Storm)
• Aggressive schedules
• Limited funding
• Increased requirement complexity
• Performance, Environment and Testing
• Increased rigor in testing
• Increased testing complexity
• Multiple requirements 1 Test
• Multiple test 1 requirement
• Multifaceted program
• TD FOA-1
• TD EMD
• EMD FOA-2
Milestone C Decision
![Page 5: System Requirements Traceability and System … · 1 Approved for Public Release, PAO #675-12, 24 August 2012 120mm Tank Ammunition M395 APMI Accelerated Precision Mortar Initiative](https://reader036.fdocuments.in/reader036/viewer/2022062909/5b8a5f7f7f8b9ac1328c0822/html5/thumbnails/5.jpg)
5 Approved for Public Release, PAO #675-12,
24 August 2012
Problem Statement
Program Summary
Process
Implementation Details
Conclusions
![Page 6: System Requirements Traceability and System … · 1 Approved for Public Release, PAO #675-12, 24 August 2012 120mm Tank Ammunition M395 APMI Accelerated Precision Mortar Initiative](https://reader036.fdocuments.in/reader036/viewer/2022062909/5b8a5f7f7f8b9ac1328c0822/html5/thumbnails/6.jpg)
6 Approved for Public Release, PAO #675-12,
24 August 2012
Armor Piercing**
ISAAS System
TA/FC
Weapon
* Current Development
** Future Development
25mm Low
Velocity Ammo
High Explosive Air Bursting*
Training*
Non-lethal (Airburst)**
Door Breaching**
Non-Lethal (Blunt)**
Battery
![Page 7: System Requirements Traceability and System … · 1 Approved for Public Release, PAO #675-12, 24 August 2012 120mm Tank Ammunition M395 APMI Accelerated Precision Mortar Initiative](https://reader036.fdocuments.in/reader036/viewer/2022062909/5b8a5f7f7f8b9ac1328c0822/html5/thumbnails/7.jpg)
7 Approved for Public Release, PAO #675-12,
24 August 2012
ISAAS Con-Ops
![Page 8: System Requirements Traceability and System … · 1 Approved for Public Release, PAO #675-12, 24 August 2012 120mm Tank Ammunition M395 APMI Accelerated Precision Mortar Initiative](https://reader036.fdocuments.in/reader036/viewer/2022062909/5b8a5f7f7f8b9ac1328c0822/html5/thumbnails/8.jpg)
8 Approved for Public Release, PAO #675-12,
24 August 2012
Program Schedule
300 Series Ammo Test 400 Series System Test
500 Series Ammo Test 600 Series System Test
![Page 9: System Requirements Traceability and System … · 1 Approved for Public Release, PAO #675-12, 24 August 2012 120mm Tank Ammunition M395 APMI Accelerated Precision Mortar Initiative](https://reader036.fdocuments.in/reader036/viewer/2022062909/5b8a5f7f7f8b9ac1328c0822/html5/thumbnails/9.jpg)
9 Approved for Public Release, PAO #675-12,
24 August 2012
”
ISAAS is in Theater
Forward Operational Assessment (FOA) running in parallel with EMD program
![Page 10: System Requirements Traceability and System … · 1 Approved for Public Release, PAO #675-12, 24 August 2012 120mm Tank Ammunition M395 APMI Accelerated Precision Mortar Initiative](https://reader036.fdocuments.in/reader036/viewer/2022062909/5b8a5f7f7f8b9ac1328c0822/html5/thumbnails/10.jpg)
10 Approved for Public Release, PAO #675-12,
24 August 2012
Problem Statement
Program Summary
Process
Implementation Details
Conclusions
![Page 11: System Requirements Traceability and System … · 1 Approved for Public Release, PAO #675-12, 24 August 2012 120mm Tank Ammunition M395 APMI Accelerated Precision Mortar Initiative](https://reader036.fdocuments.in/reader036/viewer/2022062909/5b8a5f7f7f8b9ac1328c0822/html5/thumbnails/11.jpg)
11 Approved for Public Release, PAO #675-12,
24 August, 2012
Structured Requirements
Ammunition Software
Requirements Spec
28080041
Ammunition Software Design
Description
28082950
Supporting Documents
· MIL-A-2550
· MIL-P-9024
· MIL-F-13926
· MIL-PRF-71226 (AR)
· DOD-STD-100
· MIL-STD-129
· MIL-STD-130
· MIL-STD-171
· MIL-STD-331
· OMS/MP
· MIL-STD-461
· EMIL-STD-464C
· MIL-STD-709
· MIL-STD-794
· MIL-STD-810G
· MIL-STD-889
· MIL-STD-1168
· MIL-STD-1316
· MIL-STD-1472
· MIL-STD-1474D
· MIL-STD-2105
· FED-STD-595
· STANAG 4439
· MIL-HDBK-759, Notice 2
· MIL-HDBK-454A
· ITOP 4-2-602
· TOP 1-2-511
· TOP 3-2-045
Customer Requirement Documents
System Requirement Documents
Capability Development
Document (CDD)
Rev. 2.8
26 Oct 2010
CARDS #02092
Approved
29 January 2011
System Performance
Specification (SPS)
28077271
TA/FC Performance
Specification
28082807
Weapon Performance
Specification
28083265
Ammunition Performance
Specification
28083290
TA/FC / Weapon M-ICD
28082615
Weapon / Ammo M-ICD
28083592
TA/FC / Battery M-ICD
28077025
System Electrical ICD
28083249
User Interface ICD
28083250
Messaging IRS
28083356
Battery Performance
Specification
28084210
TA/FC Software Requirements
Spec
32419
TA/FC Software Design
Description
32420
![Page 12: System Requirements Traceability and System … · 1 Approved for Public Release, PAO #675-12, 24 August 2012 120mm Tank Ammunition M395 APMI Accelerated Precision Mortar Initiative](https://reader036.fdocuments.in/reader036/viewer/2022062909/5b8a5f7f7f8b9ac1328c0822/html5/thumbnails/12.jpg)
12 Approved for Public Release, PAO #675-12,
24 August, 2012
Requirement Decomposition
KPP / KSA System
Req’s
TA/FC
Req’s
Weapon
Req’s
Ammo
Req’s
KPP 1 - System Effectiveness 17 29 5 16
KPP 2 – Operational Availability 2 7 6 1
KSA 1 – Target Acquisition 2 4 0 0
KSA 2 - Reliability 3 3 2 1
KSA 3 – Degraded Operation 3 1 2 0
KSA 4 – Dispersion 1 0 2 2
KSA 5 – Engagement Time 10 27 6 14
KSA 6 – Zero Retention/Repeatability 3 3 4 0
• Understanding user requirements decomposition key to verification planning
• Focused test planning
• Customer/User focus
![Page 13: System Requirements Traceability and System … · 1 Approved for Public Release, PAO #675-12, 24 August 2012 120mm Tank Ammunition M395 APMI Accelerated Precision Mortar Initiative](https://reader036.fdocuments.in/reader036/viewer/2022062909/5b8a5f7f7f8b9ac1328c0822/html5/thumbnails/13.jpg)
13 Approved for Public Release, PAO #675-12,
24 August, 2012
Early Test Planning is Critical
• Process demonstrates the key activities required to verify requirements
• Requirements management tool used to tie the testing and requirements
• Test planning driven by SE tools and team
• Early involvement of the customer and government test facilities
• Harvest data from FOA activities
Customer
Requirements
Document
Conduct Voice of
the Customer
(VOC)
System Spec / ICD
Development
Conduct System
SRR/SFR
Develop Initial
Test Plans
Subsystem Spec /
ICD Development
Identify Test
Objectives and
TRD’s
Review
Preliminary RVM
Preliminary Design Conduct PDR
Test
Performance /
RVM Review
System
Requirements
Verification
Assessment
Customer
QualificationPRR / SVRConduct CDR
Update Contractor
Qual Test
Objectives and
TRD’s
Develop Detailed
Test Plans
Contractor Prove
out TestingMilestone C
Design Evaluation
Testing
Contractor
Qualification
Testing
![Page 14: System Requirements Traceability and System … · 1 Approved for Public Release, PAO #675-12, 24 August 2012 120mm Tank Ammunition M395 APMI Accelerated Precision Mortar Initiative](https://reader036.fdocuments.in/reader036/viewer/2022062909/5b8a5f7f7f8b9ac1328c0822/html5/thumbnails/14.jpg)
14 Approved for Public Release, PAO #675-12,
24 August 2012
Problem Statement
Program Summary
Process
Implementation Details
Conclusions
![Page 15: System Requirements Traceability and System … · 1 Approved for Public Release, PAO #675-12, 24 August 2012 120mm Tank Ammunition M395 APMI Accelerated Precision Mortar Initiative](https://reader036.fdocuments.in/reader036/viewer/2022062909/5b8a5f7f7f8b9ac1328c0822/html5/thumbnails/15.jpg)
15 Approved for Public Release, PAO #675-12,
24 August 2012
SE Tools Supports
Test objectives linked to tests
Requirements linked to test objectives and configuration item
![Page 16: System Requirements Traceability and System … · 1 Approved for Public Release, PAO #675-12, 24 August 2012 120mm Tank Ammunition M395 APMI Accelerated Precision Mortar Initiative](https://reader036.fdocuments.in/reader036/viewer/2022062909/5b8a5f7f7f8b9ac1328c0822/html5/thumbnails/16.jpg)
16 Approved for Public Release, PAO #675-12,
24 August 2012
Verification Identification
• Early identification of the “how to” during the verification process is critical to
ensuring program success
• Test planning
• Test objectives
• Success criteria
![Page 17: System Requirements Traceability and System … · 1 Approved for Public Release, PAO #675-12, 24 August 2012 120mm Tank Ammunition M395 APMI Accelerated Precision Mortar Initiative](https://reader036.fdocuments.in/reader036/viewer/2022062909/5b8a5f7f7f8b9ac1328c0822/html5/thumbnails/17.jpg)
17 Approved for Public Release, PAO #675-12,
24 August 2012
User Focused Verification Event Summary
CDD Requirement Test
30
0
Test
31
0
Test
33
0
Test
35
0
Test
37
0
Test
40
0
Test
40
5
Test
41
0
Test
41
2
Test
42
0
Test
42
2
Test
42
3
Test
42
4
Test
42
5
Ch
emic
al A
nal
ysis
Cle
anin
g D
em
on
stra
tio
n
Dra
win
g In
spec
tio
n
EMQ
RB
Re
sult
s
Go
vern
me
nt
Are
na
Test
ing
Hu
man
En
gin
eeri
ng
An
alys
is
Logi
stic
s A
nal
ysis
Logi
stic
s In
spec
tio
n
Mai
nte
nan
ce A
nal
ysis
Nu
cle
ar E
ven
t A
nal
ysis
Op
erat
ion
al A
vaila
bili
ty A
nal
ysis
Ph
ysic
al I
nsp
ecti
on
Pro
bab
ility
of
Inca
pac
itat
ion
An
alys
is
Re
cogn
itio
n A
nal
ysis
Re
liab
ility
An
alys
is
Tact
ical
Tra
nsp
ort
atio
n S
ho
ck A
nal
ysis
Tran
spo
rtat
ion
An
alys
is
KPP-1 X X X X X X X X
KPP-2 X X X X X
KSA-2 X
KSA-3 X X X
KSA-4 X X X X
KSA-5 X X X X
KSA-6 X X
APA-1 X
APA-2 X
APA-3 X
APA-4 X
APA-5 X
APA-6 X X
APA-7 X X X X X
APA-8 X X
APA-9 X X
APA-10 X
APA-11 X X
APA-12 X X X X
APA-13 X X X X X X X
APA-14
APA-15 X X X
APA-16 X X X
APA-17 X
APA-18 X
APA-19 X
![Page 18: System Requirements Traceability and System … · 1 Approved for Public Release, PAO #675-12, 24 August 2012 120mm Tank Ammunition M395 APMI Accelerated Precision Mortar Initiative](https://reader036.fdocuments.in/reader036/viewer/2022062909/5b8a5f7f7f8b9ac1328c0822/html5/thumbnails/18.jpg)
18 Approved for Public Release, PAO #675-12,
24 August 2012
Test Planning
![Page 19: System Requirements Traceability and System … · 1 Approved for Public Release, PAO #675-12, 24 August 2012 120mm Tank Ammunition M395 APMI Accelerated Precision Mortar Initiative](https://reader036.fdocuments.in/reader036/viewer/2022062909/5b8a5f7f7f8b9ac1328c0822/html5/thumbnails/19.jpg)
19 Approved for Public Release, PAO #675-12,
24 August 2012
Sample SE Tool Output
![Page 20: System Requirements Traceability and System … · 1 Approved for Public Release, PAO #675-12, 24 August 2012 120mm Tank Ammunition M395 APMI Accelerated Precision Mortar Initiative](https://reader036.fdocuments.in/reader036/viewer/2022062909/5b8a5f7f7f8b9ac1328c0822/html5/thumbnails/20.jpg)
20 Approved for Public Release, PAO #675-12,
24 August 2012
Problem Statement
Program Summary
Process
Implementation Details
Conclusions
![Page 21: System Requirements Traceability and System … · 1 Approved for Public Release, PAO #675-12, 24 August 2012 120mm Tank Ammunition M395 APMI Accelerated Precision Mortar Initiative](https://reader036.fdocuments.in/reader036/viewer/2022062909/5b8a5f7f7f8b9ac1328c0822/html5/thumbnails/21.jpg)
21 Approved for Public Release, PAO #675-12,
24 August 2012
Manage / Identify V&V Issues
• SE tool utilized to monitor V&V process and issues
• V&V updated immediately upon test completion
• Review results as appropriate
![Page 22: System Requirements Traceability and System … · 1 Approved for Public Release, PAO #675-12, 24 August 2012 120mm Tank Ammunition M395 APMI Accelerated Precision Mortar Initiative](https://reader036.fdocuments.in/reader036/viewer/2022062909/5b8a5f7f7f8b9ac1328c0822/html5/thumbnails/22.jpg)
22 Approved for Public Release, PAO #675-12,
24 August 2012
Verification Metrics
• Constant monitoring of verification activities against plans is critical to
ensuring success
![Page 23: System Requirements Traceability and System … · 1 Approved for Public Release, PAO #675-12, 24 August 2012 120mm Tank Ammunition M395 APMI Accelerated Precision Mortar Initiative](https://reader036.fdocuments.in/reader036/viewer/2022062909/5b8a5f7f7f8b9ac1328c0822/html5/thumbnails/23.jpg)
23 Approved for Public Release, PAO #675-12,
24 August 2012
Planned vs. Actual Objectives
0
50
100
150
200
250
300
350
400
450
Nu
mb
er
of
Ob
ject
ive
s
Verification Events Sorted by Scheduled Completion Date
Planned (Cumulative)
Actual (Cumulative)
Actual Passed (Cumulative)
Gap due to analysis efforts
and endurance testing
![Page 24: System Requirements Traceability and System … · 1 Approved for Public Release, PAO #675-12, 24 August 2012 120mm Tank Ammunition M395 APMI Accelerated Precision Mortar Initiative](https://reader036.fdocuments.in/reader036/viewer/2022062909/5b8a5f7f7f8b9ac1328c0822/html5/thumbnails/24.jpg)
24 Approved for Public Release, PAO #675-12,
24 August 2012
Conclusions
• Emphasis of System Engineering discipline throughout program life cycle
• Early collaboration and involvement of the test engineering
• System Engineering involvement in test planning and execution
• Early and constant monitoring of requirement V&V
• Metrics identification and tracking
• SE Tool usage is critical to tying it all together.
![Page 25: System Requirements Traceability and System … · 1 Approved for Public Release, PAO #675-12, 24 August 2012 120mm Tank Ammunition M395 APMI Accelerated Precision Mortar Initiative](https://reader036.fdocuments.in/reader036/viewer/2022062909/5b8a5f7f7f8b9ac1328c0822/html5/thumbnails/25.jpg)
25 Approved for Public Release, PAO #675-12,
24 August 2012
Acknowledgements
Special thanks to PM-IW:
• Rob Greenfield – SE LEAD
• Andy Cline – Product Director
Test support:
• Peter Ollis – ATC Test Lead
• Don Kukowski – ATK Test Lead
![Page 26: System Requirements Traceability and System … · 1 Approved for Public Release, PAO #675-12, 24 August 2012 120mm Tank Ammunition M395 APMI Accelerated Precision Mortar Initiative](https://reader036.fdocuments.in/reader036/viewer/2022062909/5b8a5f7f7f8b9ac1328c0822/html5/thumbnails/26.jpg)
26 Approved for Public Release, PAO #675-12,
24 August 2012
Contact information:
• Name: Joel Feigum
• Phone Number: 763-744-5127
• Company: ATK Advanced Weapons
Abstract ID Number: 14764