EADS TEST & SERVICES
TS/EL/T N°08_04/08 Page 1© Copyright EADS TEST & SERVICES 2008
Engineering Process for Systems Engineering Process for Systems Testability Analysis.Testability Analysis.
Presentation of an Integrated Process
EADS TEST & SERVICES
© Copyright EADS TEST & SERVICES 2008TS/EL/T N°08_04/08 Page 2
Contents
The goal
The problems encountered
A Solution
The implementation
Synthesis - Conclusion
EADS TEST & SERVICES
© Copyright EADS TEST & SERVICES 2008TS/EL/T N°08_04/08 Page 3
Contents
The goal
The problems encountered
A Solution
The implementation
EADS TEST & SERVICES
© Copyright EADS TEST & SERVICES 2008TS/EL/T N°08_04/08 Page 4
What we want to achieve An Enhanced Testability & Diagnostics Modeling Process
to: Improved Fault Detection Confidence (FD)
Improved Fault Isolation to Optimum Repair Level (FI)
Reduced False Alarms / False Removals (FA)
Lower Mean Time To Isolate (MTTI)
Improved Safety Through Critical Fault Analysis (FMECA)
Improved System Availability
Reduced Cost of Ownership
EADS TEST & SERVICES
© Copyright EADS TEST & SERVICES 2008TS/EL/T N°08_04/08 Page 5
Contents
The goal
The problems encountered
A Solution
The implementation
EADS TEST & SERVICES
© Copyright EADS TEST & SERVICES 2008TS/EL/T N°08_04/08 Page 6
Reliability
Detection Rate Isolation Rate
Fault Coverage
Availability
Fault Detection Test
Fault Isolation Test
To reduce
Repair Time/Cost
Reliability Requirements
To reduce the number of failures
Maintainability Requirements
To Reduce Down Time
Testability
Diagnosability
Test DefinitionDiagnostic Development
FunctionalRedundancy
Test and Safety Process
Tests, BIT, BITE, Monitoring
effectiveness
SeverityCriticality
Safety Analysis
Safety
Safety Requirements
To limit risk
The missing link
SAFETY
Maintainability
Maintenance
Preventive Corrective Prognostics
EADS TEST & SERVICES
© Copyright EADS TEST & SERVICES 2008TS/EL/T N°08_04/08 Page 7
Engineering process without eXpress No testability milestone and the missing link.
Validation
Integrated Diagnostic
System Definition
Design Development
PreliminaryFMECA
CriticalFMECA
Test Definition Diagnostic Development
System FunctionalTest
Integration
Requirement DefinitionConcept
FD = 95%FI= 90% T1
Requirement AllocationFD + FI prediction
Only one validation task
Demonstration
Faults Injection
Maintenance Procedures
EADS TEST & SERVICES
© Copyright EADS TEST & SERVICES 2008TS/EL/T N°08_04/08 Page 8
Contents
The goal
The problems encountered
A Solution
The implementation
EADS TEST & SERVICES
© Copyright EADS TEST & SERVICES 2008TS/EL/T N°08_04/08 Page 9
Diagnostic Development
System Definition
Modeling Tests
Analysis BITE Software
versus Hard.
Modeling with Test.
CriticalFMECA
Test Definitionsbased on
Failure Modes
Validation
Integrated Diagnostic
Design Development
Test Definitionsbased on Function
PreliminaryFMECA
Modeling with Test
Test Strategy (Iteration)
Maintenance Procedures
System FunctionalTests.
Integration
Requirement AllocationsFD + FI prediction
Requirement DefinitionConcept
ConceptArchitectureValidationTestability
Diagnosability
FunctionalModeling
Maintenance Requirements
5 * Testability validation task
Demonstration
FD/FIDemonstration
Fault Injection
Model driven Engineering process Testability & Safety processes integrated
EADS TEST & SERVICES
© Copyright EADS TEST & SERVICES 2008TS/EL/T N°08_04/08 Page 10
The Integrated process between Safety & TestSafety: Building the Faults Catalog through the entire process,
combining Top-Down and Bottom Up approaches Top Down: From the early requirements down to the equipment
definition Bottom Up: From initial Validation up to Servicing the System
All new failure Modes found are integrated from each Test level.
Testability: Using the Faults Catalog through the entire process, combining Top-Down and Bottom Up approaches Top Down: From the early requirements down to the equipment
definition Bottom Up: The hierarchical Tests (BIT) roll-up to the highest level
definition and the Tests are Updated to the latest Fault Catalog.
EADS TEST & SERVICES
© Copyright EADS TEST & SERVICES 2008TS/EL/T N°08_04/08 Page 11
Testability Requirements
TestDefinition
The Integrated process between Safety & Testability Analysis
FunctionalSystemDesign
EquipmentsSpecifications
EquipmentDevelopment
SystemIntegration
FunctionalValidation
SystemIntegration
EquipmentsFunctionalValidation
EquipmentValidation
SystemSpecification
DiagnosticDevelopment
Safety Analysis
Safety Analysis
Diagnostic EnvironmentModeling phases
Integrated Diagnostic
Testability RequirementValidation
FMECAValidation
DiagnosticValidation
DiagnosticReport
FMECAValidation
DiagnosticValidation
DiagnosticReport
Hierarchical TestsDefinition In Service
EADS TEST & SERVICES
© Copyright EADS TEST & SERVICES 2008TS/EL/T N°08_04/08 Page 12
The goal
The problems encountered
A Solution
The implementation
Contents
EADS TEST & SERVICES
© Copyright EADS TEST & SERVICES 2008TS/EL/T N°08_04/08 Page 13
The Integrated Process Viewtoward a Software FrameworkSystem
Engineering
TestabilityDiagnosticDevelopers
TestEngineering
Test Operators
SystemDesign
DiagnosticModel
Development
Test StrategyDevelopment
TestStrategy
Execution
DiagnosticAnalysisFMECA
TestResultsAnalysis
TestResults
Collection
Saf
ety
Ana
lysi
sSafety
Analysis
EmbeddedDiagnostic
Level Support NTI1 O LevelNTI2 I Level
Production Operations
Support
The goal is to reduce the risk of appearance
of the critical loops
EADS TEST & SERVICES
© Copyright EADS TEST & SERVICES 2008TS/EL/T N°08_04/08 Page 14
Software Framework from Design to TestabilitySystem
Engineering
TestabilityDiagnosticDevelopers
TestEngineering
Test Operators
SystemDesign
DiagnosticModel
Development
Test StrategyDevelopment
TestStrategy
Execution
DiagnosticAnalysisFMECA
TestResultsAnalysis
TestResults
Collection
Saf
ety
Ana
lysi
sSafety
Analysis
EmbeddedDiagnostic
Level Support NTI1 O LevelNTI2 I Level
Production Operations
Support
EADS TEST & SERVICES
© Copyright EADS TEST & SERVICES 2008TS/EL/T N°08_04/08 Page 15
Software Framework from Design to Testability
TestEngineering
Safety Analysis Tool as SIMFIA can feed the Testability tool with:• the safety dependency model and the reliability data’s• the Failure Modes and Hierarchical Effects• the Severity
at the end of the Preliminary & critical FMECA
Testability Diagnostic Developers
eXpressTestabilityAnalysis
System Designers
SystemDesign
Safety Analysis Toolsex: EADS SIMFIA
FMECA
SafetyAnalysis
Diagnostic & FMECA
Analysis
EADS TEST & SERVICES
© Copyright EADS TEST & SERVICES 2008TS/EL/T N°08_04/08 Page 16
Software Framework fromDesign to Testability : Gateways
eXpress
EstudioPro
Cadence
Mentor
CAD / PC
EDAXML
ImportExcel
Safety AnalysisTools FMECA : Excel
Edif
Testability Diagnostic DevelopersSystem Designers
SafetyAnalysis
The CAD multi-schemas are merged through Estudio Pro and imported in eXpress as one Design. Igor Luvishis [[email protected]]
The Safety Analysis Tools as Relex, Item Software, RAMS are feeding the Testability tool through Tabular FMECA
EADS TEST & SERVICES
© Copyright EADS TEST & SERVICES 2008TS/EL/T N°08_04/08 Page 17
Software Framework from Testability to Test EngineeringSystem
Engineering
TestabilityDiagnosticDevelopers
TestEngineering
Test Operators
SystemDesign
DiagnosticModel
Development
Test StrategyDevelopment
TestStrategy
Execution
DiagnosticAnalysisFMECA
TestResultsAnalysis
TestResults
Collection
Saf
ety
Ana
lysi
sSafety
Analysis
EmbeddedDiagnostic
Level Support NTI1 O LevelNTI2 I Level
Production Operations
Support
EADS TEST & SERVICES
© Copyright EADS TEST & SERVICES 2008TS/EL/T N°08_04/08 Page 18
Software Framework from Testability to Test Engineering
eXpress
Testability/DiagnosticDevelopers
Test Engineering
Test Operators
DiagnosticModel
eXpress
DiagnosticAnalysisFMECA TRD
Test Requirement Documentation tool
Test StrategyImplementation
TPS Development
EADS Test & SERVICESSequencers
A Testability tool as eXpress is forwarding to the Test Sequencerefficient Test Strategies, for the target System, exporting:
• the UUT Description (hierarchical)• the Diagnostic Flow Diagram (Detection and Isolation) • the Test Attributes which can be enhanced with a tool like TRD• the global Diagnostic Information (Faults Group data).
DIAG-ML
EADS TEST & SERVICES
© Copyright EADS TEST & SERVICES 2008TS/EL/T N°08_04/08 Page 19
Software Framework from Test Engineering to TestSystem
EngineeringDiagnosticDevelopers
TestEngineering
Test Operators
SystemDesign
DiagnosticModel
Development
Test StrategyDevelopment
TestStrategy
Execution
DiagnosticAnalysisFMECA
TestResultsAnalysis
TestResults
Collection
Saf
ety
Ana
lysi
sSafety
Analysis
EmbeddedDiagnostic
Level Support NTI1 O LevelNTI2 I Level
Production Operations
Support
EADS TEST & SERVICES
© Copyright EADS TEST & SERVICES 2008TS/EL/T N°08_04/08 Page 20
Software Framework from Test Engineering to Test
EADS TEST & SERVICES Sequencers
Test Engineering Test Operators
Test StrategyImplementation
TestStrategy
Execution
TestResults
Collection
Production Operations
Support
UUT
Information Pipeline
A Framework integrating an ATML compatible Information Pipeline which goal is to reduce development time and maintenance costs by
facilitating information exchange based on XML Schemas description for information about
Test Station, Instrument, Test adaptor, Tests , Test results, UUT Diagnostic, Maintenance Information Collection and Analysis
Information Pipeline
EADS TEST & SERVICES
© Copyright EADS TEST & SERVICES 2008TS/EL/T N°08_04/08 Page 21
Software Framework from Test to In Service phaseSystem
EngineeringDiagnosticDevelopers
TestEngineering
Test Operators
SystemDesign
DiagnosticModel
Development
Test StrategyDevelopment
TestStrategy
Execution
DiagnosticAnalysisFMECA
TestResultsAnalysis
TestResults
Collection
Saf
ety
Ana
lysi
sSafety
Analysis
EmbeddedDiagnostic
Level Support NTI1 O LevelNTI2 I Level
Production Operations
Support
EADS TEST & SERVICES
© Copyright EADS TEST & SERVICES 2008TS/EL/T N°08_04/08 Page 22
Software Framework from Test to In Service phase
Test Operators Production Operations Support
EADS TEST & SERVICES Sequencer
TestStrategyExecution
TestResultsCollection
UUT
Level Support NTI1 O LevelNTI2 I Level
EmbeddedDiagnostic
A Visualization Interface Hierarchical Level IndicatorDiagnostic Flow DiagramHierarchical Graphical Models SchemaPanel displaying Test / Isolation Results
TestResultsAnalysis
Information Pipeline
EADS TEST & SERVICES
© Copyright EADS TEST & SERVICES 2008TS/EL/T N°08_04/08 Page 23
Software Framework Testability Requirements ValidationSystem
EngineeringDiagnosticDevelopers
TestEngineering
Test Operators
SystemDesign
DiagnosticModel
Development
Test StrategyDevelopment
TestStrategy
Execution
DiagnosticAnalysisFMECA
TestResultsAnalysis
TestResults
Collection
Saf
ety
Ana
lysi
sSafety
Analysis
EmbeddedDiagnostic
Level Support NTI1 O LevelNTI2 I Level
Production Operations
Support
EADS TEST & SERVICES
© Copyright EADS TEST & SERVICES 2008TS/EL/T N°08_04/08 Page 24
Software Framework Testability Requirements Validation
System Designers
DiagnosticDevelopers
Test Developers
Production OperationsSupport
EADS TEST & SERVICES Sequencer
eXpress
Diagnostic Model
Development
System Design
SafetyAnalysis
FMECA
TestResultsAnalysis
Failure Reporting, Analysis and Corrective Action System (FRACAS)
FRACAS Analysis tool
Learning from the critical loop
EADS TEST & SERVICES
© Copyright EADS TEST & SERVICES 2008TS/EL/T N°08_04/08 Page 25
The goal
The problems encountered
A Solution
The implementation
Synthesis - Conclusion
Contents
EADS TEST & SERVICES
© Copyright EADS TEST & SERVICES 2008TS/EL/T N°08_04/08 Page 26
SynthesisTestability tools allows
Development of diagnostic models using CAD/CAEE data Diagnostic Model Development and Diagnostic Analysis with
FMECA inputs through the V cycle Evaluation of diagnostic performance Generation of Diagnostic Test Strategies to be exported
EADS T&S sequencers allow Test Executive and Run-time execution using multiple test
environments Import Diagnostic Test Strategies and ATML XML format definition
SchemasValidation
Visualization of the Design and Diagnostic Test Strategies Results, RoEx information's
Model Information’s, Diagnostic Test Strategies from an extended DIAG-ML
EADS TEST & SERVICES
© Copyright EADS TEST & SERVICES 2008TS/EL/T N°08_04/08 Page 27
ConclusionThe integrated process allows
Coherence between Functional Schematics, FMECA, Tests and Diagnostics
Reduction of the total cost of ownership of the system
Improved traceability and Quality of Test Coverage (Detection/Isolation) and Test Results Analysis
An integrated process is possible in a software Framework including: eXpress EADS Test & Services tools
Top Related