Simulations and Testing 12
30
Validation and Evaluation SIMULATIONS AND TESTING Univesity of Konstanz By Waleed Abrar Prof. Dr. Stefan Leue... Florian Leitner-Fischer May 28, 2014 Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
-
Upload
waleed-abrar -
Category
Documents
-
view
45 -
download
0
description
Description in report
Transcript of Simulations and Testing 12
-
Validation and Evaluation
SIMULATIONS AND TESTINGUnivesity of Konstanz
By Waleed Abrar
Prof. Dr. Stefan Leue... Florian Leitner-Fischer
May 28, 2014
Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
-
Validation and Evaluation
Toadys Agenda
1 Validation and Evaluation
2 SimulationMethodologyLimitation for Cyberphysical Systems
3 Test Motivation
4 Test Procedures
5 Evaluation of test pattern and style robustness
6 Design for testability
7 BILBO
8 Conclusion
Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
-
Validation and EvaluationSimulation
Test Motivation
Agenda
1 Validation and Evaluation
2 SimulationMethodologyLimitation for Cyberphysical Systems
3 Test Motivation
4 Test Procedures
5 Evaluation of test pattern and style robustness
6 Design for testability
7 BILBO
8 Conclusion
Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
-
Validation and EvaluationSimulation
Test Motivation
Validation
Purpose
Check rather a certain design is appropriate and meet all therequirements.
Validation Using mathematical model is called formalverification.
Problem
No single Validation technique exist thats applicable to avalidation problem.
Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
-
Validation and EvaluationSimulation
Test Motivation
Evaluation
Purpose
Its the process of Computing quantitative information of somekey characteristics or design
Key Characteristic
1 Average Performance.
2 Worst case Performance.
3 Energy power Consumption.
4 Temperature /Thermal Behaviour. . . .
Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
-
Validation and EvaluationSimulation
Test Motivation
MethodologyLimitation for Cyberphysical Systems
Agenda
1 Validation and Evaluation
2 SimulationMethodologyLimitation for Cyberphysical Systems
3 Test Motivation
4 Test Procedures
5 Evaluation of test pattern and style robustness
6 Design for testability
7 BILBO
8 Conclusion
Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
-
Validation and EvaluationSimulation
Test Motivation
MethodologyLimitation for Cyberphysical Systems
Methodology
Process
Very common technique for evaluation and validation
Consist of executing a design model on appropriate computinghardware,typically on general purpose system (PC)
Abstraction levels
System Level.
Algorithm Level.
Instruction Level.
Register Level.
Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
-
Validation and EvaluationSimulation
Test Motivation
MethodologyLimitation for Cyberphysical Systems
Limitation for Cyberphysical Systems
Lot slower than the actually modelled.
Simulation in the physical environment may be dangerous.
Huge data and variable consideration during simulation.
Fast Simulation are less accurate.
Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
-
SimulationTest MotivationTest Procedures
Agenda
1 Validation and Evaluation
2 SimulationMethodologyLimitation for Cyberphysical Systems
3 Test Motivation
4 Test Procedures
5 Evaluation of test pattern and style robustness
6 Design for testability
7 BILBO
8 Conclusion
Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
-
SimulationTest MotivationTest Procedures
Purpose
Process
The main theme of testing is to make sure that a manufacturedembedded system behave as intended.
Reasons for testing embedded systems
Integrated into Physical environment, thereforemalfunctioning is much more dangerous
Functional as well as non functional testing is really important.
Testing Cyber physical system in environment is dangerous.
Testing should be done after design but could be done earlieras well.
Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
-
SimulationTest MotivationTest Procedures
Flow for testing
Figure: Overview of the testing in normal scenario[1]
Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
-
Test MotivationTest Procedures
Evaluation of test pattern and style robustness
Agenda
1 Validation and Evaluation
2 SimulationMethodologyLimitation for Cyberphysical Systems
3 Test Motivation
4 Test Procedures
5 Evaluation of test pattern and style robustness
6 Design for testability
7 BILBO
8 Conclusion
Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
-
Test MotivationTest Procedures
Evaluation of test pattern and style robustness
Pattern Generation for the gate level model
working
Identify the pattern that distinguishes a correctly working systemfrom an incorrect working system
Struck at fault model
any wire of an electronic circuit is permanently connected with 0 or1 exception is CMOS technologies
Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
-
Test MotivationTest Procedures
Evaluation of test pattern and style robustness
Pattern Generation for the gate level model
Figure: Checking function f if there is struck at-1 fault [1]
Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
-
Test MotivationTest Procedures
Evaluation of test pattern and style robustness
Self-testing program
Reasons
Key problem of testing integrated circuit is their limited number ofpins and secondly the tester should be as fast as the circuit.
Figure: Processor helping test programs[1]
Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
-
Test ProceduresEvaluation of test pattern and style robustness
Design for testability
Agenda
1 Validation and Evaluation
2 SimulationMethodologyLimitation for Cyberphysical Systems
3 Test Motivation
4 Test Procedures
5 Evaluation of test pattern and style robustness
6 Design for testability
7 BILBO
8 Conclusion
Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
-
Test ProceduresEvaluation of test pattern and style robustness
Design for testability
Fault Coverage
Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
-
Test ProceduresEvaluation of test pattern and style robustness
Design for testability
fault Simulation
Details
It is not feasible to completely predict the behaviour of the systemso fault simulation is used and ,and the properties are adjusted,such like to mimic that the system was having a fault
Problem
Fault simulation is time consuming so parallel fault simulation areused
Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
-
Test ProceduresEvaluation of test pattern and style robustness
Design for testability
fault Simulation diagram
Figure:http://cdnc.itec.kit.edu/downloads/06FaultS imulation.pdf @M.Tahoori2010
Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
-
Test ProceduresEvaluation of test pattern and style robustness
Design for testability
Fault injection
Fault Simulation is time consuming if actual system isavailable then fault injection is used
It can generate faults that cant be predicted by other faultmodel
Two types of fault injection.-local fault in system.-Environmental fault.
Methods used for fault injection
Hardware Level(toggling pins)
Software Level(toggling Memory bits)
Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
-
Evaluation of test pattern and style robustnessDesign for testability
BILBO
Agenda
1 Validation and Evaluation
2 SimulationMethodologyLimitation for Cyberphysical Systems
3 Test Motivation
4 Test Procedures
5 Evaluation of test pattern and style robustness
6 Design for testability
7 BILBO
8 Conclusion
Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
-
Evaluation of test pattern and style robustnessDesign for testability
BILBO
Design for testability
-Motivation-Scan Design-Signature Analysis-Pseudo-random test-pattern generation
Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
-
Evaluation of test pattern and style robustnessDesign for testability
BILBO
Scan Design
Figure: Flip flop connected to form a serial shift register [1]
Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
-
Evaluation of test pattern and style robustnessDesign for testability
BILBO
Signature Analysis
Figure: Checking function f if there is struck at-1 fault [1]
Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
-
Evaluation of test pattern and style robustnessDesign for testability
BILBO
Pseudo-random test-pattern generation
Figure: Checking function f if there is struck at-1 fault [1]
Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
-
Design for testabilityBILBO
Conclusion
Agenda
1 Validation and Evaluation
2 SimulationMethodologyLimitation for Cyberphysical Systems
3 Test Motivation
4 Test Procedures
5 Evaluation of test pattern and style robustness
6 Design for testability
7 BILBO
8 Conclusion
Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
-
Design for testabilityBILBO
Conclusion
Built in Logic block observer
Figure: Picture explain combining of two approches[1]
Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
-
Design for testabilityBILBO
Conclusion
Agenda
1 Validation and Evaluation
2 SimulationMethodologyLimitation for Cyberphysical Systems
3 Test Motivation
4 Test Procedures
5 Evaluation of test pattern and style robustness
6 Design for testability
7 BILBO
8 Conclusion
Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
-
Design for testabilityBILBO
Conclusion
Conclusions
Conclusions
Testing increases cost for the system ,the level of the testing andthe coverage is also and important factor in determining the cost,mechanism that reduces this cost are of great importance forcompanies.
Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
-
Design for testabilityBILBO
Conclusion
Thank You[1] These are the notes from the given chapter of the book for presentation 5.6 and 8
Prof. Dr. Stefan Leue... Florian Leitner-Fischer SIMULATIONS AND TESTING
Validation and EvaluationSimulationMethodologyLimitation for Cyberphysical Systems
Test MotivationTest ProceduresEvaluation of test pattern and style robustnessDesign for testabilityBILBOConclusion
