Research seminar 1. Dr. S. Vilkomir, Research directions in software testing.
description
Transcript of Research seminar 1. Dr. S. Vilkomir, Research directions in software testing.
![Page 1: Research seminar 1. Dr. S. Vilkomir, Research directions in software testing.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56814446550346895db0e37a/html5/thumbnails/1.jpg)
Research seminar
1. Dr. S. Vilkomir, Research directions in software testing.
2. Brandi Amstutz, Combinatorial Approach to Testing Mobile Applications: An Experimental Investigation.
Monday, October 28 2013
Room 232 S&T Bld. 1
![Page 2: Research seminar 1. Dr. S. Vilkomir, Research directions in software testing.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56814446550346895db0e37a/html5/thumbnails/2.jpg)
Research directions
in software testing
Dr. S. Vilkomir
![Page 3: Research seminar 1. Dr. S. Vilkomir, Research directions in software testing.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56814446550346895db0e37a/html5/thumbnails/3.jpg)
1. Effectiveness of combinatorial testing for logical expressions
2. Effectiveness of MC/DC
3. Testing mobile applications on different devices
![Page 4: Research seminar 1. Dr. S. Vilkomir, Research directions in software testing.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56814446550346895db0e37a/html5/thumbnails/4.jpg)
1. Effectiveness of combinatorial testing for logical expressions
Combinatorial testing:
• Each choice
• Base Choice
• Pair-wise
• t-way
![Page 5: Research seminar 1. Dr. S. Vilkomir, Research directions in software testing.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56814446550346895db0e37a/html5/thumbnails/5.jpg)
Pair-wise testing
–Dest: London, Paris, Chicago, NY
–M: 1000, 2000, 3000
–Direct: Y, N
Dest M Direct
t1 L 1 Y
t2 L 2 N
t3 L 3 -
t4 P 1 -
t5 P 2 Y
t6 P 3 N
t7 C 1 N
t8 C 2 -
t9 C 3 Y
t10 N 1 Y
t11 N 2 N
t12 N 3 -
Pair-WisePair-Wise: A value of each level for each factor must be combined : A value of each level for each factor must be combined with a value from every levels for each other factor.with a value from every levels for each other factor.
![Page 6: Research seminar 1. Dr. S. Vilkomir, Research directions in software testing.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56814446550346895db0e37a/html5/thumbnails/6.jpg)
Our results
• Fault Evaluator tool
http://core.ecu.edu/STRG/tools.html
• Four research papers:
• PSAM 10, Seattle, Washington, USA
• PIC-2010, Shanghai, China
• ICST 2012, Montreal, Canada
• ICSTW 2013,Luxembourg, Luxembourg
http://core.ecu.edu/STRG/publications.html
![Page 7: Research seminar 1. Dr. S. Vilkomir, Research directions in software testing.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56814446550346895db0e37a/html5/thumbnails/7.jpg)
New book
Introduction to Combinatorial Testing
by
D. Richard Kuhn,
Raghu N. Kacker, and
Yu Lei
![Page 8: Research seminar 1. Dr. S. Vilkomir, Research directions in software testing.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56814446550346895db0e37a/html5/thumbnails/8.jpg)
2. Effectiveness of MC/DC
• “Independent affect” is the main idea of Modified Condition/Decision Coverage (MC/DC)
• Suggested in 1992-1994 for avionic software
• DO-178B. Software Considerations in Airborne Systems and Equipment Certification. USA, 1992.
• Chilenski, J. and Miller, S. Software Engineering Journal, 1994
![Page 9: Research seminar 1. Dr. S. Vilkomir, Research directions in software testing.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56814446550346895db0e37a/html5/thumbnails/9.jpg)
Modified Condition/Decision Coverage
• Every point of entry and exit in the program has been invoked at least once, every condition in a decision in the program has taken on all possible outcomes at least once, every decision in the program has taken all possible outcomes at least once, and each condition in a decision has been shown to affect the decision's outcome independently.
A condition is shown to affect a decision's outcome independently by varying just that condition while holding fixed all other possible conditions.
From DO-178B.
9
3
1
2
![Page 10: Research seminar 1. Dr. S. Vilkomir, Research directions in software testing.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56814446550346895db0e37a/html5/thumbnails/10.jpg)
• Do these test cases satisfy MC/DC?– t1: <1, 0, 1> d= 1
– t2: <0, 1, 1> d= 1
– t3: <0, 1, 0> d= 0
– t4: <0, 0, 1> d= 0
• Holding conditions – OK• Affect the decision's outcome – OK• Answer: YES
d = A (B C)
Plans – to continue this research direction
![Page 11: Research seminar 1. Dr. S. Vilkomir, Research directions in software testing.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56814446550346895db0e37a/html5/thumbnails/11.jpg)
3. Testing mobile applications on different devices
Practical questions
![Page 12: Research seminar 1. Dr. S. Vilkomir, Research directions in software testing.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56814446550346895db0e37a/html5/thumbnails/12.jpg)
![Page 13: Research seminar 1. Dr. S. Vilkomir, Research directions in software testing.](https://reader035.fdocuments.in/reader035/viewer/2022062518/56814446550346895db0e37a/html5/thumbnails/13.jpg)
• No scientific approaches
• No justification
• Optimal set of devices?
• Our approach – next presentation