Tongji University Shanghai — Software Testing | HELLOCARMS Project

48
Software Testing Final Presentation December 2012 - Tongji University Shanghai Team: Romain CAPOT Nicolas DANINO Jean-Luc PHAN Suresh RAJALINGAM

description

Tongji University Shanghai — Software Testing | HELLOCARMS Project This project was for our Software Testing courses at Tongji University in Shanghai, China. The case study is drawn from a real-life project, the HELLOCARMS project, a life insurance policy to cover the amount of a home equity loan. For this exercise we had to : - Develop a complete version of the prototype - Perform a risk analysis - Design functional and non-functional test suites based on the risk analysis - Design and create functional and non-functional tests based on the test suites - Create a decision table that shows the effect of the four health questions and the body mass index. - Translate the decision table into a cause-effect graph - Show the boundary values for body mass index and age - Create test cases to cover the decision table and the boundary values, keeping in mind the rules about testing non-exclusive rules - Estimate resource (time/effort) for testing the feature We did the presentation the 19th December 2012. You can find the prototype here : www.nicolasdanino.com/st Team : Romain CAPOT (EPITECH Paris 2014) Nicolas DANINO (EPITECH Paris 2014 - www.nicolasdanino.com) Jean-Luc PHAN (EPITECH Paris 2014) Suresh RAJALINGAM (EPITECH Paris 2014)

Transcript of Tongji University Shanghai — Software Testing | HELLOCARMS Project

Page 1: Tongji University Shanghai — Software Testing | HELLOCARMS Project

Software TestingFinal Presentation December 2012 - Tongji University Shanghai

Team:Romain CAPOTNicolas DANINOJean-Luc PHANSuresh RAJALINGAM

Page 2: Tongji University Shanghai — Software Testing | HELLOCARMS Project

Step 1the prototype

Page 4: Tongji University Shanghai — Software Testing | HELLOCARMS Project
Page 5: Tongji University Shanghai — Software Testing | HELLOCARMS Project
Page 6: Tongji University Shanghai — Software Testing | HELLOCARMS Project
Page 7: Tongji University Shanghai — Software Testing | HELLOCARMS Project

Step 2RISk ANALYSIS

Page 8: Tongji University Shanghai — Software Testing | HELLOCARMS Project

ID Quality Risk Likelihood Impact Risk Priority Extent of Testing

1 Bad  display  of  the  no0fica0on 3 5 15 Cursory

2 Data  are  not  saved  a;er  the  form  submission 4 3 12 Cursory

3 Bad  display  of  the  form  to  the  telephone  banker 3 4 12 Cursory

4 Timeout  of  the  session  occurs 5 2 10 Broad

5 Height  or  weight  is  out  of  limit 4 2 8 Broad

6 Bad  input  format  (not  numbers) 4 2 8 Broad

7 Bad  increase  of  the  percentage  to  the  base  premium 3 2 6 Broad

8 Could  not  enter  the  height  or  weight  values 3 2 6 Broad

9 Bad  calcula0on  of  the  BMI 4 1 4 Extensive

10 Bad  informa0on  entered  into  the  form 2 2 4 Extensive

11 Wrong  associa0on  between  BMI  and  age 4 1 4 Extensive

12 Bad  display  of  the  annual  rate 4 1 4 Extensive

13 Bad  calcula0on  of  the  annual  rate 4 1 4 Extensive

14 Authen0ca0on  problem 2 1 2 Extensive

15 Problem  with  submiQed  input  values 1 2 2 Extensive

16 Escape  strings 2 1 2 Extensive

17 No  internet  connexion 1 1 1 Extensive

Risk analysis of Hellocarms

Page 9: Tongji University Shanghai — Software Testing | HELLOCARMS Project

Step 3TEST SUITES

Page 10: Tongji University Shanghai — Software Testing | HELLOCARMS Project

ID Risk Test Suites

1 Bad calculation of the BMI Test three samples to check if the results are correct

2 Wrong association between BMI and age Test each case of the associated table (BMI/age)

3 Bad display of the annual rate Fill the form as a person who has a good health

4 Bad calculation of the annual rate Fill the form with precise values in order to get the expected result

5 Authentication problem Check your password and your login

6 Problem with submitted input values Check if the submitted values match with the result values

7 Check the network settings Try to exploit the vulnerability with escaped strings

8 No internet connexion Check the network settings

Test suites of Hellocarms

Page 11: Tongji University Shanghai — Software Testing | HELLOCARMS Project

ID Risk Test Suites

1 Bad calculation of the BMI Test three samples to check if the results are correct

2 Wrong association between BMI and age Test each case of the associated table (BMI/age)

3 Bad display of the annual rate Fill the form as a person who has a good health

4 Bad calculation of the annual rate Fill the form with precise values in order to get the expected result

5 Authentication problem Check your password and your login

6 Problem with submitted input values Check if the submitted values match with the result values

7 Check the network settings Try to exploit the vulnerability with escaped strings

8 No internet connexion Check the network settings

Test suites of Hellocarms

Page 12: Tongji University Shanghai — Software Testing | HELLOCARMS Project

ID Risk Test Suites

1 Bad calculation of the BMI Test three samples to check if the results are correct

2 Wrong association between BMI and age Test each case of the associated table (BMI/age)

3 Bad display of the annual rate Fill the form as a person who has a good health

4 Bad calculation of the annual rate Fill the form with precise values in order to get the expected result

5 Authentication problem Check your password and your login

6 Problem with submitted input values Check if the submitted values match with the result values

7 Check the network settings Try to exploit the vulnerability with escaped strings

8 No internet connexion Check the network settings

Test suites of Hellocarms

Page 13: Tongji University Shanghai — Software Testing | HELLOCARMS Project

ID Risk Test Suites

1 Bad calculation of the BMI Test three samples to check if the results are correct

2 Wrong association between BMI and age Test each case of the associated table (BMI/age)

3 Bad display of the annual rate Fill the form as a person who has a good health

4 Bad calculation of the annual rate Fill the form with precise values in order to get the expected result

5 Authentication problem Check your password and your login

6 Problem with submitted input values Check if the submitted values match with the result values

7 Check the network settings Try to exploit the vulnerability with escaped strings

8 No internet connexion Check the network settings

Test suites of Hellocarms

Page 14: Tongji University Shanghai — Software Testing | HELLOCARMS Project

ID Risk Test Suites

1 Bad calculation of the BMI Test three samples to check if the results are correct

2 Wrong association between BMI and age Test each case of the associated table (BMI/age)

3 Bad display of the annual rate Fill the form as a person who has a good health

4 Bad calculation of the annual rate Fill the form with precise values in order to get the expected result

5 Authentication problem Check your password and your login

6 Problem with submitted input values Check if the submitted values match with the result values

7 Check the network settings Try to exploit the vulnerability with escaped strings

8 No internet connexion Check the network settings

Test suites of Hellocarms

Page 15: Tongji University Shanghai — Software Testing | HELLOCARMS Project

ID Risk Test Suites

1 Bad calculation of the BMI Test three samples to check if the results are correct

2 Wrong association between BMI and age Test each case of the associated table (BMI/age)

3 Bad display of the annual rate Fill the form as a person who has a good health

4 Bad calculation of the annual rate Fill the form with precise values in order to get the expected result

5 Authentication problem Check your password and your login

6 Problem with submitted input values Check if the submitted values match with the result values

7 Check the network settings Try to exploit the vulnerability with escaped strings

8 No internet connexion Check the network settings

Test suites of Hellocarms

Page 16: Tongji University Shanghai — Software Testing | HELLOCARMS Project

ID Risk Test Suites

1 Bad calculation of the BMI Test three samples to check if the results are correct

2 Wrong association between BMI and age Test each case of the associated table (BMI/age)

3 Bad display of the annual rate Fill the form as a person who has a good health

4 Bad calculation of the annual rate Fill the form with precise values in order to get the expected result

5 Authentication problem Check your password and your login

6 Problem with submitted input values Check if the submitted values match with the result values

7 Escape strings Try to exploit the vulnerability with escaped strings

8 No internet connexion Check the network settings

Test suites of Hellocarms

Page 17: Tongji University Shanghai — Software Testing | HELLOCARMS Project

ID Risk Test Suites

1 Bad calculation of the BMI Test three samples to check if the results are correct

2 Wrong association between BMI and age Test each case of the associated table (BMI/age)

3 Bad display of the annual rate Fill the form as a person who has a good health

4 Bad calculation of the annual rate Fill the form with precise values in order to get the expected result

5 Authentication problem Check your password and your login

6 Problem with submitted input values Check if the submitted values match with the result values

7 Escape strings Try to exploit the vulnerability with escaped strings

8 No internet connexion Check the network settings

Test suites of Hellocarms

Page 18: Tongji University Shanghai — Software Testing | HELLOCARMS Project

ID Risk Test Suites

1 Bad calculation of the BMI Test three samples to check if the results are correct

2 Wrong association between BMI and age Test each case of the associated table (BMI/age)

3 Bad display of the annual rate Fill the form as a person who has a good health

4 Bad calculation of the annual rate Fill the form with precise values in order to get the expected result

5 Authentication problem Check your password and your login

6 Problem with submitted input values Check if the submitted values match with the result values

7 Check the network settings Try to exploit the vulnerability with escaped strings

8 No internet connexion Check the network settings

Test suites of Hellocarms

Page 19: Tongji University Shanghai — Software Testing | HELLOCARMS Project

Step 4DECISION TABLE

Page 20: Tongji University Shanghai — Software Testing | HELLOCARMS Project

CONDITIONS 1 2 3 4 5 6 7 8 9 10 11 12

Smoke?

Disabled?

Hospitalized ?

Diagnosed ?

BMI 34-36 34-36 34-36 37-39 37-39 37-39 <17 >39

Age 18-39 40-59 >59 18-39 40-59 >59

ACTIONS

Increase 50 % 50 % 50 % 50 % 75 % 50 % 25 % 100 % 75 % 50 %

Decline

Decision table

Page 21: Tongji University Shanghai — Software Testing | HELLOCARMS Project

CONDITIONS 1 2 3 4 5 6 7 8 9 10 11 12

Smoke?

Disabled?

Hospitalized ?

Diagnosed ?

BMI 34-36 34-36 34-36 37-39 37-39 37-39 <17 >39

Age 18-39 40-59 >59 18-39 40-59 >59

ACTIONS

Increase 50 % 50 % 50 % 50 % 75 % 50 % 25 % 100 % 75 % 50 %

Decline

Decision table

Page 22: Tongji University Shanghai — Software Testing | HELLOCARMS Project

CONDITIONS 1 2 3 4 5 6 7 8 9 10 11 12

Smoke?

Disabled?

Hospitalized ?

Diagnosed ?

BMI 34-36 34-36 34-36 37-39 37-39 37-39 <17 >39

Age 18-39 40-59 >59 18-39 40-59 >59

ACTIONS

Increase 50 % 50 % 50 % 50 % 75 % 50 % 25 % 100 % 75 % 50 %

Decline

Decision table

Page 23: Tongji University Shanghai — Software Testing | HELLOCARMS Project

Step 5cause-effect graph

Page 24: Tongji University Shanghai — Software Testing | HELLOCARMS Project

BMI 34-36

AGE 18-39

AGE 40-59

AGE >59

100%

Life insurrance cause-effect

75%

50%

25%

Page 25: Tongji University Shanghai — Software Testing | HELLOCARMS Project

BMI 34-36

AGE 18-39

AGE 40-59

AGE >59

100%

Life insurrance cause-effect

75%

50%

25%

Page 26: Tongji University Shanghai — Software Testing | HELLOCARMS Project

BMI 34-36

AGE 18-39

AGE 40-59

AGE >59

100%

Life insurrance cause-effect

75%

50%

25%

Page 27: Tongji University Shanghai — Software Testing | HELLOCARMS Project

BMI 34-36

AGE 18-39

AGE 40-59

AGE >59

100%

Life insurrance cause-effect

75%

50%

25%

Page 28: Tongji University Shanghai — Software Testing | HELLOCARMS Project

BMI 34-36

AGE 18-39

AGE 40-59

AGE >59

100%

Life insurrance cause-effect

75%

50%

25%

Page 29: Tongji University Shanghai — Software Testing | HELLOCARMS Project

BMI 37-39

AGE 18-39

AGE 40-59

AGE >59

100%

Life insurrance cause-effect

75%

50%

25%

Page 30: Tongji University Shanghai — Software Testing | HELLOCARMS Project

Smoked 50%

Life insurrance cause-effect

Page 31: Tongji University Shanghai — Software Testing | HELLOCARMS Project

Smoked

Diagnosed 50%

50%

Life insurrance cause-effect

Page 32: Tongji University Shanghai — Software Testing | HELLOCARMS Project

Diagnosed

Hospitalized

50%

50%

Life insurrance cause-effectSmoked 50%

Page 33: Tongji University Shanghai — Software Testing | HELLOCARMS Project

Hospitalized

Disabled

50%

50%

Life insurrance cause-effect

Diagnosed 50%

Smoked 50%

Page 34: Tongji University Shanghai — Software Testing | HELLOCARMS Project

BMI <17

Disabled 50%

Decline

Life insurrance cause-effect

Hospitalized 50%

Diagnosed 50%

Smoked 50%

Page 35: Tongji University Shanghai — Software Testing | HELLOCARMS Project

BMI <17

BMI >39

Decline

Decline

Life insurrance cause-effect

Disabled 50%

Hospitalized 50%

Diagnosed 50%

Smoked 50%

Page 36: Tongji University Shanghai — Software Testing | HELLOCARMS Project

Smoked

Diagnosed

Hospitalized

BMI <17

Disabled

BMI >39

50%

50%

50%

50%

Decline

Decline

Life insurrance cause-effect

Page 37: Tongji University Shanghai — Software Testing | HELLOCARMS Project

Step 5THE BOUNDARY VALUES

Page 38: Tongji University Shanghai — Software Testing | HELLOCARMS Project

The BMI boundary values

BMI 0 - 16 17 - 33 34 - 36 37 - 39 > 39

Boundary value Underweight No increase Increase(25% to 75%)

Increase(50% to 100%) Overweight

Page 39: Tongji University Shanghai — Software Testing | HELLOCARMS Project

The age boundary values

Age 0 - 17 18 - 39 40 - 59 > 59

Boundary value Minor Young Mid-age Senior

Page 40: Tongji University Shanghai — Software Testing | HELLOCARMS Project

Step 6Test cases

Page 41: Tongji University Shanghai — Software Testing | HELLOCARMS Project

The test casesCONDITIONS 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21

Smoked ? Y N N N N N N N N N N N N N N N Y N N N Y

Diagnosed ? N Y N N N N N N N N N N N N N N N Y N N Y

Hospitalized ? N N Y N N N N N N N N N N N N N N N Y N Y

disabled ? N N N Y N N N N N N N N N N N N N N N Y Y

BMI N/A N/A N/A N/A 34 36 34 36 35 37 39 38 39 < 17 > 39 25 35 34 29 37 35

Age N/A N/A N/A N/A 18 39 40 59 > 59 20 39 47 > 59 35 35 < 18 36 62 52 30 50

ACTIONS

Increase 1.5 1.5 1.5 1.5 1.8 1.8 1.5 1.5 1.25 2 2 1.8 1.5 N/A N/A N/A 2.6 1.9 1.5 3 7.6

Decline N N N N N N N N N N N N N Y Y Y N N N N N

Page 42: Tongji University Shanghai — Software Testing | HELLOCARMS Project

Step 7resource estimation

Page 43: Tongji University Shanghai — Software Testing | HELLOCARMS Project

Risks Found

Extensive Risks

Broad Risks

Cursory Risks

+9

+3

+5

17

Calculation of the total risk

Page 44: Tongji University Shanghai — Software Testing | HELLOCARMS Project

Risks Found 17

Time per Risk x 20 mins

Total Time (risks) ~6 hours

Total time for the risks

Margin + 20%

Page 45: Tongji University Shanghai — Software Testing | HELLOCARMS Project

Total test cases 21

Time per Risk x 10 mins

Total Time (cases) ~4 hours

Total time for cases

Margin + 20%

Page 46: Tongji University Shanghai — Software Testing | HELLOCARMS Project

+6 hoursTime (Risks)

+4 hours

Total 2 h 30 per Engineer (Total 10 hours)

Total time

Time (Cases)

Team /4 Engineer

Page 47: Tongji University Shanghai — Software Testing | HELLOCARMS Project

Resource estimation10 hours (2 h 30 per engineer)

Page 48: Tongji University Shanghai — Software Testing | HELLOCARMS Project

THANK YOUTh! End...