Functional Test Reporting Prateek Baheti

19
PRATEEK KUMAR BAHETI Functional Test Reporting: - Moving Beyond Test Percentage - The Anatomy of a good report

description

Presentation from vodQA Bangalore - Get Set Test

Transcript of Functional Test Reporting Prateek Baheti

Page 1: Functional Test Reporting Prateek Baheti

PRATEEK KUMAR BAHETI

Functional Test Reporting: - Moving Beyond Test Percentage - The Anatomy of a good report

Page 2: Functional Test Reporting Prateek Baheti

WRITING TESTS ANALYZING FAILURES

Page 3: Functional Test Reporting Prateek Baheti

Do You ???

• Have a separate team to analyze test failures

• Not have conclusive results to a test report analysis

• Constantly refer back to the environment while analyzing test reports

Page 4: Functional Test Reporting Prateek Baheti

Most Basic Test Report

Page 5: Functional Test Reporting Prateek Baheti

Slightly better ???

Page 6: Functional Test Reporting Prateek Baheti

A little more context !!!

Page 7: Functional Test Reporting Prateek Baheti

Greater Visibility

Page 8: Functional Test Reporting Prateek Baheti

Environment Information in report

Page 9: Functional Test Reporting Prateek Baheti

Data and Presentation

Page 10: Functional Test Reporting Prateek Baheti

A rigid report

Page 11: Functional Test Reporting Prateek Baheti

Analyzing features covered in tests.

Page 12: Functional Test Reporting Prateek Baheti

An example JSON data

Page 13: Functional Test Reporting Prateek Baheti

Analysis of your tests

Page 14: Functional Test Reporting Prateek Baheti

Link to project management tool

Page 15: Functional Test Reporting Prateek Baheti

Embed Video in report

Page 16: Functional Test Reporting Prateek Baheti

Trend analysis ???

0

20

40

60

80

100

120

1 2 3 4 5 6 7 8 9 10

Success rate

Success rate

Page 17: Functional Test Reporting Prateek Baheti

Tests are meant to check

REGRESSION

Page 18: Functional Test Reporting Prateek Baheti

Heat maps for tests

Page 19: Functional Test Reporting Prateek Baheti

Lets Summarize !!

• What does a good report need to have ?

• Data separated from presentation

• Analysis of test reports