Mike Lyles , Jay Philips and Rex Black

The Good, The Bad and The Metrics

About XBOSoft

• Founded in 2006

• Dedicated to software quality• Software QA consulting• Software testing services

• Offices in San Francisco, Beijing, Oslo and Amsterdam

From XBOSoft

• Amy • Jan

Housekeeping• Everyone except the speakers is muted

• Questions via the gotowebinar control on the right side of your screen

• Questions can be asked throughout the webinar, we’ll try to fit them in when appropriate

• General Q & A at the end of the webinar

• You will receive info on recording after the webinar

THE GOOD, THE BAD, AND THE METRICS

An XBOSoft Webinarwith

Mike Lyles, Jay Philips, & Rex BlackDecember 17, 2013

11am-12pm EST

About the Speakers

Rex Black - President of RBCS. His popular first book, Managing the Testing Process, has sold over 50,000 copies around the world, and is now in its third edition. His ten other books on testing have also sold tens of thousands of copies. Rex is the past President of the International Software Testing Qualifications Board and of the American Software Testing Qualifications Board.

Jay Philips - CEO & President of Project Realms, Inc. an IT consulting firm focusing on software quality. Jay is also the CEO & President of TeamQualityPro, which is a real-time integrated dashboard platform used to evaluate the entire ecosystem of application projects and resources. TeamQualityPro is code agnostic so all organizations can implement a real-time executive dashboard system.

Mike Lyles - Sr. QA Manager with 20+ years of IT experience.  His current role is over Performance testing, Automation testing, and Service Virtualization for all business communities within his organization.   Mike enjoys teaching others in the testing profession.  He has spoken at multiple conferences on testing, and has written multiple published articles. 

What is Your Story?

Has your organization ever considered replacing a tester that did not write, for example, 15 test cases per day?

Is the testing team blamed if defect leakage is greater than 5% into production?

What drives decisions like these? The common thread in these examples is “Test Metrics”

What is Your Opinion?

Everyone has an opinion… Some believe they are the most valuable way to

communicate the results of testing

Some think that they are useless, misleading, and damaging to the communication of test results

Some believe that without measurement you are not managing the effort. And some believe that bad metrics are worse than no metrics at all.

Where Does Your Organization Fit in the Metrics Debates?

Is your team aligned? Do you agree with the team?

Do you use a reporting process for test results?

Are you forced to report on metrics you don't believe are valuable?

Do you have dozens of metrics that you are reporting periodically that no one looks at, and when they do look at them, there is room for misinterpretation?

Topics for the Panel

1. Top metrics that are misused or misunderstood

2. Best metrics that everyone should use

3. Worst metrics that you should avoid or remove

4. Tools and processes that can help your organization better measure your testing

Discussion Topic #1

What metrics do you see in the industry that are

predominantly being misused or misunderstood by

organizations?

EXAMPLE – Misused/Misunderstood

Discussion Topic #2

What are the top metrics that you would suggest for any

organization to use? What are the most common?

EXAMPLE – Suggested Metrics

Discussion Topic #3

What are metrics that organizations should avoid and/or discontinue using?

EXAMPLE – Metrics to Avoid

Discussion Topic #4

What tools and/or processes can best assist organizations

in delivering meaningful, accurate, and quality metrics?

EXAMPLE – Dashboard 1

EXAMPLE – Dashboard 2

Closing Thoughts

Visit our Sites!Scan The Codes!

Rex Blackhttp://www.rbcs-us.com@RBCS

Jay Philipshttp://www.projectrealms.comhttp://teamqualitypro.com@jayphilips, @ProjectRealms,@TeamQualityPro

Mike Lyleshttp://www.mikewlyles.com@mikelyles

Thank you for attending

Follow us: @XBOSoftQuestions : services@xbosoft.com