How the Grinch Stole Software Testing

12
How the Grinch Stole How the Grinch Stole Testing Testing Noise, Noise, Noise! Noise, Noise, Noise!

description

Learn how to: § Permit static analysis rule exemptions under exceptional circumstances. § Know when it's time to disable or reconfigure a static analysis rule. § Exempt problematic files or code chunks from static analysis. § Design more robust regression tests. § Adopt a sustainable workflow for keeping tests in synch with the evolving application.

Transcript of How the Grinch Stole Software Testing

Page 1: How the Grinch Stole Software Testing

How the Grinch Stole How the Grinch Stole TestingTesting

Noise, Noise, Noise! Noise, Noise, Noise!

Page 2: How the Grinch Stole Software Testing

Open and hide your control panel

Join audio:•Choose “Mic & Speakers” to use VoIP•Choose “Telephone” and dial using the information provided

Submit questions and comments via the Questions panel

Note: Today’s presentation is being recorded and will be provided within 48 hours.

Your Participation

GoToWebinar Housekeeping

Page 3: How the Grinch Stole Software Testing

The Grinch didn’t think very much

of testing,In fact he found

the whole process un-resting.

The Grinch didn’t think very much

of testing,In fact he found

the whole process un-resting.

All the Noise Noise Noise

Page 4: How the Grinch Stole Software Testing

What is Noise?

Incorrect messages

Unhelpful messages

Irrelevant messages

Anything I don't need to hear

Anything I don't want to hear

Page 5: How the Grinch Stole Software Testing

Why is Testing Noisy?

Poor tools

Poor config

Poor strategy

Poor design

Poor policy

Page 6: How the Grinch Stole Software Testing

Test Design

Plan

Code review

Does the test prove my point?

Does failure pinpoint the problem?

Page 7: How the Grinch Stole Software Testing

Test Configuration

Testing code you won't change

Running tests you plan to fix "someday"

- someday will never come

Page 8: How the Grinch Stole Software Testing

Toning it Down

Suppressions

Unit test assertions

Static analysis

By file

By type

By age

By severity

Parasoft Proprietary and Confidential 8

Page 9: How the Grinch Stole Software Testing

Test Maintenance

Run regularly – Entropy Increases

Turn off low value to noise ratio tests

Keeping it clean is better than periodic mass cleaning

Page 10: How the Grinch Stole Software Testing

Relavence

Am I testing for things that are happening

QA results

Code reviews

field bugs

For things expected to happen?

Security

performance

Page 11: How the Grinch Stole Software Testing

Risk management

Will it happen?

Is it worth preventing?

Owasp top ten example

Page 12: How the Grinch Stole Software Testing

Q&A

Email

[email protected]

[email protected]

Blogs:

http://alm.parasoft.com

Social

Facebook: https://www.facebook.com/parasoftcorporation

Twitter: @Parasoft @MustRead4Dev

LinkedIn: http://www.linkedin.com/company/parasoft

Parasoft Proprietary and Confidential

Inspired by “How the Grinch Stole Christmas” by Doctor Seuss