TMF2014 Testing Disruption-K Ross

18
9/05/14 1 1 Disruptive Forces In Testing Dr Kelvin Ross Australian Test Managers Forum, Sydney 8 May 2014 2 Disruptive Technology

description

Thank you Dr. Kelvin Ross for presenting at the Australian Test Managers Forum 2014. If you would like any information on TMF please email [email protected]

Transcript of TMF2014 Testing Disruption-K Ross

Page 1: TMF2014 Testing Disruption-K Ross

9/05/14

1

1

Disruptive Forces In Testing

Dr Kelvin Ross Australian Test Managers Forum, Sydney 8 May 2014

2

Disruptive Technology

Page 2: TMF2014 Testing Disruption-K Ross

9/05/14

2

3

Disruptive Technology

4

Disruptive Technology

Page 3: TMF2014 Testing Disruption-K Ross

9/05/14

3

5

Disruptive Technology

Biggest Disruptors The Last 5 Years? Agile

Offshoring Virtualisation

Page 4: TMF2014 Testing Disruption-K Ross

9/05/14

4

7

Disruptive Forces

Customer Testing

Dev Ops

“You can't just ask customers what they want and then try to give that to them. By the time you get it built, they'll want something new.”

Steve Jobs

Page 5: TMF2014 Testing Disruption-K Ross

9/05/14

5

9

FAIL FAST

10

Customer Testing

Page 6: TMF2014 Testing Disruption-K Ross

9/05/14

6

Secured $80m in VC funding

Applause!Testing In The Wild

Page 7: TMF2014 Testing Disruption-K Ross

9/05/14

7

Verification “Are we building the product right?”

Validation “Are we building the right product?”

Barry Boehm, 1979

Barry Boehm

Scientific Method for Customer Experiments

to Guide Software Development

Page 8: TMF2014 Testing Disruption-K Ross

9/05/14

8

15

Customer Testing

A / B Tests

Source: Advanced Topics in Continuous Deployment Mike Brittain,Engineering Director, Etsy @mikebrittain mikebrittain.com/talks E.g.“Google Analytics Content Experiments”

Page 9: TMF2014 Testing Disruption-K Ross

9/05/14

9

Source: Principles and Practices in Continuous Deployment Mike Brittain,Engineering Director, Etsy @mikebrittain mikebrittain.com/talks

Feature Toggles

Page 10: TMF2014 Testing Disruption-K Ross

9/05/14

10

Source: Advanced Topics in Continuous Deployment Mike Brittain,Engineering Director, Etsy @mikebrittain mikebrittain.com/talks

Feature Toggles

DEV OPS

Page 11: TMF2014 Testing Disruption-K Ross

9/05/14

11

21

No Silos

22

CI CD CD

Continuous Integration

Continuous Deployment

Continuous Delivery

Page 12: TMF2014 Testing Disruption-K Ross

9/05/14

12

Source: Principles and Practices in Continuous Deployment Mike Brittain,Engineering Director, Etsy @mikebrittain mikebrittain.com/talks

Rapid Releases

Page 13: TMF2014 Testing Disruption-K Ross

9/05/14

13

CD Platform

Source Control

Build System

Pipeline Management

& Visualization

Artifact/Package

Repository

Automated Configuration Management

(IaC)

Test infrastructure

Automated Deployment

System

Source: Continuous Delivery at Scale John Esser, Director Engineering Productivity, Ancestry.com ALM Forum Seattle, 2014

Git Flow

Page 14: TMF2014 Testing Disruption-K Ross

9/05/14

14

Source: Principles and Practices in Continuous Deployment Mike Brittain,Engineering Director, Etsy @mikebrittain mikebrittain.com/talks

Release Pipeline

Source: Steve Neely, [email protected] @stenvoon http://bit.ly/cdpaper ALM Forum Seattle, 2014

Release Pipeline

Page 15: TMF2014 Testing Disruption-K Ross

9/05/14

15

Source: Advanced Topics in Continuous Deployment Mike Brittain,Engineering Director, Etsy @mikebrittain mikebrittain.com/talks

Release Pipeline

Source: Principles and Practices in Continuous Deployment Mike Brittain,Engineering Director, Etsy @mikebrittain mikebrittain.com/talks

Release Pipeline

Page 16: TMF2014 Testing Disruption-K Ross

9/05/14

16

Page 17: TMF2014 Testing Disruption-K Ross

9/05/14

17

33

In 5 Years…

“Be a yardstick of quality. Some people aren't used to an environment where excellence is expected.”

Steve Jobs

Page 18: TMF2014 Testing Disruption-K Ross

9/05/14

18

35

Q&A