Test innovation for everyone
description
Transcript of Test innovation for everyone
![Page 1: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/1.jpg)
Alan Page, Microsoft
Test Innovation for Everyone
www.eurostarconferences.com
@esconfs#esconfs
![Page 2: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/2.jpg)
Innovation
![Page 3: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/3.jpg)
Ideas
![Page 4: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/4.jpg)
TestInnovation
![Page 5: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/5.jpg)
TestIdeas
![Page 6: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/6.jpg)
I know quite certainly that I myself have no special talent. Curiosity, obsession and dogged endurance, combined with self-criticism, have brought me to my ideas.
![Page 7: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/7.jpg)
Ideas
![Page 8: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/8.jpg)
We don’t know where we get our ideas from. What we do know is that we do
not get them from our laptops.
![Page 9: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/9.jpg)
Ideas
Ideas
IdeasIdeas
Ideas
Ideas
Ideas
Ideas
Ideas
Ideas
Ideas
Ideas
![Page 10: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/10.jpg)
The Adjacent Possible
“The premise that innovation prospers
when ideas can serendipitously
connect and recombine with other
ideas”
![Page 11: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/11.jpg)
![Page 12: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/12.jpg)
Let’s Go Innovate!
![Page 13: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/13.jpg)
Let’s Solve a Problem
![Page 14: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/14.jpg)
What Problem Do We Need to Solve?
![Page 15: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/15.jpg)
How Can We Solve This Problem?
![Page 16: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/16.jpg)
Two kinds of problems…
![Page 17: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/17.jpg)
![Page 18: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/18.jpg)
![Page 19: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/19.jpg)
Optimizing Application Performance
![Page 20: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/20.jpg)
program.exe
![Page 21: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/21.jpg)
program.exe
![Page 22: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/22.jpg)
program.exe
![Page 23: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/23.jpg)
program.exe - coverage report
Function Total Blocks Blocks Covered
Foo 12 10Bar 16 8Baz 7 6Fizz 19 12
![Page 24: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/24.jpg)
New Tricks (for Old Testing Dogs)
![Page 25: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/25.jpg)
Code CoverageComponent Coverage
Fizz 70%
Buzz 62%
FizzBuzz 81%
![Page 26: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/26.jpg)
Code CoverageComponent Coverage
Fizz 70%
Buzz 62%
FizzBuzz 81%Blech!
![Page 27: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/27.jpg)
Code Coverage – take 2Test Selection
Component Tests
Fizz a,b,d,e,f,g,y
Buzz b,c,d,r,s,t
FizzBuzz a,b,d,e,f,r,t,u,v,z
![Page 28: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/28.jpg)
Test Pass Rate
Test This 90%
Test That 95%
Test the other thing 98%
Test Pass Rates
![Page 29: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/29.jpg)
Test Pass Rate
Test This 90%
Test That 95%
Test the other thing 98%
Test Pass Rates
What Does
This Tell You?
![Page 30: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/30.jpg)
Test History (Last 5) Bugs
Test This P, P, P, F, F 134, 157,154
Test That F, P, F, P, F 174
Test the other thing
P, P, P, P, P 132
Test Pass Rates
![Page 31: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/31.jpg)
![Page 32: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/32.jpg)
![Page 33: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/33.jpg)
500,000 Screens Reviewed
![Page 34: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/34.jpg)
4500 Unique Reviewers
![Page 35: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/35.jpg)
~5000Bugs Fixed
![Page 36: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/36.jpg)
![Page 37: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/37.jpg)
![Page 38: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/38.jpg)
“We now know a thousand ways not to build a light bulb”
![Page 39: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/39.jpg)
Making Innovation Happen
For You
![Page 40: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/40.jpg)
Know The Problem
Question The Problem
Fail at the Problem
See the (bigger)
Problem
![Page 41: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/41.jpg)
![Page 42: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/42.jpg)
The unit of progress for Lean Startups is validated learning - a rigorous method for demonstrating progress when one is embedded in the soil of extreme uncertainty
![Page 43: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/43.jpg)
![Page 44: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/44.jpg)
“The way to get good ideas is to get lots of ideas and throw the bad ones away”
- Linus Pauling
![Page 45: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/45.jpg)
![Page 46: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/46.jpg)
TestIdeas
![Page 47: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/47.jpg)
![Page 48: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/48.jpg)
User Groups
BlogsBooks
![Page 49: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/49.jpg)
If you have one person you’re influenced by, everyone will say you’re the next whoever. But if you rip off a hundred people, everyone will say you’re so original.
- Gary Panter
![Page 50: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/50.jpg)
![Page 51: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/51.jpg)
![Page 52: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/52.jpg)
http://angryweasel.com/bloghttp://twitter.com/alanpage
![Page 53: Test innovation for everyone](https://reader031.fdocuments.in/reader031/viewer/2022013101/555162f1b4c905e1708b52a2/html5/thumbnails/53.jpg)
Photo Credits
• Passport / safe slide– Some rights reserved by IceSabre (safe)– Some rights reserved by The Wide Wide World
(passports)– Some rights reserved by Samantha Decker (map)
• Microwave– Some rights reserved by samsungtomorrow
• Dead End– Some rights reserved by freefotouk
• Others are book covers or from Microsoft Clipart collection