What is New in Visual Studio 11 for Testers
description
Transcript of What is New in Visual Studio 11 for Testers
![Page 1: What is New in Visual Studio 11 for Testers](https://reader035.fdocuments.in/reader035/viewer/2022062410/568160b2550346895dcfd5d6/html5/thumbnails/1.jpg)
What is New in Visual Studio 11 for Testers
Charles SterlingSenior Program Manager Microsoft Corporationhttp://blogs.msdn.com/visualstudioalm
GSJGD
![Page 2: What is New in Visual Studio 11 for Testers](https://reader035.fdocuments.in/reader035/viewer/2022062410/568160b2550346895dcfd5d6/html5/thumbnails/2.jpg)
Agenda
Review of what we delivered in Visual Studio 2010 + enhancements for Visual Studio 11
Paradigm Shift to Exploratory Testing
Enhancements in Lab Management
![Page 3: What is New in Visual Studio 11 for Testers](https://reader035.fdocuments.in/reader035/viewer/2022062410/568160b2550346895dcfd5d6/html5/thumbnails/3.jpg)
Microsoft Test Manager enhancements for Visual Studio 11
Huge Performance improvementsMulti Line Test CasesRich Text Test CasesTest Data ReductionSuite CopyingTest Case access from the Test RunnerMark Test Case Status directly in MTM (no need to launch the runner)Testing Metro ApplicationsEXPLORATORY TESTING!!!!!!!!!!
![Page 4: What is New in Visual Studio 11 for Testers](https://reader035.fdocuments.in/reader035/viewer/2022062410/568160b2550346895dcfd5d6/html5/thumbnails/4.jpg)
Demo
![Page 5: What is New in Visual Studio 11 for Testers](https://reader035.fdocuments.in/reader035/viewer/2022062410/568160b2550346895dcfd5d6/html5/thumbnails/5.jpg)
Agenda
Review of what we delivered in Visual Studio 2010 + enhancements for Visual Studio 11
Paradigm Shift to Exploratory Testing
Enhancements in Lab Management
![Page 6: What is New in Visual Studio 11 for Testers](https://reader035.fdocuments.in/reader035/viewer/2022062410/568160b2550346895dcfd5d6/html5/thumbnails/6.jpg)
The Agile Workflow
![Page 7: What is New in Visual Studio 11 for Testers](https://reader035.fdocuments.in/reader035/viewer/2022062410/568160b2550346895dcfd5d6/html5/thumbnails/7.jpg)
Why - Exploratory testing
Enables focusing customer value rather than spec complianceFree Testers from up front planning and find bugs fast and early without overheadFocuses on working software!
![Page 8: What is New in Visual Studio 11 for Testers](https://reader035.fdocuments.in/reader035/viewer/2022062410/568160b2550346895dcfd5d6/html5/thumbnails/8.jpg)
Exploratory testing – myths
1. Exploratory testing is ad-hoc, random testing2. There is no way to measure exploratory testing3. Bugs found through exploratory testing are hard
to repro
![Page 9: What is New in Visual Studio 11 for Testers](https://reader035.fdocuments.in/reader035/viewer/2022062410/568160b2550346895dcfd5d6/html5/thumbnails/9.jpg)
Using “Testing Tours” to put a method to the madness
Guidebook tour Back alley tour Supermodel tour You can make up your own…
![Page 10: What is New in Visual Studio 11 for Testers](https://reader035.fdocuments.in/reader035/viewer/2022062410/568160b2550346895dcfd5d6/html5/thumbnails/10.jpg)
Sample tours – how we did it
The Reflex tour – tests responsiveness of the IDE The Idiot tour – tests F1 inline help on each element The Palatial tour – tests our multi monitors experience The Footprint tour – tests virtual memory usage The Budget tour – tests experience on a low end machine
![Page 11: What is New in Visual Studio 11 for Testers](https://reader035.fdocuments.in/reader035/viewer/2022062410/568160b2550346895dcfd5d6/html5/thumbnails/11.jpg)
Measuring exploratory testing
Right metrics are like a fingerprint of your team: no silver bullet
Distinguish between app quality metrics and metrics that direct exploratory testing
![Page 12: What is New in Visual Studio 11 for Testers](https://reader035.fdocuments.in/reader035/viewer/2022062410/568160b2550346895dcfd5d6/html5/thumbnails/12.jpg)
Metrics – how we did it
Code coverage across toursStory complexity to bugs ratioSession duration for storiesSession roll up per tour
![Page 13: What is New in Visual Studio 11 for Testers](https://reader035.fdocuments.in/reader035/viewer/2022062410/568160b2550346895dcfd5d6/html5/thumbnails/13.jpg)
Heat maps – how we did it
![Page 14: What is New in Visual Studio 11 for Testers](https://reader035.fdocuments.in/reader035/viewer/2022062410/568160b2550346895dcfd5d6/html5/thumbnails/14.jpg)
Finding reproducible bugs
![Page 15: What is New in Visual Studio 11 for Testers](https://reader035.fdocuments.in/reader035/viewer/2022062410/568160b2550346895dcfd5d6/html5/thumbnails/15.jpg)
A couple of puzzles
How many software testers does it take to change a light bulb?None. Testers just noticed that the room was dark. Testers don't FIX bugs, they just find them.
How many developers does it take to change a light bulb?“What's the problem? The bulb at MY desk works fine!”
![Page 16: What is New in Visual Studio 11 for Testers](https://reader035.fdocuments.in/reader035/viewer/2022062410/568160b2550346895dcfd5d6/html5/thumbnails/16.jpg)
Rich bugs – how we did it
Automatic repro stepsScreenshotsDesktop recordingSystem information Intellitrace logs
![Page 17: What is New in Visual Studio 11 for Testers](https://reader035.fdocuments.in/reader035/viewer/2022062410/568160b2550346895dcfd5d6/html5/thumbnails/17.jpg)
Demo
![Page 18: What is New in Visual Studio 11 for Testers](https://reader035.fdocuments.in/reader035/viewer/2022062410/568160b2550346895dcfd5d6/html5/thumbnails/18.jpg)
Test documentation – how we did it
Test cases automatically created while doing exploratory testingCan save artifacts from exploration like expected imageWith each sprint, regression suites are automatically ready
![Page 19: What is New in Visual Studio 11 for Testers](https://reader035.fdocuments.in/reader035/viewer/2022062410/568160b2550346895dcfd5d6/html5/thumbnails/19.jpg)
Demo of Exploratory Testing
![Page 20: What is New in Visual Studio 11 for Testers](https://reader035.fdocuments.in/reader035/viewer/2022062410/568160b2550346895dcfd5d6/html5/thumbnails/20.jpg)
Agenda
Review of what we delivered in Visual Studio 2010 + enhancements for Visual Studio 11
Paradigm Shift to Exploratory Testing
Enhancements in Lab Management
![Page 21: What is New in Visual Studio 11 for Testers](https://reader035.fdocuments.in/reader035/viewer/2022062410/568160b2550346895dcfd5d6/html5/thumbnails/21.jpg)
Lab Management Enhancements for Visual Studio 11
Use physical infrastructure Zero Configuration Support for clustered Hyper-V hosts Scale to 1000’s of VMs Scale by cloning VMs via Network Isolation New Environment viewer Deploy using deployment scripts Full support SCVMM 2012
![Page 22: What is New in Visual Studio 11 for Testers](https://reader035.fdocuments.in/reader035/viewer/2022062410/568160b2550346895dcfd5d6/html5/thumbnails/22.jpg)
http://blogs.msdn.com/anutthara http://twitter.com/anutthara
Q&A
Please fill the feedback forms!