Testing SharePoint solutions overview
-
Upload
spiffy -
Category
Technology
-
view
3.463 -
download
2
description
Transcript of Testing SharePoint solutions overview
![Page 1: Testing SharePoint solutions overview](https://reader033.fdocuments.in/reader033/viewer/2022061216/54b389494a7959b5428b4836/html5/thumbnails/1.jpg)
Testing SharePoint SolutionsOverviewErvin LohVisual Studio ALM MVPK365Labs Sdn Bhd
Light Up SharePoint
![Page 2: Testing SharePoint solutions overview](https://reader033.fdocuments.in/reader033/viewer/2022061216/54b389494a7959b5428b4836/html5/thumbnails/2.jpg)
Presenter
Ervin LohProfile
Ervin Loh is currently the Application Lifecycle Management Program Manager at K365Labs Sdn Bhd. He works on a variety of Application Lifecycle Management, Software Configuration Management, and Lab Management products. He is also active in the IT community space by contributing contents to Microsoft Malaysia's START.NET and Ultimate program workshops and talks in conferences, events and user groups.
![Page 3: Testing SharePoint solutions overview](https://reader033.fdocuments.in/reader033/viewer/2022061216/54b389494a7959b5428b4836/html5/thumbnails/3.jpg)
ASP.NET Developers, SharePoint Developers
Target Audience
![Page 4: Testing SharePoint solutions overview](https://reader033.fdocuments.in/reader033/viewer/2022061216/54b389494a7959b5428b4836/html5/thumbnails/4.jpg)
Is this how you kill bugs?
![Page 5: Testing SharePoint solutions overview](https://reader033.fdocuments.in/reader033/viewer/2022061216/54b389494a7959b5428b4836/html5/thumbnails/5.jpg)
![Page 6: Testing SharePoint solutions overview](https://reader033.fdocuments.in/reader033/viewer/2022061216/54b389494a7959b5428b4836/html5/thumbnails/6.jpg)
![Page 7: Testing SharePoint solutions overview](https://reader033.fdocuments.in/reader033/viewer/2022061216/54b389494a7959b5428b4836/html5/thumbnails/7.jpg)
![Page 8: Testing SharePoint solutions overview](https://reader033.fdocuments.in/reader033/viewer/2022061216/54b389494a7959b5428b4836/html5/thumbnails/8.jpg)
An Unfortunately Common Scenario
− Developer writes code− Developer makes sure the code compiles− Developer checks in code− Repeat x15 developers for 4 weeks− Developer lead does a build of all code from
developers− Application is installed in test environment− Tester tries to test the application− Application doesn’t work− Developer blames tester
![Page 9: Testing SharePoint solutions overview](https://reader033.fdocuments.in/reader033/viewer/2022061216/54b389494a7959b5428b4836/html5/thumbnails/9.jpg)
The Demonstrations Scenario
− The Configurations− A fully configured Visual Studio 2010, Team Foundation
Server 2010, and SharePoint Server 2010 environment.− The Tasks
− A lot of tests.
![Page 10: Testing SharePoint solutions overview](https://reader033.fdocuments.in/reader033/viewer/2022061216/54b389494a7959b5428b4836/html5/thumbnails/10.jpg)
“we have a changed requirement, what do I need to test?”
Have you heard any of these?
“my testers are spending too long testing the same thing”
“tooling is expensive (time, licenses, people)”
“developers and testers work in silos and don’t communicate/speak the same language”
“when is my software ready to ship?”
“the developers say the defects are useless”
![Page 11: Testing SharePoint solutions overview](https://reader033.fdocuments.in/reader033/viewer/2022061216/54b389494a7959b5428b4836/html5/thumbnails/11.jpg)
What if you could…
reduce the time it takes to determine the root cause of a bug
enable users to easily run acceptance tests and track their results
reduce the time it takes to verify the status of a reported bug fix
reduce the time it takes to replicate a bug uncovered by user actions
reduce the time it takes to isolate differences between the test and production environment
![Page 12: Testing SharePoint solutions overview](https://reader033.fdocuments.in/reader033/viewer/2022061216/54b389494a7959b5428b4836/html5/thumbnails/12.jpg)
Generalist SpecialistManual Testing Some scripting
Creates scripts to set up lab, create data
Strong scripting skills
Some coding skills
Strong coding
Develops fully automated testing procedures
Expert coding skills
Where does testing happen?
Black Box Testing
White Box Testing
API Testing
70% of testing happens here
Majority of test tools target here
![Page 13: Testing SharePoint solutions overview](https://reader033.fdocuments.in/reader033/viewer/2022061216/54b389494a7959b5428b4836/html5/thumbnails/13.jpg)
Visual Studio 2010 Test Capabilities
Team Foundation Server Reporting
Web Test
Load Test
Coded UI Test
Unit Testing
Test Case Management
Lab Management
Microsoft Test Runner
Data Collectors (Historical Debugging, Test Impact, Metrics)
![Page 14: Testing SharePoint solutions overview](https://reader033.fdocuments.in/reader033/viewer/2022061216/54b389494a7959b5428b4836/html5/thumbnails/14.jpg)
Why is fixing bugs difficult?
− Insufficient information to reproduce− Not every step is documented− Can’t see exactly how the bug was triggered
− Different environments− OS, service packs, installed software,…− Creating a clean environment takes time
![Page 15: Testing SharePoint solutions overview](https://reader033.fdocuments.in/reader033/viewer/2022061216/54b389494a7959b5428b4836/html5/thumbnails/15.jpg)
Microsoft Test Manager 2010
− Plan, Manage and Execute (manual) tests from one place− Create test cases− Build test suites− Define configurations− Run test cases− File bugs into TFS
− Including captured data− Automate testing− Integrated with TFS
![Page 16: Testing SharePoint solutions overview](https://reader033.fdocuments.in/reader033/viewer/2022061216/54b389494a7959b5428b4836/html5/thumbnails/16.jpg)
VS Agents: Diagnostic Data Adapters
− Visual Studio Agents 2010− Separate download− Test Controller & Test Agents
− Capture data while testing− Save data with bug report
− Easy for developer to reproduce bug
Video CaptureSteps
PerformedSystem InfoIntelliTrace™
System Info
IntelliTrace™
![Page 17: Testing SharePoint solutions overview](https://reader033.fdocuments.in/reader033/viewer/2022061216/54b389494a7959b5428b4836/html5/thumbnails/17.jpg)
70%of all functional testing is still done manually.
![Page 18: Testing SharePoint solutions overview](https://reader033.fdocuments.in/reader033/viewer/2022061216/54b389494a7959b5428b4836/html5/thumbnails/18.jpg)
DemoFunctional Testing with Microsoft Test Manager
![Page 19: Testing SharePoint solutions overview](https://reader033.fdocuments.in/reader033/viewer/2022061216/54b389494a7959b5428b4836/html5/thumbnails/19.jpg)
Automated Testing for SharePoint
Web Performance Testing Load Testing Coded UI Testing Unit Testing
![Page 20: Testing SharePoint solutions overview](https://reader033.fdocuments.in/reader033/viewer/2022061216/54b389494a7959b5428b4836/html5/thumbnails/20.jpg)
Web Performance Testing
− Simulate a single use case− Internet Explorer Web Testing toolbar
− Records the user’s web requests− Important: This is not a UI test
− Validation Rules− Extraction Rules− Parameterized Tests− Data-Driven Tests
![Page 21: Testing SharePoint solutions overview](https://reader033.fdocuments.in/reader033/viewer/2022061216/54b389494a7959b5428b4836/html5/thumbnails/21.jpg)
Load Testing
− Stress-testing: simulate many users at once− Need multiple servers to create substantial load− Multiple agents generate load on the application− Single controller coordinates the agents and captures
data− PerfMon-style output
![Page 22: Testing SharePoint solutions overview](https://reader033.fdocuments.in/reader033/viewer/2022061216/54b389494a7959b5428b4836/html5/thumbnails/22.jpg)
Coded UI Testing
− Simulate a single use case− Uses a recording toolbar, like Web Performance test
− Records the user’s interaction with the UI− Generates code to reproduce that interaction− Code can be edited and customized at will
− Has some issues with SharePoint− e.g. no support for datasheets
− Visual Studio Feature Pack 2 adds support for Silverlight
![Page 23: Testing SharePoint solutions overview](https://reader033.fdocuments.in/reader033/viewer/2022061216/54b389494a7959b5428b4836/html5/thumbnails/23.jpg)
DemoAutomated Testing with Microsoft Visual Studio
![Page 24: Testing SharePoint solutions overview](https://reader033.fdocuments.in/reader033/viewer/2022061216/54b389494a7959b5428b4836/html5/thumbnails/24.jpg)
SharePoint Dashboards
![Page 25: Testing SharePoint solutions overview](https://reader033.fdocuments.in/reader033/viewer/2022061216/54b389494a7959b5428b4836/html5/thumbnails/25.jpg)
Are we making progress on running test plans?
How are our builds doing over time?
Are we fixing bugs?What’s the quality of our
bug fixes?
Ready to Ship?Are we ready to ship?
![Page 26: Testing SharePoint solutions overview](https://reader033.fdocuments.in/reader033/viewer/2022061216/54b389494a7959b5428b4836/html5/thumbnails/26.jpg)
DemoReporting
![Page 27: Testing SharePoint solutions overview](https://reader033.fdocuments.in/reader033/viewer/2022061216/54b389494a7959b5428b4836/html5/thumbnails/27.jpg)
![Page 28: Testing SharePoint solutions overview](https://reader033.fdocuments.in/reader033/viewer/2022061216/54b389494a7959b5428b4836/html5/thumbnails/28.jpg)
Resources
− Test Manager 2010 and Lab Manager− http://msdn.microsoft.com/en-us/library/ms182409.aspx− http://msdn.microsoft.com/en-us/library/dd997438.aspx
− Visual Studio 2010 Agents− http://www.microsoft.com/downloads/en/details.aspx?
FamilyID=a3216d2a-0530-4f6c-a7c9-0df37c54a902− Pex and Moles
− http://research.microsoft.com/en-us/projects/pex/default.aspx
![Page 29: Testing SharePoint solutions overview](https://reader033.fdocuments.in/reader033/viewer/2022061216/54b389494a7959b5428b4836/html5/thumbnails/29.jpg)
Questions?
![Page 30: Testing SharePoint solutions overview](https://reader033.fdocuments.in/reader033/viewer/2022061216/54b389494a7959b5428b4836/html5/thumbnails/30.jpg)
© 2011 Microsoft Corporation. All rights reserved. Microsoft, Visual Studio, the Visual Studio logo, and [list other trademarks referenced] are trademarks of the Microsoft group of companies.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond
to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation.
MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED, OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.