Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from...
Transcript of Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from...
![Page 1: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/1.jpg)
![Page 2: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/2.jpg)
![Page 3: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/3.jpg)
Test Automation
![Page 4: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/4.jpg)
generalist specialist
manual
testing
some
scripting
creates scripts
to set up lab,
create data
strong
scripting skills
some
coding skills
strong coding
develops fully
automated
testing
procedures
expert
coding skills
Tester Segmentation
black box testing
white box testing
api testing
70% of testing happens
here
majority of test tools
target here
![Page 5: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/5.jpg)
VS2013 Ultimate
![Page 6: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/6.jpg)
![Page 7: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/7.jpg)
Microsoft Test Manager
![Page 8: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/8.jpg)
iteration 1 iteration 2 release iteration
feature a feature b feature c feature d
unit
testing
manual
testing
regression
testing
performance
testing
feature a
![Page 9: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/9.jpg)
![Page 10: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/10.jpg)
![Page 11: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/11.jpg)
data adapter description
actions use to collect each UI action you perform as you run a test
(for client roles only)
asp.net client proxy for
intellitrace and testimpact
use for web applications when you select intellitrace or
testimpact for a server role (use on client to web server)
eventlog use to capture event log data (for client or server roles)
intellitrace use to collect exceptions and specific diagnostic tracing
information to help isolate bugs that are difficult to reproduce
(for client or server roles)
network emulation use to emulate slower networks when you run your tests (for
client or server roles)
system information use to collect system information for a machine (for client or
server roles)
test impact use to collect information that can help you decide which
tests to rerun based on changes made to an application for a
specific build (for client or server roles)
video recorder use to create a video recording of your desktop session while
you run a test (for client roles only)
![Page 12: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/12.jpg)
![Page 13: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/13.jpg)
Performance Profiling
Full feature profiling support
Hot Path: the list of functions that are doing the most work
Summary Timeline provides an overview of code performance
![Page 14: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/14.jpg)
Profiling Methods
•Gathers information at intervals (clock cycles)
•No code modifications
•Use this for first pass explorationsSampling
•Modifies your code
•Gathers detailed timing and count informationInstrumentation
•Multi-threaded code profilingConcurrency
•Object creation
•Garbage collection.NET Memory
•Interaction between your application and SQL Server via ADO.NETTier Interaction
![Page 15: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/15.jpg)
Tier Interactions
![Page 16: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/16.jpg)
![Page 17: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/17.jpg)
![Page 18: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/18.jpg)
![Page 19: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/19.jpg)
Web Performance Test?
![Page 20: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/20.jpg)
Load Modeling & Testing
![Page 21: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/21.jpg)
Load Modeling
![Page 22: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/22.jpg)
Data-driven
![Page 23: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/23.jpg)
![Page 24: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/24.jpg)
What are Load Tests?
![Page 25: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/25.jpg)
Two ways to run load tests
![Page 26: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/26.jpg)
![Page 27: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/27.jpg)
Load generated on-premises – traditional approach
Application under test
Visual Studio Test Controller
Test Agent
Report Data
Test Data
Performance Data
Test
Test
Test
SQL Server
Visual Studio Load Testing
![Page 28: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/28.jpg)
Application under test
Visual Studio Test Controller
Test Agent
Report Data
Test Data
Performance Data
Test
Test
Test
SQL Server
Load generated by agents in the cloud, controller on-premises
Visual Studio Load Testing with Azure
![Page 29: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/29.jpg)
Analysis & Extensibility
![Page 30: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/30.jpg)
![Page 31: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/31.jpg)
Team Foundation Server (TFS) Features
![Page 32: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/32.jpg)
![Page 33: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/33.jpg)
Email Alerts
![Page 34: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/34.jpg)
TFS Reporting
![Page 35: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/35.jpg)
Visual Studio Automated Testing
• Coded UI Test and Web
Performance / Load Test
• Generate code from action
recordings
• Replay and assert
• Extensible
• Integrated with Team
Foundation Server
• Bug Tracking
• Continuous, scheduled builds
and tests
![Page 36: Test Automation - CPTTM · •Coded UI Test and Web Performance / Load Test •Generate code from action recordings •Replay and assert •Extensible •Integrated with Team Foundation](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f758609eaf92124c11a9532/html5/thumbnails/36.jpg)
Summary