How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & CloudBees
23
1 How To Use Jenkins for Continuous Load Testing and Mobile Test Automation Webinar and Present Introducing performance and functional automation early with Continuous Integration
Transcript of How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & CloudBees
1
How To Use Jenkins for Continuous Load Testing and Mobile Test Automation
Webinar
andPresent
Introducing performance and functional automation early with Continuous Integration
2
CI Gets More TestingIn This Webinar
TODAY’S PRESENTERS
Andy Pemberton: CloudBees, Sr. Dir. Solution ArchitectureMike Ostenberg: SOASTA, Dir. Solutions EngineeringBrad Johnson: SOASTA, VP Product
TWO COMPANIES, A SINGLE SOLUTION
- the leader in Mobile and Cloud Testing
- the Jenkins Enterprise company
Together, we offer a complete cloud-based service:
Continuous Delivery for Web & Mobile
@apemberton
@bradjohnsonsv
3
Agenda
• Achieving (even) more test coverage with Jenkins• Utilizing cloud in development and test• CloudBees and Jenkins• From Continuous Integration to Continuous Delivery• CI with SOASTA CloudTest (load) and TouchTest
(mobile)
Questions: Submit in the question box during event
4
TestingThe Legacy of….WAIT
UtUnit
Testing
FtFunctional
Testing
Development Testing Operations
PtPerformance
Testing
MoMonitoring
Legacy Approach: Silos and waiting
TIME
5
Eliminating Delays Compresses TimeEnabling more testing to be done earlier and more often
UtUnit
Testing
FtFunctional
Testing
Testing
PtPerformance
Testing
MoMonitoring
Legacy Approach: Silos and waiting
Agile Approach: Automation and Continuous Testing
OperationsDevelopment
Dev OpsTesting
TIME
6
Continuous Integration BlueprintGartner models “Shift Left” for testing
* Source: Gartner, “Blueprint for Adding Continuous Integration as a Start to Your Continuous Delivery Process” Sean Kenefick, Aug 25, 2014
Traditionally later-stage testing!
Perf & mobile testing plugins enhance value across delivery cycle
7
Poll Question
8
CloudBees and JenkinsFrom Continuous Integration to Continuous
Delivery
Andy Pemberton
@apemberton
o#1 OSS CI server
oWritten in Java
oHighly Extensible
oFounded ~2005
oEasy to install / use
oExtensible via 1000+ plugins
oWidely adopted
o 80K+ installations
oCloudBees knows Jenkins
oOn-premise, cloud and hybrid
oExpert support
oEnterprise plugins
Have you met Jenkins?
o Jenkins founder, Kohsuke Kawaguchi, CloudBees CTO
oWe optimize Jenkins for the enterprise
o Jenkins Operations Center
o Jenkins OSS Support
oEnterprise-class plugins
oCommit code and support the Jenkins Community
o Jenkins training and consulting
o Jenkins User Conferences (JUC) and newsletters
o…we are the Jenkins Enterprise experts!
CloudBees
CloudBees Jenkins Products
On-Premise In the Cloud Hybrid
No matter how you use Jenkins
Jenkins Enterprise by CloudBees
Jenkins Operations Centerby CloudBees
DEV@cloud DEV@cloudHybrid
Jenkins: the Hub of Continuous Delivery
Source Code
Binaries
Quality Analysis Functional Test
Performance / Load Test
Production
Jenkins: the Hub of Continuous Delivery
Source Code
Binaries
Quality Analysis Functional Test
Performance / Load Test
Production
o“Survival is not mandatory (nor is adopting DevOps)”
o Gene Kim, Wall Street Journal - CIO Journal DevOps piece
oSeek out opportunities for automation - testing is an ideal first step
oLoad, functional, and mobile testing have been challenging…
DevOps is a Journey
http://blogs.wsj.com/cio/2014/05/22/enterprise-devops-adoption-isnt-mandatory-but-neither-is-survival/
8x more frequent releases
8000x faster release process
2x higher releases success
12x faster defect fixes
DevOps
15
Mike Ostenberg
Building your tests and automating with Jenkins
16
CI Mobile Application Func & Perf Testing
o Demo:
• Creating a quick functional test in TouchTest
• Creating a quick performance test in CloudTest
• Running Load and Performance Tests from Jenkins:
• Play TouchTest/CloudTest tests from Jenkins
• Setting Thresholds to automatically alert on poor performance
• Plotting performance trending data directly in Jenkins
• Reviewing detailed results directly in Jenkins
• Jenkins Enterprise by CloudBees enhancements
• Add templates
• Add folders
• Add roles and permissions
What are we going to show
17
SOASTA SolutionsQuality Across the Software Application Lifecycle
Expertise
18
Setting up the Test Environment
TouchTest
o Run MATT utility to create testable application
o Install Testable application on device
CloudTest
o Install conductor on laptop
o Modify mobile device proxy settings
Jenkins
o Install SOASTA PlugIn
o Install Plot PlugIn
o Install Jenkins Enterprise by CloudBees
• Open Source: online at jenkins-ci.org
• Automatically available on CloudBees DEV@cloud
• Complete control over CloudTest/TouchTest Automation from within your Jenkins builds:
• Totally integrated into Jenkins environment
SOASTA Jenkins Plug-in
Jenkins Enterprise by CloudBees – Folders Plus Plugin
Jenkins Enterprise by CloudBees – Role-based Access Control
Jenkins Enterprise by CloudBees – Templates Plugin
23
Thanks & Q&A
Contact SOASTA:www.soasta.com/cloudtest/[email protected] us:
twitter.com/cloudtest
facebook.com/cloudtest
Knowledge Center• White Papers• Webinar
Recordings• Case Studies
CloudLink Community• Support• Tutorials• Video
RESOURCES
Contact [email protected] us:
twitter.com/cloudbees
facebook.com/CloudBees
www.SOASTA.com www.CloudBees.com/jenkins
blog.cloudbees.com
developer.cloudbees.com• Platform Services• Frameworks
