“Using APM to Turbocharge Continuous Integration”

Alan Shimel, Founder & Editor-in-chief, DevOps.comMatt LeRay, Senior Vice President and Business Unit Executive, CA TechnologiesBrad Johnson, VP of Product Marketing, CloudBees

June 28, 2016

2 © 2015 CA. ALL RIGHTS RESERVED.

RELEASE

Today’s Webcast Program

• Introductions

• Current Environment

• Leading Challenges

• APM and DevOps

• Continuous Integration

• Leveraging Integration

• CA APM + Cloudbees Jenkins

• Q&A

3 © 2015 CA. ALL RIGHTS RESERVED.

RELEASE

Panelist Introductions

• Alan Shimel, Founder & Editor-in-Chief, DevOps.com@ashimmy

• Matt LeRay, Senior Vice President and Business Unit Executive, CA Technologies@matthewleray

• Brad Johnson, Vice President of Product Marketing, Cloudbees@bradjohnsonsv

4 © 2015 CA. ALL RIGHTS RESERVED.

Forrester: 80% of MTTR (repair) is actually MTTI (identify)…

“

DORA: DevOps leaders recover 24x faster than other organizations.*

“

Too Little DevOps, Too Much Repair

*2016 State of DevOps Report

5 © 2015 CA. ALL RIGHTS RESERVED.

Manual testing

Manualscripting

Developers deadlocked

Too little testing, too late

in the cycleConstrained

environmentsToo many disparate

tools

Poor customer

experience

CustomerExperience

PLAN

RELEASE

DEFECTS

DEFECTS

OUTAGES

OPSDEV

Challenges of the Traditional Approach

6

© 2016 CA. ALL RIGHTS RESERVED.

Software changes continuously

deployed to live production

Continuous Deploymen

tContinuous Integration

Automated commit, build and testing of code in the development environment

DevOps Cultural approaches & technical practices

User FeedbackRapid Changes

Disc

iplin

e

AGILE

An incremental approach to

identifying, prioritizing, and coordinating

feature development

Development Production / Prod-like Live ProductionEnv.

Stag

e

Release Deploy Monitor

Upstream (left) Downstream (right)Define Plan Code Compile Build Unit Test Analyze Integrate Int. Test Package Place Load Test Acct. Test

Change Mgt. Production Bugs

DevOps in Context: CI to CD (to Cd)

7 © 2015 CA. ALL RIGHTS RESERVED.

Bringing Together APM and Continuous Integration

Applications Performance Data

Build Data (Status, No., etc.)

DEV OPS

Publish APM Data in Jenkins

Publish CI Data in CA APM

8

© 2016 CA. ALL RIGHTS RESERVED.

Accelerate problem resolution by

90%

Accelerate app dev cycles by

15%

Forrester Consulting “Total Economic Impact of CA APM”

“APM makes it easier for us to figure out solutions quickly because we can involve the right researchers, quickly figure out where the problem is, [and] get to the root cause.”

“In essence, we’re issuing less code or less fixes into production, which allows [us] to focus more on maintaining a competitive advantage in the market-place of what we deliver in our online solutions.”

Using APM in Pre-Prod Makes Developers More Efficient

9 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Full Visibility

MeetKPIs

Scale todemand

BetterUX

DeviceTuning

Betterreliability

QA/TESTDEV PRODUCTIONPRE-PROD

CustomerExperience

Code | Integrate | Build Functional & UA Testing Performance Testing Deploy to Production

IT OPERATIONS

No usabilityinsights

No device specific

feedbackNo productioncrash analytics

Digital Experience

ManagementNo business

metricsCloud and

Container Blind Spots

No real world performance

data

DEVELOPMENT

Crashanalytics

Device specificreporting

Behavioral Analytics

Real World Test Models

BusinessAnalytics

Cloud and Container

Monitoring

IDE SCM CI TESTCONTAINER CONFIG CLOUD PROVISION

IDEA

Putting the “Ops” in DevOps to Anticipate User Needs

10

© 2016 CA. ALL RIGHTS RESERVED.

Code & Commit Build & Config Scan & Test Release Deploy

Over 1.2 Million Users

1000+ plugins cover every delivery stage

Jenkins Connects All the Things

11

© 2016 CA. ALL RIGHTS RESERVED.

Ongoing support & maintenance

Security & compliance

Scale & operations

Control & visibility

Enterprise DevOps✓

Criteria for DevOps @ Scale

12

© 2016 CA. ALL RIGHTS RESERVED.

The Path To DevOps

Quadrant 1:Team-level Agile

Quadrant 2:Team-level CD

Quadrant 3:Enterprise Agile

Quadrant 4:EnterpriseContinuous Delivery

Team

Wor

kgro

upEn

terp

rise

Define Plan Code Build Integrate Test Release Deploy Operate

Getting There: 4 Quadrants of DevOps Maturity

13

© 2016 CA. ALL RIGHTS RESERVED.

• Packaging & managing apps/environments• Deploying to key stakeholders (maybe Prod)• Integrated performance metrics to reqs• Ties to Dev process (Agile practices)

• Standardized “Share Services” models• Business, Dev, Ops requirements aligned• Integrated performance metrics to reqs• Culture of collaboration & integration

4 Quadrants of DevOps Maturity

14

© 2016 CA. ALL RIGHTS RESERVED.

Turbocharge the Software Pipeline using APM and CI

Dev QA/Test ProductionPre-Prod

Application Performance Management

Continuous Integration

Continuous Feedback - Continuous Improvement

15

© 2016 CA. ALL RIGHTS RESERVED.

Capabilities:

– Collects performance data from APM– Performs multiple build comparison – Multiple APM/CI integration points– Helps automate build release process

Features:

– Collect multiple performance KPIs – Define multiple fail conditions– Build pass/fail email notification– Notify build status without fail– Decorate ATC node with build no./status– Jump to APM Webview “in context” from

Jenkins build or cross-build dashboard

CA-APM Jenkins Plugin - Overview

16

© 2016 CA. ALL RIGHTS RESERVED.

Jenkins to CA APM WebView

17

© 2016 CA. ALL RIGHTS RESERVED.

Cross Build Dashboard with Reason

18

© 2016 CA. ALL RIGHTS RESERVED.

Use Case: Integrated WorkflowCheck in code more frequently and Jenkins runs the build and tests it more

often in pre-production – ensuring quality release to production.

Check in the code with new functionality

Jenkins builds it and runs

the tests

Jenkins marks it pass or fail based on CA APM build

conditions

Data through the CA APM

Jenkins Plugin

Performance data pulled into

Jenkins from CA APM

Jenkins generates cross-build dashboard

Attributes incl. build status,

build number shown on ATC

Allows access to CA APM in-

context from Jenkins dashboard

19

© 2016 CA. ALL RIGHTS RESERVED.

RELEASE

RELEASEPLAN

Q&A?

Thanks!For more information visit:

CA APM:http://www.ca.com/us/products/ca-application-performance-management.html

Cloudbees Jenkins:https://www.cloudbees.com/products/cloudbees-jenkins-platform