EMC World 2016 - DevOps-at-Scale Session

2© Copyright 2016 EMC Corporation. All rights reserved. 2© Copyright 2016 EMC Corporation. All rights reserved.

DEVOPS AT SCALEBART DRISCOLL


YOUR SPEAKER IT leader and evangelist within EMC Global Services Passionate about driving IT Performance through lean

and agile Focused on application development and deployment

operations (aka. DevOps)

R. Bart DriscollDirector, DevOps Services @bartdriscoll

https://infocus.emc.com/author/bart_driscoll/[email protected]

Austin, TX


DEVOPS IS …

…optimizing the flow of work to create products that create value faster and more reliably.

OPS

DEV


WHY IS THIS SO CHALLENGING?

PLATFORMS OPERATING MODEL TOOLS PROCESS STANDARDS


DEVOPS-AT-SCALE

APPLICATION

WORKING PROTOTYPE

ENTERPRISE PORTFOLIO

DESIGN STANDARDS FRAMEWORKS PRINCIPLES ARCHITECTURES


EPS Comparison• Enterprise Objective– Improve Earnings per Share

• Aligned IT Goals– Drive efficiency

• Improve Net Income by lowering net operating cost– Accelerate Time-to-Market

• Capture new (or reclaim) market share by providing new/update service to customers faster than competitors

– Improve Quality• Advance customer satisfaction by delivering

technically sound, fit for purpose solutions

• Software Delivery Management Program

GLOBAL BANKING CLIENT

Enterprise At-A-Glance

• 6,000+ active dev projects• 30,000+ IT Professionals• 7 Major Divisions• Globally distributed IT• Countless Partners• Heterogeneous platforms


• Focus– Pilot Continuous Integration and Delivery– Advise Infrastructure Provisioning and Management

• Influence– Integrating Lean SDLC (SAFe/Agile) initiative– Developing business case and roadmaps– Support development of Standardized Architectures

• Approach– Provide multi-level services– Develop internal champions and sponsors

EMC & GWB COLLABORATIONGLOBAL WHOLESALE BANKING DIVISION


1. Align2. Prove3. Radiate

ALIGN PROVE RADIATE

PATHWAY TO SUCCESS


ALIGNDEFINE DESIRED STATE

Cloud

DevOps

Agile

INDUSTRY TRENDS ENTERPRISE GOALS

• Drive efficiency• Accelerate TTM• Improve quality

DESIREDSTATE


DEVELOPMENTOPERATIONS

SECURITY

COMPLIANCE

INFRASTRUCUTRE

ARCHITECTURE TESTPRODUCT

ALIGNBE DEPLOYMENT-FOCUSED

DEPLOY


ACKNOWLEDGE CURRENT READINESSALIGN


MEASURE OUTCOMESALIGN

Processes& Models

3-5 Year Objectives/Outcomes

AnnualObjectives/Outcomes

Improvement Targets

Improve Earnings Per Share

Driv

e Effi

cienc

yAc

cele

rate

Tim

e-to

-Mar

ket

Impr

ove

Qual

ity

By E

OY 2

015,

ena

ble

busin

ess t

o ca

nary

test

UI

feat

ures

with

Pro

duct

ion

user

com

mun

ity

By E

OY 2

015,

feat

ure-

driv

en

deve

lopm

ent (

FDD)

pr

actic

es a

re S

OP fo

r pilo

t te

am(s

)

By E

OY 2

015,

team

can

de

ploy

into

pro

duct

ion

ever

y 30

day

s or l

ess f

or o

f pi

lot a

pplic

atio

n(s)

By E

OY 2

015,

ope

ratio

ns

team

s can

supp

ort a

uto-

scal

e up

/dow

n fo

r web

and

ap

plica

tion

tiers

of p

ilot

appl

icatio

n(s)

By E

OY 2

015,

dev

elop

men

t an

d te

st te

ams h

ave

desig

ned,

dev

elop

ed a

nd

impl

emen

ted

CD fo

r DBs

in

supp

ort o

f pilo

t ap

plica

tion(

s)

Application Architecture PracticesPlatform/Server Management ProcessDatabase Development LifecycleRelease Management ProcessDeployment & Provisioning ProcessSoftware Development Lifecycle

AffectedProcesses &

Practices

S.M.A.R.T.Improvement Targets


ALIGNORGANIZE AROUND VALUE

GROUPING DYNAMIC TEAMING MODEL

GOAL

Operational SilosCentralized Management

Cross-functional TeamSelf-managed; Product Aligned

GOAL



ALIGN PROVE RADIATE

PATHWAY TO SUCCESS


• Pilot JAVA application

• Develop/demo working prototype

• Build Champion(s)

• Train team

PROVEDEMONSTRATE VIABILITY


• Cross-functional• Collaborative• Transparent• Iterative• Courageous• Retrospective

PROVESEED CULTURE

“Why should we change?”

“Can’t do that because …?” “Impossible!”

“Can we do that?”

“Cool!”

CHAMPIONS


TAKE 2: DEVOPS & CD FOR CRM

What:Provide the culture, process automation, and tooling to improve development velocity, release frequency and software quality.

How: Lean Agile

DevOps/ Continuous Delivery

Cloud Infrastruc

ture *

Agility(Velocity

& Quality)

* Limited capability/influence


PROVETARGET VALUE STREAM

A frequently executed workflow like this…

enables a value stream like this...


PROVEEMBED TOOLING


PROVEITERATIVE ROADMAP

• Commit Stage Includes ETL• Acceptance Stage Includes•Dependency Management • Push-button Release Automation• Release Mgmt Simplification• Canary Deployments•Mule/CRM upgrades

• Commit Stage includes ADS DB• Acceptance Stage• Enhanced Dashboard / Feedback

• Source Control• Pre-Commit Stage for MS Dynamics & Integration Services• Commit Stage for MS Dynamics & Integration Services•Dashboard/Feedback Loop•Dedicated VM Environment

Q1 Q2 FUTURE



ALIGN PROVE RADIATE

PATHWAY TO SUCCESS


DEPENDENT SYSTEMS; SHARED STANDARDSRADIATE

CRM Functionality Removed from Navigator (Client/Contact/Activity), just Deal Management Remains.

CEDTX Data

Navigator Services

DEALSTX Data

GCIB MSCRMMS Dynamics CRM 2015

DACTX Data

GWB MSCRMMS Dynamics CRM 2015

The next Phase of the Sales Platform:

Navigator: All CRM functionality will be removed from Navigator which will retain only Deal Management functionality.

Informatica will no longer push Clients/Entities and will start pushing read-only Deal data.

CRM Integration Engine will add support for Client/Entity data and will not longer sync Activities or Contacts with Navigator. Its data services will be the provisioning point for this data.

GPDS will be refactored to not update CDB or the legacy CED Orgs. Downstreams must stop using legacy CED Orgs.

Client Plans must move to GCIB MSCRM.

Client/Entity updates are gathered from a CED MQ topic (must research what MRDS plans).

Sales ADS: Theoretically, if GWB MSCRM contains all contacts and activities, it could serve as the aggregation point for that data. However, the Sales ADS will eventually become the single provisioning point and we will incrementally build it to that point. Until GDH is replaced and its downstreams refactored, its data will still flow to GDH.

CRM Integration Engine

MULE

FAST Mart

SalesADS

Real-time inserts, updates, deletes: Activities, Contacts, Clients/Entities.

Deal & Admin Codes

DealsAssociates

GDH ProfitClient Financials

1x/month

4x/day

SOSRef DataClient 360

4x/day

GCIB Reporting Lines, Ref

Data

Manual Process

Web Service Direct Call

Informatica ETL

Legend

Out: Plug-inIn: CRM API

MS Dynamics MarketingCloud

Dynamics Marketing Connector

Azure Service Bus

GPBS

DACClient/Server

NavigatorWeblogic Portal

GCBRTX Data

GDHSales Referrals

Sales Data4x/day

GCB Referrals

GPBS MQ Topic

Sync Data and Aggregated

Contacts, Activities, Clients, Client Plans

Refe

renc

e Da

ta, R

efer

rals

, Clie

nt

Plan

s, D

eals

& C

lient

360


DEVELOP LAYERED GOVERNANCE MODELSRADIATE

ENTERPRISE

PORTFOLIO (L.O.B.)

ARCHITYPE

APPLICATION

TEAM

DEV TEST STAGE PRODQU

ALIT

Y ST

ANDA

RDS

POLI

CY-D

RIVE

N PI

PELI

NES


CREATE AN EXTENSIBLE AGILE PLATFORMRADIATE

Deployment Environments Management & Monitoring

Version Control Build Tools Continuous Integration Tools Test Frameworks

TestManager

ACCEPTANCE STAGINGPRE-COMMIT DEV/COMMIT PRODUCTION

Configuration Managment Artifact Repositories

API FRAMEWORK & LIBRARIES

DevOps Workflow

TEST

API FRAMEWORK & LIBRARIES


DEVELOP A SUPPORT SYSTEM FOR CHANGERADIATE

EXTERNAL COACH(es)

INTERNAL CHAMPION(s)

TECHNICAL SME(s)

Industry ExpertiseBroad Experience

‘Outsider’ Perspective

• Recognized leader• Politically savvy• ‘Insider’ Perspective• Pragmatic thought-leadership

• Known technical expert• Deep subject matter expert• Innovator/Early Adopter

• • •


CREATE SPACERADIATE

APPAPP

APP

APP

CD PIPELINE CD PIPELINES

GOAL

TEAM

GOAL

GOAL

GOAL

Goal

TEAMS

TOOLS

PROCESS & BEST PRACTICE

STANDARDS & GUIDELINES

COACHING & CHAMPIONS O

NB

OA

RD

IN

G

Legacy Enterprise


CIO

PRODUCT MANAGEMENT

TEAM MEMBER

TEAM MEMBER

TEAM MEMBER

TEAM MEMBER

TEAM MEMBER

TEAM MEMBER

TEAM MEMBER

FUNCTIONALTEAM LEAD

TEAM MEMBER

TEAM MEMBER

TEAM MEMBER

TEAM MEMBER

TEAM MEMBER

TEAM MEMBER

TEAM MEMBER

FUNCTIONALTEAM LEAD

TEAM MEMBER

TEAM MEMBER

TEAM MEMBER

TEAM MEMBER

TEAM MEMBER

TEAM MEMBER

TEAM MEMBER

FUNCTIONALTEAM LEAD

TEAM MEMBER

TEAM MEMBER

TEAM MEMBER

TEAM MEMBER

TEAM MEMBER

TEAM MEMBER

TEAM MEMBER

FUNCTIONALTEAM LEAD

TEAM MEMBER

TEAM MEMBER

TEAM MEMBER

TEAM MEMBER

TEAM MEMBER

TEAM MEMBER

TEAM MEMBER

OTHER

TEAM MEMBER

TEAM MEMBER

TEAM MEMBER

TEAM MEMBER

TEAM MEMBER

TEAM MEMBER

TEAM MEMBER

MANAGE BY PRODUCTRADIATE

METRICS

SKILLS

PRODUCT


SUMMARY

ALIGN PROVE RADIATE

TO OVERCOME INERTIA

TO CREATE LASTING CHANGE

EMC World 2016 - DevOps-at-Scale Session

Technology

Transcript of EMC World 2016 - DevOps-at-Scale Session