Enabling Enterprises to Adopt DevOps

48
WhiteHedge Technologies WhiteHedge Technologies “CHANGING CHAOS TO COHERENCE”

Transcript of Enabling Enterprises to Adopt DevOps

WhiteHedge TechnologiesWhiteHedge Technologies

“CHANGING CHAOS TO COHERENCE”

WhiteHedge

[email protected]

TABLE OF CONTENTS - OUR AGENDA

About WhiteHedge

1

Traditional IT Vs DevOps

2

What is DevOps ?

3

Why WhiteHedge?

5

WhiteHedge Expertise

6

Projects and Case Studies

7

Get in Touch

8

DevOps Offerings at WhiteHedge

4

2

WHITEHEDGE - AN OVERVIEW

Global Presence

+

+

+

+

+

+

Agile + Flexible

Thorough + Quick Learner

Competitive + Comprehensive

Honest + Transparent

Young + Mature

Innovative + Creative

More about us …What defines us ?

California

New Jersey Rotterdam

Pune

Envision Products | Convert into businesses

100+ employees | 50+ live products world-wide

The best of the Talent and Infrastructure

Started 2003 | Focused Agile Product Development

Self funded | Well funded | Profitable

3

Traditional IT Vs DevOpsTraditional IT models are not designed for todays High Velocity Business

?

WhiteHedge

[email protected] 5

YOUR CHALLENGE TODAY

Constantly evolving needs

Quick and efficient response to change

Risk of losing clients to competitors

WhiteHedge

[email protected]

Traditional Ops are 41% more time-consuming

overall

Traditional Ops spends an average of 7.2 hours

weekly on communication

Traditional Ops spends 21% more time putting out fires

TRADITIONAL OPS VS DEVOPS

6

DevOps spends 33% more time on infrastructure

improvements

DevOps spends 60% less time handling support

cases

WhiteHedge

[email protected]

Traditional Ops DevOps

TRADITIONAL OPS VS DEVOPS

7

WhiteHedge

[email protected]

COMPANIES THAT ADOPT DEVOPS

63 %

Improvement in the quality of their

software

deployments

63 %

Release newsoftware more

frequently

55 %

Notice improved cooperation and

collaboration

38 %

Report a higher quality of code

production

8

WhiteHedge

[email protected]

DEVOPS BENEFITS

40%

Time Saved in Handling the Support Cases

50%

Reduction in Deployment Failure

33%

More Time to ImproveInfrastructure

22%

Less Time in Resolving Production Issues

*Taken from 2014 state of DevOps Report

9

WHAT IS DEVOPS? Surprisingly it is NOT just Development + Operations!

?

WhiteHedge

[email protected]

Communication + Collaboration + IntegrationInter-dependence of Software Development and IT Operations

DEVOPS- A CULTURE OF COMMUNICATION

11

WhiteHedge

[email protected]

WE DEFINE DEVOPS AS -

12

WhiteHedge

[email protected]

DEVOPS MATURITY MODEL

Intermediate

Basic

Build ClusterContinuous Integration / Deployment

Code analyticsCross-Silo visibility / analytics

Better Agility

Daily/Weekly buildsAuto-deploy to test and stagingAuto-test execution at the build

Always up-to-date QA status

Mature Model

Self-Service EnvironmentAuto build on commitDependency RepositoryAuto functional testsAnalytics and Monitoring

Let’s start here

Advanced

13

WhiteHedge

[email protected]

DEVOPS MATURITY MODEL

No DevOps• Poor Ad-Hoc

Communication• No Automation• Reactive,

Unpredictable, Uncontrolled processes

Initial• Managed

Communication, Shared Decisions

• Automation in silos, Lack of central infrastructure

• Managed processes, Still reactive, Non-standardized

Basic• Collaborative

communication• Centralized and

coherent automation across all silos

• Standardized processes, Proactive

Intermediate• Collaborative

processes with measured output

• Data collection from automated processes, gap identification with Business Vision

• Visible and Predictable processes with defined quality output

Mature• Effective knowledge

sharing, Visible processes, Auto-output analysis

• Automation to enable self-service (learn/act/correct)

• Process risk and cost optimization

ProcessAutomationCollaboration

14

[email protected]

WhiteHedgeDEVOPS IS NOT JUST WRITING SCRIPTS!

15

WhiteHedge

[email protected]

DEVOPS IS NOT JUST INCREASED NUMBER OF DEPLOYMENTS!

DevOps is about becoming more efficient with deployments and reducing risk

DevOps is about continuousimprovement

DevOps is ensuring you deliver production-ready code with each of your deployment

16

WhiteHedge

[email protected]

DEVOPS IS NOT JUST FOR STARTUPS

DevOps is not just a skill DevOps integrates with legacy as well as modern systems

Enterprises too can better their delivery models by adopting DevOps

DevOps can be adopted in phases

17

WhiteHedge

[email protected]

DEVOPS BENEFITS

CONTINUOUS SOFTWARE DELIVERY

Faster Time to Market

1IMPROVED

DEFECT DETECTION

Proactive Than Reactive

2FASTER

RESOLUTION & TURNAROUND

Faster Feature Delivery

3INCREASED

ORGANIZATION EFFECTIVENESSValue Add to Business

4

You Gain

WORK WITH US. WE KNOW DEVOPS.

18

DEVOPS Offerings @ WhiteHedgeDEVOPS

WhiteHedge

[email protected]

This 5 Circles represent our DEVOPS as a SERVICEImprove the ability of agile developments teams to continuously deliver value for the end customers

UNDERSTAND STRATEGY

/ VISION

ASSESSMENT &

PLANNING

DESIGN AND IMPLEMENT

MONITOR AND TRAIN

WhiteHedge DevOps as a Service

DEVOPS AS A SERVICE

20

WhiteHedge

[email protected]

STRATEGICLEADERSHIP

DEVOPS AS A SERVICE

We will understand your Business Vision

Identify gaps between Business vision and DevOps vision

Review current DevOps maturity level

System assessment for improvements

DevOps solves business problem

21

WhiteHedge

[email protected]

ASSESSMENT \ PLANNING

DEVOPS AS A SERVICE

We will help bridge the gap between Development –

Deployment – Run/Maintenance

WhiteHedge DevOps team will work closely with your

software development and your DevOps team(s)

Given a problem in Operations or Infrastructure, we have

expertise to recommend you the best solution

Choose and finalize the DevOps tool set to be implemented

Design and document the process

Understand people, processes, culture

22

WhiteHedge

[email protected]

DESIGN AND IMPLEMENT

DEVOPS AS A SERVICE

Implement the DevOps tools set

Automate infrastructure provisioning

Implement continuous integration and delivery

We have built expertise in various technologies using

which we can build dashboards, tools, connectors

Continuous Build, Integration, Testing

23

WhiteHedge

[email protected]

MONITOR AND TRAIN

DEVOPS AS A SERVICE

WhiteHedge DevOps as a service encourages collecting

and measuring data from all possible sources

Monitor automation process

Share ideas

Train your staff with necessary guidelines and roadmap

to continue the progress

Measure, Monitor and build Self-Directed Team

24

WhiteHedge

[email protected]

DEVOPS AS A SERVICE

We have observed that DevOps process and culture start

falling apart after DevOps implementer train and leave the

project team

Typical DevOps consultant will bring technical expertise,

implement and will leave

WhiteHedge DevOps as a service can continue to work

with your team to guide them

Like continuous Integration / Delivery, Continuous

Improvement is also a critical factor !

Keep Iterating, Continue Improving

25

WhiteHedge

[email protected]

DEVOPS BREADTH - WE ARE GOOD AT

WhiteHedge provides expertise in following DevOps areas

Virtualization Platform

Virtualization Platform

Infrastructure as a Service

Infrastructure as a Service

Test and Build Systems

Test and Build Systems Monitoring & AlertingMonitoring & Alerting

Application Server

Application Server

TrendingTrending

Operating Systems

Operating Systems

Configuration Management

Configuration Management

LoggingLogging

Other ToolsOther Tools

DatabasesDatabases

26

CI ? CDCI ? CD

Process Supervisors

Process Supervisors

WhiteHedge

[email protected]

AUTHORIZED PARTNERS

27

WhiteHedge

[email protected]

WHITEHEDGE EXPERTISE

§ Amazon Web Services§ Windows Azure§ Rackspace§ OpenStack§ Google Compute Engine§ AppNexus

§ VMware§ KVM§ Xen§ VirtualBox§ Vagrant

§ Logstash / ELK§ Splunk§ Loggly§ SumoLogic

§ RHEL§ CentOS§ Ubuntu§ Debian§ Unix (Solaris)§ Windows§ Mac OS X

§ JBoss§ Tomcat§ Jetty§ Nginx§ Apache§ IIS

§ Jenkins§ Travis-CI§ Shippable§ Cloudbees§ Bamboo§ TeamCity§ Maven§ SauceLabs§ Cucumber

§ Redis§ RDS§ MySQL§ Cassandra§ MongoDB§ Oracle§ Sybase§ PostgreSQL

Virtualization Platforms Logging

Operating SystemsApp & Web Servers

Databases

Monitoring, Alerts and Trending

Test & Build Systems

§ Datadog§ Zabbix§ Nagios§ NewRelic§ Graphite§ Cacti§ PagerDuty

Infrastructure as a Service

28

WhiteHedge

[email protected]

WHITEHEDGE EXPERTISE

Security

§ Conjur§ Snor

Containerization Tools

§ Docker§ LXC Containers

Application Deployment

§ Capistrano§ Fabric

Configuration Management

Process Supervisors

§ Monit§ Runits§ Supervisor§ God§ Blue Pill§ Upstart§ Systemd

Other Tools

§ Kubernetes§ Docker Machine§ Docker Swarm§ Docker Compose§ Takipi

§ Chef§ Puppet§ Ansible

29

Why WhiteHedge?

WhiteHedge

[email protected] 31

WE UNDERSTAND YOUR BUSINESS GOALS

EXPERTISE IN DEVOPS IS A MUST

YOU BUSINESS VISION NEEDS TO BE

MAPPED TO YOUR DEVOPS VISION

DEVOPS SPACE IS CONTINUOUSLY

EVOLVING

We can help you align your business goals with DevOpsgoals to ensure that long term success

WhiteHedge

[email protected]

WE HELP YOU ACCELERATE

32

§ Derive and define key IT metrics

§ Number of defects (overall and by application/severity)

§ Frequency of changes (development velocity)

§ Defects due to change

§ Mean time to repair (MTTR)

§ Mean time between failures (MTBF)

§ Availability

§ Performance

We understand your business goals

And align them with your DevOps goals

We build a system that can measure the metrics

WhiteHedge

[email protected] 33

WE HELP YOU MEASURE BUSINESS VALUE OF A CHANGE

Focus what the business actually needs

Measure the business valueWhiteHedge strength

To do DevOps successfully:

Measure and estimate the business valueof a new story, and the business risk to each deployment.

If more business value than risk:Deploy more often

Configuration management

Remove the ops team!

WhiteHedge

[email protected] 34

WE HAVE TECHNOLOGY EXPERTS

Updated Approach

Collaboration Provide the right solution

At WhiteHedge we keep ourselves updated with latest technology trends to ensure we can provide you with

the best consultation in the DevOps space

WhiteHedge

[email protected]

WE FOCUS ON…

35

Technology ProcessPeople

§ Cultural Change –Collaboration, Cooperation and Transformation to a Learning Organization

§ Increased responsiveness to business

§ Improved quality of code§ More agile development

§ More agile change process

§ Improved quality of software deployments

§ More frequent software releases

§ Improved visibility into IT process and requirements

WhiteHedge

[email protected] 36

OUR PRINCIPLES OF DEVOPS

Automate Everything Deliver small increments

Continuous Improvement Test early and test often

Continuous feedback Cohesive Teams

Projects and Case Studies

[email protected]

WhiteHedgeDEVOPS STACK FOR ONE OF OUR CLIENTS

38

WhiteHedge

[email protected]

CLIENT IN THE MEDIA DOMAINDesigning and implementing the DevOps strategy to align with the business vision of introducing a new device in the mobile devices market.

WhiteHedge SolutionØ Created VPCs in two different

AWS region with multi-AZ configuration

Ø Configured Highly Available NAT servers for inbound and outbound traffic

Ø Created auto-scaling policies based on CPU Utilization and inbound traffic through ELBs

Ø Defined policies for periodic patching & updates to base AMIs

SituationØ Worldwide leader in consumer electronicsØ Leader in manufacturing mobile devicesØ Introduction of a new tablet in the market

ChallengeØ Building AWS infrastructure to support a product

launch in 40 countriesØ Creating a CI, CD Pipeline for a node.js serverØ Setting up auto-scaling infrastructure to support

heavy traffic during the shopping season

WhiteHedge

[email protected]

Technology

Value Addition

WhiteHedge

Ø AWS, EC2, CodeDeployØ Jenkins, DockerØ NodeJS, Python, Bash

Ø Created CloudFormation Templates for quick future deployments for new regions

Ø User AWS CodeDeploy to deploy server on AWS

Ø Monitoring using DataDog & Operational support integration with PagerDuty

Ø WhiteHedge offered DevOps consultation, implementation, though leadership and helped in taking strategic decisions related to infrastructure design.

Ø Infrastructure was an important aspect to support the new device in the market, in order to autoscale and support the variable and unknown load in production.

WhiteHedge

[email protected]

AMAZON ELASTIC CONTAINER SERVICEAmazon EC2 Container Service (Amazon ECS) is a highly scalable, fast, container management service that makes it easy to run, stop, and manage Docker containers on a cluster of Amazon EC2 instances.

WhiteHedge SolutionØ We explored a number of Docker

orchestration tools: Kubernetes, Docker Swarm and Amazon ECS.

Ø ECS lets you launch and stop container-enabled applications with simple API calls

Ø Allows you to get the state of your cluster from a centralized service

Ø Gives you access to many familiar Amazon EC2 features.

Ø No need to maintain any software to manage cluster on our side as ECS is a free service.(If you are using EC2 instances)

ProblemØ How to orchestrate and autoscale Docker

containers on Amazon EC2?

ChallengeØ We run application inside docker containers on

EC2.Ø We automated docker image creation using

Jenkins and scripts.Ø We automated deployment using Amazon

CodeDeploy. Ø However autoscaling docker images on EC2 is an

open problem today. Ø How could we orchestrate and autoscale docker

containers in production?

WhiteHedge

[email protected]

APPLICATION PERFORMANCE MANAGEMENTApplication Performance Management (APM) is the monitoring and management of performance and availability of software applications.

WhiteHedge SolutionØ We setup and configured the monitoring

solution for the client using DatadogØ System monitoring and Application

monitoringØ We setup automated alerts in the form of

phone calls, emails and chat notificationsØ Alerts were triggered when the

application went down or was unresponsive, when the system parameters looked unhealthy (CPU, Memory, etc.) or when the application produced too many errors.

Ø The application health was shown graphically on the Datadog dashboard

ProblemØ Getting an insight into how the application

performed was needed to take key business decisions

ChallengeØ While the client developed and continuously

deployed the software, there was no feedback mechanism in place

Ø It was important to know if the application was up and responding

Ø We had to design a mechanism which would help in debugging issues in the system

WhiteHedge

[email protected]

APPLICATION MONITORINGApplication monitoring is a process that ensures that a software application processes and performs in an expected manner and scope.

WhiteHedge SolutionØ We realized the need to do code

augmentation to gather the HTTP request processing time metric.

Ø We had to ensure that this code augmentation does not affect the overall performance of the system.

Ø We chose to do this using Datadog. Ø Our application was in NodeJS. We used

module.Ø The metrics were sent from code using

the node-dogstatsd module to local Datadog agent using UDP.

Ø Local Datadog agent sent the metrics to Datadog server using Python.

Ø The Datadog UI and scripts were used to display the metrics in the desired format

ProblemØ Our client wanted an insight into how the

application was performing in terms of the time needed to process an HTTP request.

ChallengeØ Many monitoring solutions offer out of the box

support to track HTTP response times by sending dummy HTTP requests to the system.

Ø Our challenge was to come up with stats which give the response times for each real (production) request into the system.

WhiteHedge

[email protected]

MONITORING USING ZABBIXOpen source and enterprise-level software designed for real-time monitoring of millions of metrics collected from tens of thousands of servers, virtual machines and network devices.

WhiteHedge SolutionØ System monitoring plays a great role in

offering clients a complete, robust solution to their needs.

Ø After research and testing, WhiteHedge decided to utilize Zabbix as the backbone of their monitoring services.

Ø Using Zabbix the WhiteHedge team is able to detect issues quicker and reduce the response times for failed services and applications.

Ø Fully customized alerts, specific to each server/ service monitored have been implemented by the WhiteHedge team to maximize uptime for their clients’ environments.

SituationØ Our client was looking for an easy-to- set-up

and user-friendly monitoring software, preferably on Linux platform with back-up support available 24/7.

Ø And the software still had to have the capabilities to implement custom checks.

WhiteHedge

[email protected]

CLOUD MIGRATIONMoving data, applications or other business elements from on premise to cloud or from one cloud environment to another.

WhiteHedge SolutionØ After studying the existing architecture and the business

requirements WhiteHedge proposed a cloud-based

architecture which leverages the Amazon’s Elastic

Compute Cloud (EC2) and other associated services.

Ø WhiteHedge applied Phase Driven Approach to Cloud

Migration

Business ChallengeØ Physical hardware components rapidly

approaching end of life.Ø Increasing downtime due to network failure in

data center. Ø Increasing operational expenses year over

year.

Ø Cloud experts helped our client to migrate to the

AWS cloud without downtime.

Ø WhiteHedge helped our client to keep the cost

structure at low level.

Ø WhiteHedge put focused efforts that resulted in

efficient turnaround with qualitative delivery.

Ø Integration of third party tools such as Puppet to

get work done.

WhiteHedge

[email protected]

Clou

d A

sses

smen

t Financial Assessment (TCO calculation)

Security and Compliance Assessment

Technical Assessment (Classify application types)

Identify the tools that can be reused and the tools that need to be built

Create a plan and measure success

Proo

f of C

once

pt Build a pilot and validate the technology

Test existing software in the cloud

Mov

ing

Data Understand different

storage options in the AWS cloud

Migrate file servers to Amazon S3

Migrate MySQL to Amazon RDS

Mov

ing

App

s Create AMIs for each component

Leveraging the Cloud and other AWS services

Harden security

Leverage multiple availability zones O

ptim

izat

ion Implement advanced

monitoring.

Optimize usage based on demand

PHASE DRIVEN APPROACH TO CLOUD MIGRATION

WhiteHedge was successful in aligning with our client business and technical requirements, which resulted in extending the relationship to deliver the solution roadmap and implementation responsibility.

[email protected]

WhiteHedgeCONTACT US

GET IN TOUCH WITH USWe would like to hear from you!

How you have adopted DevOps in your company?Would you like to have a quick chat about our DevOps offerings?!

Write to us!

Mukta Aphale - [email protected] Joshi - [email protected]

http://www.whitehedge.com/devops.html

47

THANK YOU!Have a Nice Day!