Ramesh Krishnamurthy, CTO at World DevOps Summit 2016

Topic Title: Integrating Test Automation in DevOps

Name of the Speaker : Ramesh Krish

Company Name : Indium Software (India) Limited

http://www.unicomlearning.com/2016/World_Devops_Summit_Bangalore/


START PROJECT APPLICATION BUILD AVAILABLE FINISH PROJECT

REGRESSION CYCLE

Document Steps

Document Steps

Traditional Automation

Record

Tests

Run Scripts & Analyze tests

Modify Test for Changes

Run Scripts & Analyze tests

Re -Recording

Modify Test for Changes

Identification of multiple tool sets

Setup infrastructure Run and Analyze

Test

Troubleshooting and fixing issues on need

basis

Identify Automatable Components

CODE | BUILD | TEST |

PACKAGE | RELEASE |

CONFIGURE | MONITOR

Automation in Dev-Ops

Implement Solution

Test case Feasibility for Automation

Modify Test

Run and Analyze Test

Modify Test

Run Scripts

& Analyze

tests

Build components

& Flows Automate Run

Scripts

Framework Driven

Automation In Agile

Run Scripts

Test Automation Overview

Development, Review, Approval & CI

CODE

BUILD

TEST

PACKAGE

RELEASE

CONFIGURE

MONITOR

Typical DevOps Structure


QA

IT Operations

DEV

DevOps

Version Control, Code Merge, Build Status

Quality Assurance (Smoke / Sanity, Regression)

Artifact Repo, Pre deployment staging

Infra Configuration , Management

Performance, Health Checks

Change Mgnt, Release Approvals, Regression Automation

DevQA


QA

OPS

DEV

LEGENDS

- Dev - QA

Code review / Approval /

Merge

Build Version Control

Build Status Notification

QaOps


QA

OPS

DEV

LEGENDS

- QA - OPS

Build Deployment

Artifact Repository

Pre deployment Staging

Infrastructure Configuration

Configuration Management

Performance Monitoring

DevOps - QA


QA

OPS

DEV

LEGENDS

Change Management

Release Approvals

Continuous Integration

Health Check

Defect Management

- Dev - OPS


Entity

Developer

Source Code

STOP / OPEN DEFECT

Test

Cluster

Test Tools [Selenium, UFT, Junit, SlikTest]

Test Management

Tool

PROCESS ID: S02

Deliver Build

MOVE TO PRODUCTION

PROCESS ID: S01

Prepare Staging Environment PROCESS ID: S03

Final Validation (UAT)

PROCESS ID: S04

Executive Approval

S01

STAGING ENVIRONMENT [EXTERNAL]

QA ENVIRONMENT [INTERNAL]

Test Controller

Q02

Q03

PROCESS ID: Q02

Compile Source

PROCESS ID: Q01

Prepare Build

PROCESS ID: Q03

Deliver Build

Test Controller

Test Pass?

PROCESS ID: Q04

Integration / System Testing

Run Tests

Build Request

Yes

Yes

No

Deployment Request

No Validation Pass?

Build successful Notification

Installation Request

CLOUD INFRASTRUCTURE

STAGING SERVER

Unmerge Request

CODE MERGE

CI Tool [Jenkins, Buildbot,

Hudson]

Q01

Build Successful Notification


Hudson]

CI LAYER

iSAFE – Automation Framework

A working model

Entity

Developer

Source Code

STOP / OPEN DEFECT

Test

Cluster


Test Management

Tool

PROCESS ID: S02

Deliver Build

MOVE TO PRODUCTION

PROCESS ID: S01



PROCESS ID: S04

Executive Approval

S01



Test Controller

Q02

Q03

PROCESS ID: Q02

Compile Source

PROCESS ID: Q01

Prepare Build

PROCESS ID: Q03

Deliver Build

Test Controller

Test Pass?

PROCESS ID: Q04

Integration / System Testing

Run Tests

Build Request

Yes

Yes

No

Deployment Request

No Validation Pass?




STAGING SERVER

Unmerge Request

CODE MERGE


Hudson]

Q01



Hudson]

CI LAYER

Listener


Entity

Developer

Source Code

STOP / OPEN DEFECT

Test

Cluster


Test Management

Tool

PROCESS ID: S02

Deliver Build

MOVE TO PRODUCTION

PROCESS ID: S01



PROCESS ID: S04

Executive Approval

S01



Test Controller

Q02

Q03

PROCESS ID: Q02

Compile Source

PROCESS ID: Q01

Prepare Build

PROCESS ID: Q03

Deliver Build

Test Controller

Test Pass?

PROCESS ID: Q04

Smoke / Sanity / Integration / System Testing

Run Tests

Build Request

Yes

Yes

No

Deployment Request

No Validation Pass?




STAGING SERVER

Unmerge Request

CODE MERGE


Hudson]

Q01



Hudson]

CI LAYER


Listener Listener


Lack of Skilled Resources

Tools Management

Legacy to cloud migration

Collaboration within the teams

Consistently passing Smoke & Sanity suites

DEVOPS AUTOMATION - CHALLENGES

DevOps - Advantages & Challenges

Repetitive and monotonous manual tasks can be eliminated

8x more frequent production deployments

50% lower change failure rates

3x reduction in cost

12x faster service restoration times when something went wrong

Entire automation is version controlled

Eliminate human errors

Most of the activities in Dev Ops can be automated

DEVOPS AUTOMATION - ADVANTAGES


DevOps Tools

BUILD

TEST

PACKAGE

RELEASE

CONFIGURE

MONITOR

CODE

DEVOPS TOOLS

MONITOR

CODE REVIEW CONTINOUS INTEGRATION TEST MANAGEMENT TOOLS OSX RELEASE & DEPLOYMENT CONFIGURE MONITOR

Nagios, Zabbix & Sensu | AWS CloudWatch & StackDriver | New Relic & AppDynamics |

Compuware APM & Boundary | BigPanda and PagerDuty

World Conference Next Generation Testing 2015

Speaker Name: Ramesh Krish

Email ID: [email protected]

Organized by UNICOM Trainings & Seminars Pvt. Ltd. [email protected]


mailto:[email protected]

Ramesh Krishnamurthy, CTO at World DevOps Summit 2016

Services

Transcript of Ramesh Krishnamurthy, CTO at World DevOps Summit 2016