888 IT Operations Management with Nolio

27

description

888's webinar with Nolio held Feb '10, Covering how 888 achieved IT Operational agility,control and automation using Nolio's ASAP (Application Service Automation Platform) solution.

Transcript of 888 IT Operations Management with Nolio

Page 1: 888 IT Operations Management with Nolio
Page 2: 888 IT Operations Management with Nolio

www.noliosoft.com © 2009 Nolio Application Service Automation. All rights reserved.

Nolio ASAP

Eran Sher, Co-Founder & VP Products

Page 3: 888 IT Operations Management with Nolio

www.noliosoft.com © 2009 Nolio Application Service Automation. All rights reserved.

Bridge Apps & OpsGrowing Volume and Frequency of Change

Manage App Complexity, Dependencies

Control DistributedHeterogeneous DCs

× High error rates / application failures× Bottlenecks, delays× Lower operational efficiencies,

higher costs× Limited manageability and control

Key operational challenges

Page 4: 888 IT Operations Management with Nolio

www.noliosoft.com © 2009 Nolio Application Service Automation. All rights reserved.

Nolio Architecture

Central Server

Proxy Server

Local Agents

Thin Mgmt’ Client

Page 5: 888 IT Operations Management with Nolio

www.noliosoft.com © 2009 Nolio Application Service Automation. All rights reserved.

The Nolio ASAP Solution

Manageability, Visibility, Control

Deploy

Maintain

Remediate

Recover

3rd Party Integration

Sta

ndard

izati

on

Inte

rface

IN

Auto

mati

on

Eng

ine O

UT

Centrally Manage the Application Service-Cycle

Page 6: 888 IT Operations Management with Nolio

Ariel PisetzkyDirector of IT Operations

IT Operations On The Poker Table

Page 7: 888 IT Operations Management with Nolio

888 Achievements with Nolio

Overall: Reduced number of Application failures and reduce Operational Cost!Senior Management – Visibility, Reports Operations management – Control, Visibility and AutomationOps Engineers – “now I can do my job!” (without mistakes, no need to repeat tasks and stay long hours”)

Page 8: 888 IT Operations Management with Nolio

Automation Results and ROI

Process Before Nolio After Nolio Frequency

Quality (avg number of errors)

Time Quality (avg number of errors)

Time

Credit Processing

~8 3 Days ~1 1 Day Monthly

Poker game servers

5 Days 2 Days Monthly

XML Gateway

1 Day 1 Hour Monthly

10’s more

Page 9: 888 IT Operations Management with Nolio

What we did with Nolio

Financial system deploymentsCRM updates & upgradesFront end server roll-outsFront end servers updatesCentral processing application upgradeAnd many, many more

Page 10: 888 IT Operations Management with Nolio

888 IT Ops - Responsibilities

What does the team do?• Keeping the production environment running• Updating the services• Deploying new applications• Building B2B white label environments

How do we measure the team?• Uptime• Stability• Deployment time

Page 11: 888 IT Operations Management with Nolio

2009 IT Ops TargetsQuality of Service• Reduce deployment time• Reduce deployment errors• Automate checklist procedure

Manageability and control• Know who/what/where/when• Control who/what/where/when• Measure our services (quality and time) so we

can improve• Preserve “know-how”

Page 12: 888 IT Operations Management with Nolio

IT Infrastructure – High Level View

Page 13: 888 IT Operations Management with Nolio

IT Infrastructure – Going in to Details

Page 15: 888 IT Operations Management with Nolio

IT Infrastructure – Going in to Numbers

800 servers in production8 types of OS5 main product lines

– Casino– Poker– Sport– Games– Bingo

Over 80 internal applications

Page 16: 888 IT Operations Management with Nolio

888 IT Ops – Org Chart

CIO

IT Ops IT Infra

MonitoringAutomation SupportTier 2

Project Management

Page 17: 888 IT Operations Management with Nolio

Application Changes growth - 2009

> 260%

Page 18: 888 IT Operations Management with Nolio

Constant IT Growth

New datacenter Replace ~300 application servers Relocate online activity – in flight!

More CPU’s – up ~15%Virtualize old physical serversMore storage (40%)More networking devices

Page 19: 888 IT Operations Management with Nolio

Summary – 2009 challenges

Extreme growth of monthly Change RequestsGrowth of servers in the datacentersOpened a new datacenters3 new applications to manage

Page 20: 888 IT Operations Management with Nolio

Why Automation

We had to be prepared: > 260% growth the amount of Change Requests completed! 35% of the servers re-installed or relocated Open an additional datacenter

We had to improve our Service Quality: Reduce human errors servicing critical applications Shorten deployment time of application changes

We had to do it efficiently: Save hundreds of work hours in new deployments Reduce the use of on-call engineers Support business growth with minimum hiring and training.

Page 21: 888 IT Operations Management with Nolio

What to Look for in Automation Holistic solution

Management reports Automation with ease of use – not scheduling Delegation (provide tools for the organization)

Ease of use Easy initial setup and deployment of the solution

You don’t want automation for automation deployment Ongoing maintenance should be easy

Fast ROI Ease of use when writing scenarios

Page 22: 888 IT Operations Management with Nolio

Nolio Rollout in 888 Phase I (design, assessment, planning)

Asses IT Ops Targets for 2009 Targeted specific applications In the selected Apps, traced the processes with the Highest Error rate and

highest cost. Built Process automation gantt.

Phase II (quick wins) Assigned 5% team effort Started with credit processing application Deployed >50 agents & automated time consuming workflows

Results: With minimal* effort, number of deployment errors were reduced by 80%

Phase III (full deployment) All team members know Nolio 10’s of application deployments have been automated 1000’s of successful deployment

* 5 weeks, “sideshow” project, no interference with ongoing activity

Page 23: 888 IT Operations Management with Nolio

SOME SCREEN SHOTS

Page 24: 888 IT Operations Management with Nolio

Nolio in 888 – CRM Upgrade

Page 25: 888 IT Operations Management with Nolio

Nolio in 888 – CRM Upgrade

Page 26: 888 IT Operations Management with Nolio

Nolio in 888 – CRM Upgrade

Page 27: 888 IT Operations Management with Nolio

Nolio in 888 – CRM Upgrade