Monitoring and Managing the new demands of Hybrid Applications

Joe Calçada

Hybrid Cloud ITSM Technical Sales Canada

October 18th 2016.

Hybrid Cloud

Since our 2012 study, cloud technology has become much more mainstream

1IBV report: “The Power of Cloud - Driving Business Model Innovation”, 2012. Link: https://ibm.biz/Bd4uzw

Today, 78% says cloud initiatives

are coordinated or fully integrated

In 2012, only 34% said they had

a solid plan in adopting cloud1

10%0% 30%20% 50%40%

Fully integrated as part of an overall strategic transformation

Multiple related initiatives within a coordinated program

Ad hoc initiatives with some coordination among business

group

Ad hoc initiatives with no coordination among business

group

44%

34%

3%

19%

10%0% 30%20%

We have redesigned our business process due to cloud

We have redesigned out IT infrastructure due to cloud

We have adopted or plan to adopt cloud 21%

7%

6%

How enterprise cloud initiatives are viewed within respondent’s organization

Level of cloud adoption in respondent’s organization

The unique business conditions and requirements of each organization defines its optimal hybrid technology landscape

What categories of applications high performing organizations are planning to migrate to an application-

as-a-service consumption model in two years

10%0% 30%20% 50%40%

Customer Support

Sales and Marketing

Distribution

Finance

Application development and testing

38%

39%

55%

68%

60%

40%

70%

85% of our IT portfolio will be moved

to cloud in 3 to 5 years. The most

important 15% will remain in-house.

IT Director, Telecommunication, USA

“”

We buy bare-metal type of IaaS

and build applications in-house

with our customized platforms.

CTO, IT Services, USA

“”

Today’s Hybrid Cloud and their Applications

Hybrid Application

End users

Devices

MiddlewareWeb Servers, App Servers, …

BackendDataBases, Z Backends, …

Cloud Workloads

On Premises Workloads

Application Resourceson IaaS, PaaS (VMs,

containers, Cloud Foundry runtimes, etc)

Cloud-native

Cloud-enabled

Seamless portability across any IT landscape using containers enables growth in hybrid applications

4

Data & AnalyticsCompute Security

IOT

Application

Storage

Networking

Integrate

Business Rules

Data Cache

Document Generation

Message Hub

Message Hub Incubator

MQ Light

Session Cache

WebSphere App Server

Workflow

Workload Scheduler

Access Trail

App Security on Cloud

IBM Identity Mixer

Key Protect

Network Sec Groups-VMs

Single Sign-On

API Connect

API Harmony

API Management

Cloud Integration

Connect & Compose

Message Connect

Secure Gateway

Secure Broker

Service Discovery

Service ProxyContext Mapping

Driver Behavior

IoT Platform

IoT for Automotive

IoT for Electronics

IoT for Insurance

IoT Real Time Insights

IoT Workbench

Block Storage

Object Storage

Auto-scaling

Blockchain

CDN

Load Balancer for Containers, and Virtual Servers

VPN

Cloud Foundry Runtimes

Docker Containers

OpenStack Virtual Servers

OpenWhisk

Watson

AlchemyAPI

Concept Insights

Conversation

Dialog

Document Conversion

Language Translation

Natural Language Classifier

Personality Insights

Relationship Extraction

Retrieve and Rank

Speech to Text

Text to Speech

Tone Analyzer

Tradeoff Analytics

Visual Insights

Visual Recognition

Analytics Exchange

Apache Spark

BigInsights **

BigInsights for Apache Hadoop

Cloudant NoSQL DB

dashDB (D), dashDB Tx

DataWorks

Decision Optimization **

Elasticsearch by Compose

Embeddable Reporting

Geospatial Analytics

IBM Data Lake **

IBM DataStage on Cloud

IBM DB2 on Cloud

IBM Graph

IBM Master Data Mgmt on Cloud

Insights for Twitter

Insights for Weather

MongoDB by Compose

PostgreSQL by Compose

Predictive Analytics

Redis by Compose

Streaming Analytics

Weather Company Data **

Xpages NoSQL Database

MobileIBM Push Notifications

Mobile Analytics

Mobile App Builder

Mobile App Content Mgr

Mobile Client Access

Mobile Foundation

Mobile Quality Assurance

Presence Insights

DevOps

Active Deploy

Auto-Scaling

Automated Access. Tester

Delivery Pipeline

Deployment Risk Analytics

Digital Content Checker

Globalization Pipeline

IBM Alert Notification

IBM Operations Analytics Advanced Insights **

IBM Runbook Automation

Integration Tester

Monitoring & Analytics

Open Toolchain Fabric **

Track & Plan

** New service this month

Bluemix Public Services – July 2016

Application Management – Driving forces for change The nature & requirements of Applications are evolving…

– The era of Cloud - requires digital engagement, rapid delivery of client

facing applications, and new consumption models with focus on business

outcomes and end user experience.

– Hybrid Applications - Clients in most industries are rapidly moving to

models where their applications are hosted in a mixture of On-premises

infrastructure and Cloud Infrastructure (public and private, IaaS and PaaS)

The nature of “managing the application” is evolving…

– End User Experience - No longer about managing the

infrastructure; rather managing the application to ensure the optimal

end user experience

– Analytics - clients are looking for analytics to solve problems even

faster

– Hybrid Management - As with Hybrid Applications, management

solutions are increasingly hybrid – hybrid technologies and hybrid delivery

models such as on-premises and SaaS

6

7

APM Video on YouTube

Reducing & Preventing Outages and Slowdowns for the 24/7 Hybrid Application World

Application Performance Management can help

Diagnose for quicker problem resolution

Identifyperformance issues beforehand

Isolate where the problem is occurring

1 2 3

Improve availability by 60-90%Reduce outages by 50% or more Diagnose problems 90% faster

Today’s Hybrid Application

End users

Devices

MiddlewareWeb Servers, App Servers, …

BackendDataBases, Z Backends, …

Cloud Workloads

On Premises Workloads

Application Resourceson IaaS, PaaS (VMs,

containers, Cloud Foundry runtimes, etc)

Application Performance ManagementMeeting the new Demands

Data & AnalyticsCompute Security

IOT

Application

Storage

Networking

Integrate

Business Rules

Data Cache

Document Generation

Message Hub

Message Hub Incubator

MQ Light

Session Cache

WebSphere App Server

Workflow

Workload Scheduler

Access Trail

App Security on Cloud

IBM Identity Mixer

Key Protect

Network Sec Groups-VMs

Single Sign-On

API Connect

API Harmony

API Management

Cloud Integration

Connect & Compose

Message Connect

Secure Gateway

Secure Broker

Service Discovery

Service ProxyContext Mapping

Driver Behavior

IoT Platform

IoT for Automotive

IoT for Electronics

IoT for Insurance

IoT Real Time Insights

IoT Workbench

Block Storage

Object Storage

Auto-scaling

Blockchain

CDN

Load Balancer for Containers, and Virtual Servers

VPN

Cloud Foundry Runtimes

Docker Containers

OpenStack Virtual Servers

OpenWhisk

Watson

AlchemyAPI

Concept Insights

Conversation

Dialog

Document Conversion

Language Translation

Natural Language Classifier

Personality Insights

Relationship Extraction

Retrieve and Rank

Speech to Text

Text to Speech

Tone Analyzer

Tradeoff Analytics

Visual Insights

Visual Recognition

Analytics Exchange

Apache Spark

BigInsights **

BigInsights for Apache Hadoop

Cloudant NoSQL DB

dashDB (D), dashDB Tx

DataWorks

Decision Optimization **

Elasticsearch by Compose

Embeddable Reporting

Geospatial Analytics

IBM Data Lake **

IBM DataStage on Cloud

IBM DB2 on Cloud

IBM Graph

IBM Master Data Mgmt on Cloud

Insights for Twitter

Insights for Weather

MongoDB by Compose

PostgreSQL by Compose

Predictive Analytics

Redis by Compose

Streaming Analytics

Weather Company Data **

Xpages NoSQL Database

MobileIBM Push Notifications

Mobile Analytics

Mobile App Builder

Mobile App Content Mgr

Mobile Client Access

Mobile Foundation

Mobile Quality Assurance

Presence Insights

DevOps

Active Deploy

Auto-Scaling

Automated Access. Tester

Delivery Pipeline

Deployment Risk Analytics

Digital Content Checker

Globalization Pipeline

IBM Alert Notification

IBM Operations Analytics Advanced Insights **

IBM Runbook Automation

Integration Tester

Monitoring & Analytics

Open Toolchain Fabric **

Track & Plan

** New service this month

Bluemix Public Services – July 2016

9

A Comprehensive Monitoring Capability Overview

10

Systems & Hypervisors, Network, Storage

Middleware, Databases, Services

Applications: Cloud, mobile, Traditional

Topology:Tracks and displays

dependencies

Diagnostics:(Deep Dive):

Traces/displays methods and timing to get to line of code causing delays

End User Monitoring:(Synthetic & Real)

Measures availability & response time from the user perspective, across geographical locations

Transaction Tracking:Gathers /displays response time across components so end-to end timing is understood

Resource Monitoring:Collects Metrics,

Propagates status

APM UI

Reporting/Analytics:Metric history and trendingMetrics and logs analysisDynamic baselinesPredictive analysis

Monitoring Adoption Model With clear path to deeper insights for IT Ops, LOBs, Developers

IT OPS LOB Developers

IsolateDiagnose

Identify

Eventing & Alerting

Predictive Alerts

Synthetic Monitoring

Val

ue

Resource Monitoring

Correlation of Data and Analytics

Capabilities and insights

SaaS, On-Premises, or Hybrid deployments

End User Experience Monitoring

Transaction Tracking

Deep Dive Diagnostics

Log Search

11

Synthetic Monitoring – Overview

•Record your synthetic transactions visually using a Firefox browser plugin

•Built upon industry leading Selenium technologyScript Recording

•Uses real browsers which download and run all content, including AJAX

•Geographically distributed points-of-presence hosted in IBM SoftLayer data centersScript Playback

•Modern web UI

•Rapidly diagnose the root cause of an issue

Real-time Dashboards

•Get notified of availability or performance issues via email

•Integrate with on-premises OmnibusAlerting

•Upload synthetic transaction scripts

•Configure playback schedules, locations, thresholds and variableSelf-service

Management

•Long term historical reporting built upon CognosReporting

IBM Website Monitoring on Cloud is a pure SaaS offering for monitoring the availability of your public Internet facing websites from multiple geographically

distributed points-of-presence.

12

Anomaly DetectionAlerting before potential issues become service

impacting, enabling IT to shift from reactive to proactive

Cognitive IntelligenceDynamically learns application and infrastructure

behavior; manages thresholds dynamically

ForecastingForecast anomalies and metrics to identify potential critical

issues

Multivariate AnalysisDiscover related KPIs for deeper insight and faster mean

time to repair

Challenge: Reacting to performance thresholds is not enough. IT Staffs must become proactive to ensure mission critical applications never go down.

Predict

IBM Watson Inside

IBM Operations Analytics – Predictive Insights

13

Hybrid Gateway capabilities allow for On-Prem and Cloud Monitoring

Hybrid Gateway allows you to bring data from an On-prem environments into an IBM Performance

Management v8 environment.

Hybrid GW supports resource monitoring data, but not transaction tracking and deep dive diagnostic data.

Use v8 agents for transaction tracking and deep dive diagnostic data..

Both metric data and events can be visualized in IPM v8

Uses a single web based console to view metric data & events, leverage

Role Based Access Control in the Application Dashboard of the

Performance Management server to provide views for operations,

the line of business and development.

WAS

V6

Remote TEMS

HUB TEMS & TEPS

Remote TEMS

Warehouse

WAS

HTTP ServerLoad

BalancerDB2

V6V6

V6WAS

V6

HTTP Server

V6

HTTP Server

V6

V8 APM Server

V8 V8

Hybrid GW

14

Both worlds can be displayed

15

With support for hybrid agents, you now see an icon for the domain where the agent is located, such as these examples:

− IBM Tivoli Monitoring

− IBM Monitoring

− UNKNOWN: No Icon

A Day in the life of IT Operations during a critical IT Outage

GregOps Engineer

AnnetteIT Ops Support

JimApp SME

Launch in Context

Launch in Context

Launch in Context

Service Desk

APM

Storage

?

?

Event Management

?

?

Community & Social

IBM Knowledge Center & Pubs

IBM Support & PMRs

Google Search

Run Books

I haven’t seen this before …

?

Time to first productive action increasing due to tool proliferation and knowledge gaps in first tier IT Ops teams.

MTTR increasing with application complexity and frequent changes

MTTR

The problem we want to solve – Reduce MTTR for WebSphere Application Servers with applied Cognitive Capabilities. And at the heart it is about

reducing MTTK

Pic

ture

so

urc

e: F

orre

ste

r Re

se

arc

h

• Mean Time to Repair for application-related problems is often 3-6 hours

• Application outages are too costly. Average outages last 86mins and cost $450k+

• Issues that go beyond Level 1 support often involve at least 3-4 people taking up an average of 5-7 total man hours

• IT professionals spend a lot of time figuring out how to surface actionable insights from massive amounts of data and information

• Hype Cycle for most of IT technologies shows shorter adoption time for new techno – that’s increasing IT staff knowledge requirements

• What Changed• What Questions to Ask• What Actions to Take• What Steps to Follow• How to Fix It

MTTK:

Knowledge Content

Integrations for Data

Integrations for Action

ITSM Monitoring & ITOA

Attack the MTTR Long Tail with Cognitive IT Ops Solutions

18Page© 2016 IBM Corporation

IT Operations Tier 1 IT Operations SME Cognitive ITOps SME

Your newest employee

• Can listen

• Can understand

• Can relate to you

• Can empathize with you

• Is resourceful

Vision

Knowledge workers bring benefits to organizations in a variety of important ways.

Making the boring stuff insightful. Let our AI quickly tell you what you need to know.

est. DOB: early 1H16

A Day in the life of IT Operations during a critical IT Outage

GregOps Engineer

AnnetteIT Ops Support

JimApp SME

Event Management

What are the common causes

of this error? Community & Social

Google Search

IBM Knowledge Center & Pubs

Support, PMR, APAR,

Technotes

APM

Run Books

What is the resolution for this WAS connection

pool error?

What is the command to

check connection pool resources?

Execute run book WAS-11A.

Service Desk

Create | Update Ticket

Natural language interactions remove

ambiguity and return best content quickly.

MTTR decreasing as productive first steps pushed to first responders