Oracle Management Cloud

Copyright © 2015, Oracle and/or its affiliates. All rights reserved. |

Oracle Management Cloud: Log Analytics


Safe Harbor Statement

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

2


Agenda

Oracle Management Cloud Overview

Log Analysis Challenges

Introducing Oracle Management Cloud: Log Analytics

Key Capabilities

1

2

3

4

3


Agenda




Key Capabilities

1

2

3

4

4

Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | 5

Introducing Oracle Management Cloud

Vision:

Complete suite of IT Operations services on the cloud

Monitoring

Diagnostics Performance Management

Orchestration

Scheduler Configuration Management

Reporting

Notifications

Logs

Analytics

Resource Management


Continuous Ingestion Machine Learning

Real-Time Processing

Customer-Generated Data

Machine-Generated Data

All of Your Operational Data, Correlated and Analyzed

Anomaly Detection

Real-time Insight

Comprehensive Monitoring


Initial Offerings Solve The Most Pressing IT Challenges

Application Performance Monitoring

Improve End-User Experience

and System Performance; Diagnose Performance Issues

Faster

Log Analytics

Extract Value from Logs by Collecting, Correlating, and

Searching Any Kind of Log Data; Quickly Discover Anomalies

IT Analytics

Make Critical Decisions About Your IT Estate; Plan For Growth, Run

What-If Analyses, Compare Resource Usage


Agenda




Key Capabilities

1

2

3

4

8


A Wealth of Data in Log Files!

LOG FILES

OPERATIONAL INTELLIGENCE

CUSTOMER PROFILE AND

BEHAVIOR COMPLIANCE

SECURITY FORENSICS

PERFORMANCE MONITORING

PROBLEM TROUBLESHOOTING


Extracting Insight from Log Data 2015-05-10T12:59:52.212: INFO: OrderApp-3212: Order type: Failed, cust: 933373, order: 3997396, region: APAC <May 10, 2015 12:59:50 PM PST> <Error> <Server> <BEA-002608> <The Listen Thread closed because of an error> java.sql.SQLException: Closed Connection at oracle.jdbc.driver.SQLStateMapping.newSQLException(SQLStateMapping.java:70) at processOrders.acme.com(SubmitOrder.java:112) 150510 12:59:45 [ERROR] /usr/sbin/mysqld: Incorrect key file for table '/tmp/#sql_21b2_0.MYI'; try to repair it 150510 12:59:45 [ERROR] Got an error from unknown thread, storage/myisam/mi_write.c:223 150510 12:59:45 [ERROR] /usr/sbin/mysqld: Sort aborted: Error writing file '/tmp/MYK74Kpi' (Errcode: 28) Jul 17 22:04:29 router last message repeated 2 times Jul 17 22:04:29 router dnsprobe[276]: Primary DNS server Is Down... Switching To Secondary DNS server Jul 17 22:05:08 router dnsprobe[276]: Switching Back To Primary DNS server


Extracting Insight from Log Data 2015-05-10T12:59:52.212: INFO: OrderApp-3212: Order type: Failed, cust: 933373, order: 3997396, region: APAC <May 10, 2015 12:59:50 PM PST> <Error> <Server> <BEA-002608> <The Listen Thread closed because of an error> java.sql.SQLException: Closed Connection at oracle.jdbc.driver.SQLStateMapping.newSQLException(SQLStateMapping.java:70) at processOrders.acme.com(SubmitOrder.java:112) 150510 12:59:45 [ERROR] /usr/sbin/mysqld: Incorrect key file for table '/tmp/#sql_21b2_0.MYI'; try to repair it 150510 12:59:46 [ERROR] Got an error from unknown thread, storage/myisam/mi_write.c:223 150510 12:59:46 [ERROR] /usr/sbin/mysqld: Sort aborted: Error writing file '/tmp/MYK74Kpi' (Errcode: 28) May 10, 2015 22:04:29 myhost.acme.com: router dnsprobe[276]: dns query failed May 10, 2015 22:04:30 myhost.acme.com: router dnsprobe[276]: Primary DNS server Is Down... Switching To Secondary DNS server May 10, 2015 22:04:30 myhost.acme.com: router dnsprobe[276]: Switching Back To Primary DNS server

Order Number

Error Message

Time Stamp

Host Name

Error Message


But Extracting Information from Logs is Challenging…

• Log data scattered across 1000s of infrastructure, server, platform and application logs

• Log content and format is diverse , proprietary and growing over 40%* every year

•Aggregation and parsing is slow can take hours or days

* Monash Research: Growth in machine-generated data


Elastic Apps & Agile Development Exacerbate The Problem

•Dynamic application topologies making it difficult to analyze the right log data

•Agile developers create new

types of log messages unknown to IT Ops or usable in rule-based alerts

Application Application Application


Agenda




Key Capabilities

1

2

3

4

14


Introducing Oracle Management Cloud Log Analytics

15

Database Application

Storage EMCC Repository

Application

Storage

Customer Data Center

Customer Private Cloud

Customer Oracle Public Cloud

Customer AWS

Logs + Operational Data




A Cloud Service that leverages a modern, secure, big-data platform pre-fabricated to

integrate data across silos

Monitor, aggregate, index, analyze, search and explore, correlate All Log Data from your

applications and infrastructure (on-premise and cloud) in real-time

Oracle Application

Storage

Database Application

Storage


Key Business Value For Log Analytics Cloud Service

16

Detect problems early Troubleshoot problems faster Work Collaboratively between Development and Operations

Lower Investment Lower Learning Curve

No Hardware/Software

Make Better Decisions Efficient and Accurate Problem Troubleshooting

Fast Time to Value Using Cloud

Service Harness machine data for better

decisions Real-time operational insight into

app health & availability


Agenda




Key Capabilities

1

2

3

4

17


APM Integration

A Differentiated Way to Explore Log Data

Topology Awareness

Machine Learning

Light Touch Aggregation

18

Dashboards


Topology Aware Log Exploration

• Intrinsic knowledge of application topology

– Auto-create and update application topology

– Accurate and efficient search and exploration in context of the application and supporting infrastructure

• Auto-discovery and real-time collection of any type of log data across all components of application stack

– Syslog, application server, database, application, network devices, Windows events, etc.

Application/System Topology

Log Data Sources

Explore logs specific to the application experiencing the problem


Machine Learning Based Pattern and Outlier Detection

• Smart clustering of log events based on common signature helps identify patterns and outliers

– Reduce millions of log events into a smaller set of patterns

– Rapid troubleshooting of a problems, by quickly identifying outliers and intermittent errors

• Intelligent drill-down and pivoting provides further insight into root-cause by showing chronological log of entries preceding and following event of interest

Aug 18 11:00:57 Unable to create file ABC.txt for user root Aug 18 23:07:26 Unable to create file DEF.txt for user larry Aug 18 23:08:30 Unable to create file XYZ.ppt for user moe Aug 18 23:08:22 Unable to create file ZZ.top for user curly Aug 18 23:08:01 Succeeded authorizing right 'system.priv.admin’

Reduce the above log entries to a pattern and an anomaly Pattern: <Date> Unable to create file <File-Name> for user <User-Name> Outlier: Aug 18 23:08:01 Succeeded authorizing right 'system.priv.admin'

Analyze and explore log data efficiently


Light Touch Log Aggregation

• Ingest, parse, and analyze ANY log file

– Any infrastructure, Any application, Any platform, Syslogs

• Simplified configuration to enable log monitoring

– Auto-enable log monitoring

– Auto-identification of log types

• Named uploads of log file collections for ad-hoc collaboration

Rapid time-to-value with automatic, secure ingestion of ANY Log data

Log Source Parsers


Dashboards Provide Real-Time Operational Insight

• Delivers out-of-the-box dashboards for entire application stack providing extensive monitoring of key log events

• Compose custom dashboards delivering immediate insight across your IT and business events and metrics

– Predefined widgets, charts and controls exposing critical operational and business metrics

• Compose dashboards with integrated views from across all cloud services

Gain business and IT insights from log data


Application Performance Monitoring Integration

• Easily expand troubleshooting effort by drilling into logs from your APM tool

• Easily know what happened in your application, platform and infrastructure logs in context of your application request flows within the specific time of issue

23

Troubleshoot problems from end user performance issues down to logs

Drilldown to Log

Oracle Management Cloud

Software

Transcript of Oracle Management Cloud