CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast...

34

Transcript of CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast...

Page 1: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing
Page 2: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

CON7793

Fast Data: Business-User-Friendly Tooling Best Practices

Robin J. SmithProduct Management Strategy DirectorOracle Event ProcessingProduct Management Strategy DirectorOracle Event Processing

Greg RyanSenior Director, MarketingCanon Information and Imaging Solutions

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Page 3: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

Safe Harbor Statement

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

Page 4: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

Fast Data: Business-User-Friendly Tooling Best PracticesAgenda

Canon Fast Data Solutions

Oracle Event Processing New Business Tooling

1

2

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Oracle Event Processing New Business Tooling• The Concepts

• The New Business Taxonomy

• The Demonstration

2

Page 5: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

Fast Data: Business-User-Friendly Tooling Best PracticesAgenda

Canon Fast Data Solutions

Oracle Event Processing New Business Tooling

1

2

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Oracle Event Processing New Business Tooling• The Concepts

• The New Business Taxonomy

• The Demonstration

2

Page 6: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Page 7: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

How Canon Uses Fast Data to Realize its M2M Vision

Greg Ryan

Senior Director, Marketing

Page 8: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

Continuous

Feed

Office

Imaging System

Industry and Others

50%50%40%40%

1010%

Canon Revenue 2013: $35.5B

Canon - Global Leader in B2B Document Solutions

Canon Office ProductsBreakdown by Business Unit

Cut Sheet

#1#1Canon GroupCanon Group

*Source: IDC‘s Worldwide Quarterly Hardcopy Peripherals Tracker, 14Q2

*SFDC: Single Function Digital Copier

No.1 Sales Unit WW in 2013*A3 Laser MFP and SFDC*

Page 9: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

Remote Maintenance Service for MFP’s

IoT

1 million + connected devices in over 100 countries

Page 10: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

Big Data Challenges

Canon Sales

Companies

Sales

Companies

Partners

Customers

Storage-dependent architecture• Temporary data storage for received events

• Polling mode for data loading

1.Scalability

2.Performance

Be

fore

Page 11: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

New Architecture Utilizing Oracle Technologies

Application Server(③ EXALOGIC)Web Server

WebLogic

Path

② OEP

Filtering

History registration

Data summarizingAllocation

① Coherence - scalable, in-memory event receiver for faster response & storage savings

② OEP – filtering for added flexibility and performance

③ EXADATA + Exalogic - high performance & reliable infrastructure

DB Server(③ EXADATA)

①Coherence①Coherence

Path FilteringData summarizing

Email notificationAllocation

EventHigh speed DB

Access data on the large memory cache

DeviceRegistrationModel MasterReceived Data Summary Data

MFP’s

1 Million +

Page 12: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

ValueAdded

Services

New Service by Big Data Analysis

New

Services

RemoteMaintena

nce +

Remote Maintenance Value Added Services

Data from device

(Service history, production info)

Big Data

AnalysisBusiness

Forecast

Sales

Activities

Supply

Analysis

Product

SpecsOther Data

Sources

(Non device)

Page 13: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

M2M Direction of Canon

Remote Maintenance Value Added Services

Microsoft

Google

Salesforce.com

Enterprise Systems

ERP CRM ECM ..etc

Mobile

Intelligent Devices Intelligent Gateway

Enterprise Imaging Platform

Page 14: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

M2M Direction of Canon

Java EE

DBWLS

Coh/OEPCoh/OEP

SOA OIT

Exadata

Exalogic

Microsoft

Google

Salesforce.com

Java ME

Oracle Database

Appliance

Java EE

DBWLS

SOA WCC OIT

Page 15: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Oracle Event Processing Stream Explorer forBusiness users and integrators

Page 16: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

Manage the ever-growing real time Event Driven complexities of your Business

The Internet of Things, Social media, Business applicationsBy 2020 50 Billion Devices

will Create an Large Endless Amount of Data in Motion

Devices are becoming more connected

Devices are becoming more intelligent

Social Media can influence a global connected Society

Business applications can now have Event Awareness

The Right Data at the Right Time

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. 16

Business applications can now have Event Awareness

Page 17: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

� Event-Driven technologies are perceived as too complex

� Entry barrier for learning the various “event languages ” is very high, certainly

not Business focused

� No easy methodology to quickly identify a real time business pattern that

Technology Challenges for Customers

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. 17

represent Business opportunities and/or threats

� Difficult to adequately & quickly prototype, test event driven Applications

� No well established Cloud, SAAS focused web-tooling

� Mostly used for niche specialty situations by highly technical audience

Page 18: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

Connecting Everything & Anything of Interest to your Business

Oracle Event Processing: From Noise to Value

Devices /

Gateways

Services

Internet of Things Enterprise

OEP

• High Volume

• Continuous Streaming

• Sub-Millisecond Latency

• Disparate Sources

• Time-Window Processing

• Pattern Matching

Copyright © 2014 Oracle and/or its affiliates. All rights reserved.

OEPOEPOEPOEP

• Filtering

• Correlation

• Aggregation

• Pattern

matching

“Sea of data”

Macro-event

High-value

Actionable

In-context

OEPembeddedOEP

• High Availability / Scalability

• Coherence Integration

• Geospatial, Geofencing

• Big Data Integration

• Business Event Visualization(Oracle Business Activity Monitoring)

• Action!

Page 19: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

Connecting Everything & Anything of Interest to your Business

Oracle Event Processing: From Noise to Value

Devices /

Gateways

Services

Internet of Things Enterprise

OEP

Copyright © 2014 Oracle and/or its affiliates. All rights reserved.

OEPOEPOEPOEP

• Filtering

• Correlation

• Aggregation

• Pattern

matching

“Sea of data”

Macro-event

High-value

Actionable

In-context

OEPembeddedOEP

ExalogicSingle Node Performance1 Million Events/Second

Sparc T5Performance4 Million Events/Second

Page 20: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

Complexity grows with Event Driven Technology Sophistication

� Scale-out to handle massive data volumes using commodity cluster

� Distributed event processing using Coherence

� Predictive analysis, Machine learning

� Built-in support for Clustering, Classification, and Regression models

Copyright © 2014 Oracle and/or its affiliates. All rights reserved.

� Big Data Integration

� Tight integration: Hbase, Cassandra, Oracle NoSQL, Apache Flume, Kafka

� Intuitive Visualization of Processed data

� One click dashboard generation using Oracle BAM

Page 21: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

The Oracle Stream Explorer empowers Business Users, anywhere, for

Real-Time, Instant Insight of Fast Data Streaming Data Analysis

Designed for SaaS on the Oracle Cloud

A New Breed of Innovative Instant Streaming Insight Tooling

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 21

Requiring NO knowledge of Real Time Event Driven Architectures, the

Standards-based Continuous Query Language (CQL), the high

performance Java Event Server or the semantics of Event Stream

Processing Application Models

Page 22: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

Stream Explorer Terminology for Business Users

• Explorer: The application User Interface

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. 22

Page 23: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

• Catalog: The repository for browsing resources

Stream Explorer Terminology for Business Users

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. 23

Page 24: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

• Shape: A blueprint of an event in a stream or data in a data source. How the

business data is represented in the selected stream

Stream Explorer Terminology for Business Users

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. 24

Page 25: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

• Data Source: A connection to static data that is joined to your stream to enrich

it and/or to be used in business logic and output

Stream Explorer Terminology for Business Users

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. 25

Page 26: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

• Stream: An incoming flow of events that you want to analyze, for example a

stream of JMS, EDN events, or simulated Business events from a CSV file

Stream Explorer Terminology for Business Users

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. 26

Page 27: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

• Exploration: An application that correlates events from streams, data from data

sources, even other Explorations. It uses filters, groupings, summaries, ranges,

and more to Identify, Qualify and Expose a Real Time Business Solution

Stream Explorer Terminology for Business Users

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. 27

Page 28: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

• Pattern: A pre-built Exploration that addresses a particular business scenario in a

focused and simplified User Interface

Stream Explorer Terminology for Business Users

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. 28

Page 29: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

Stream Explorer: Empowers Business Users for Real-Time Streaming Data Analytics and IOT

Proactively identify and act on emerging threats and opportunities in the

Streaming data related to your enterprise

Improve operational efficiencies with actionable insight from real-time

information

Copyright © 2014 Oracle and/or its affiliates. All rights reserved.

information

Improve signal-to-noise ratio by only processing and storing data that is

relevant

Build real-time applications in half the time and with no complexity

Page 30: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

Business Problem

Monitor a network of local and remote (Internet of Things)

Equipment/Devices to identify any equipment that continuously

indicates persistent Faults

Demonstration: Equipment Monitoring Solution

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. 30

DeviceID=USCARSORCL8

Device_status_Code=0000

Msg=“Devices in Healthy State from heartB”

DeviceID=ITROMETELI5

Device_status_code=7B90

Msg=“Drive Motor Malfunction detected HDR” DeviceID=ITROMETELI5

Device_status_code=7B90

Msg=“Drive Motor Malfunction detected HDR”

Page 31: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

Our Oracle Stream Explorer Analysis Steps for Success

Step 1) Identify Device Stream Source (JMS) and Database Device Reference Tables (Device Codes/Details)

Step 2) EXPLORATION 1: Build the complete Business Context relating to every Device (Equipment) and Display

• Join the live device stream with more information for each device with historical reference data in a database table,

such as location of the specific failing equipment and details relating to each Error Code

• Adjust information elements and push for downstream BAM Dashboard

Step 3) Severe Errors Exploration: Interrogate Device Business Data Monitoring for Severe Errors

Demonstration: Equipment Monitoring Solution

Copyright © 2014 Oracle and/or its affiliates. All rights reserved.

Step 3) Severe Errors Exploration: Interrogate Device Business Data Monitoring for Severe Errors

• Select Devices that indicate a specific Error code

Step 4) Many Severe Errors Exploration: Immediately Identify Error Analysis Pattern and Display

• We will maintain a count of each unique DeviceID

• In a 3 hour time window (from now) identify when a device sends fault messages more than or equal to 3 times?

Step 5) Many Severe Errors Details Exploration: Augment Device having Severe Errors with Persisted Information and Display

• Join the live device Analysis stream with information for each device with historical reference data in a database table

• Push seriously failing devices resultant data stream and information downstream to Dashboard

Page 32: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

Fast Data @ Oracle Openworld 2014

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. 32

OEPBOF SOA Event Delivery Network

empowered by Fast Data

Lloyd Williams, Simone Geib Oracle TUESDAY

07:00 PM

Moscone South -

302

How Fast Data Is Turned into Fast Information

and Timely Action

Lucas Jellema AMIS Holding B.V. WEDNESDAY

02:00 PM

Moscone South -

236

Hands-on Fast Data Development with Oracle

Event Processing 12c

Robin Smith, Lloyd Williams, Prabhu Thukkaram, Bing

Song, Sandeep Bishnoi

Oracle THURSDAY

08:30 AM

Hotel Nikko -

Nikko Ballroom III

Fast Data: A Customer’s Journey to Delivering

a Compelling Real-Time Solution

Lloyd Williams, Guido Schmutz, Rui Pereira Oracle, Trivadis AG THURSDAY

01:15 PM

Moscone South -

270

Page 33: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing

Canon at OOW 2014

• Canon Booth, Moscone South # 2101

� Business Process Automation (P2P, O2C)

� Canon’s Enterprise Imaging Platform

� Field Service Automation

� Mini Theatre Presentations on the ½ hour

• JDE Pavilion, Moscone West # 3817

Procure to Pay /Order to Cash� Procure to Pay /Order to Cash

� Inventory Management

• Sessions:

� Fast Data: Best Practices…Mon at 2:45

Moscone South #236

� JDE Wearables…Thurs at 12:00

Moscone West #2024

Page 34: CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast Sales Activities Supply Analysis Product Specs Other Data Sources ... Manage the ever-growing