CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast...
Transcript of CON7793 Fast Data Business-User-Friendly Tooling Best ... · Big Data Analysis Business Forecast...
CON7793
Fast Data: Business-User-Friendly Tooling Best Practices
Robin J. SmithProduct Management Strategy DirectorOracle Event ProcessingProduct Management Strategy DirectorOracle Event Processing
Greg RyanSenior Director, MarketingCanon Information and Imaging Solutions
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
Fast Data: Business-User-Friendly Tooling Best PracticesAgenda
Canon Fast Data Solutions
Oracle Event Processing New Business Tooling
1
2
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Oracle Event Processing New Business Tooling• The Concepts
• The New Business Taxonomy
• The Demonstration
2
Fast Data: Business-User-Friendly Tooling Best PracticesAgenda
Canon Fast Data Solutions
Oracle Event Processing New Business Tooling
1
2
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Oracle Event Processing New Business Tooling• The Concepts
• The New Business Taxonomy
• The Demonstration
2
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
How Canon Uses Fast Data to Realize its M2M Vision
Greg Ryan
Senior Director, Marketing
Continuous
Feed
Office
Imaging System
Industry and Others
50%50%40%40%
1010%
Canon Revenue 2013: $35.5B
Canon - Global Leader in B2B Document Solutions
Canon Office ProductsBreakdown by Business Unit
Cut Sheet
#1#1Canon GroupCanon Group
*Source: IDC‘s Worldwide Quarterly Hardcopy Peripherals Tracker, 14Q2
*SFDC: Single Function Digital Copier
No.1 Sales Unit WW in 2013*A3 Laser MFP and SFDC*
Remote Maintenance Service for MFP’s
IoT
1 million + connected devices in over 100 countries
Big Data Challenges
Canon Sales
Companies
Sales
Companies
Partners
Customers
Storage-dependent architecture• Temporary data storage for received events
• Polling mode for data loading
1.Scalability
2.Performance
Be
fore
New Architecture Utilizing Oracle Technologies
Application Server(③ EXALOGIC)Web Server
WebLogic
Path
② OEP
Filtering
History registration
Data summarizingAllocation
① Coherence - scalable, in-memory event receiver for faster response & storage savings
② OEP – filtering for added flexibility and performance
③ EXADATA + Exalogic - high performance & reliable infrastructure
DB Server(③ EXADATA)
①Coherence①Coherence
Path FilteringData summarizing
Email notificationAllocation
:
EventHigh speed DB
Access data on the large memory cache
DeviceRegistrationModel MasterReceived Data Summary Data
MFP’s
1 Million +
ValueAdded
Services
New Service by Big Data Analysis
New
Services
RemoteMaintena
nce +
Remote Maintenance Value Added Services
Data from device
(Service history, production info)
Big Data
AnalysisBusiness
Forecast
Sales
Activities
Supply
Analysis
Product
SpecsOther Data
Sources
(Non device)
M2M Direction of Canon
Remote Maintenance Value Added Services
Microsoft
Salesforce.com
Enterprise Systems
ERP CRM ECM ..etc
Mobile
Intelligent Devices Intelligent Gateway
Enterprise Imaging Platform
M2M Direction of Canon
Java EE
DBWLS
Coh/OEPCoh/OEP
SOA OIT
Exadata
Exalogic
Microsoft
Salesforce.com
Java ME
Oracle Database
Appliance
Java EE
DBWLS
SOA WCC OIT
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Oracle Event Processing Stream Explorer forBusiness users and integrators
Manage the ever-growing real time Event Driven complexities of your Business
The Internet of Things, Social media, Business applicationsBy 2020 50 Billion Devices
will Create an Large Endless Amount of Data in Motion
Devices are becoming more connected
Devices are becoming more intelligent
Social Media can influence a global connected Society
Business applications can now have Event Awareness
The Right Data at the Right Time
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. 16
Business applications can now have Event Awareness
� Event-Driven technologies are perceived as too complex
� Entry barrier for learning the various “event languages ” is very high, certainly
not Business focused
� No easy methodology to quickly identify a real time business pattern that
Technology Challenges for Customers
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. 17
represent Business opportunities and/or threats
� Difficult to adequately & quickly prototype, test event driven Applications
� No well established Cloud, SAAS focused web-tooling
� Mostly used for niche specialty situations by highly technical audience
Connecting Everything & Anything of Interest to your Business
Oracle Event Processing: From Noise to Value
Devices /
Gateways
Services
Internet of Things Enterprise
OEP
• High Volume
• Continuous Streaming
• Sub-Millisecond Latency
• Disparate Sources
• Time-Window Processing
• Pattern Matching
Copyright © 2014 Oracle and/or its affiliates. All rights reserved.
OEPOEPOEPOEP
• Filtering
• Correlation
• Aggregation
• Pattern
matching
“Sea of data”
Macro-event
High-value
Actionable
In-context
OEPembeddedOEP
• High Availability / Scalability
• Coherence Integration
• Geospatial, Geofencing
• Big Data Integration
• Business Event Visualization(Oracle Business Activity Monitoring)
• Action!
Connecting Everything & Anything of Interest to your Business
Oracle Event Processing: From Noise to Value
Devices /
Gateways
Services
Internet of Things Enterprise
OEP
Copyright © 2014 Oracle and/or its affiliates. All rights reserved.
OEPOEPOEPOEP
• Filtering
• Correlation
• Aggregation
• Pattern
matching
“Sea of data”
Macro-event
High-value
Actionable
In-context
OEPembeddedOEP
ExalogicSingle Node Performance1 Million Events/Second
Sparc T5Performance4 Million Events/Second
Complexity grows with Event Driven Technology Sophistication
� Scale-out to handle massive data volumes using commodity cluster
� Distributed event processing using Coherence
� Predictive analysis, Machine learning
� Built-in support for Clustering, Classification, and Regression models
Copyright © 2014 Oracle and/or its affiliates. All rights reserved.
� Big Data Integration
� Tight integration: Hbase, Cassandra, Oracle NoSQL, Apache Flume, Kafka
� Intuitive Visualization of Processed data
� One click dashboard generation using Oracle BAM
The Oracle Stream Explorer empowers Business Users, anywhere, for
Real-Time, Instant Insight of Fast Data Streaming Data Analysis
Designed for SaaS on the Oracle Cloud
A New Breed of Innovative Instant Streaming Insight Tooling
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 21
Requiring NO knowledge of Real Time Event Driven Architectures, the
Standards-based Continuous Query Language (CQL), the high
performance Java Event Server or the semantics of Event Stream
Processing Application Models
Stream Explorer Terminology for Business Users
• Explorer: The application User Interface
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. 22
• Catalog: The repository for browsing resources
Stream Explorer Terminology for Business Users
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. 23
• Shape: A blueprint of an event in a stream or data in a data source. How the
business data is represented in the selected stream
Stream Explorer Terminology for Business Users
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. 24
• Data Source: A connection to static data that is joined to your stream to enrich
it and/or to be used in business logic and output
Stream Explorer Terminology for Business Users
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. 25
• Stream: An incoming flow of events that you want to analyze, for example a
stream of JMS, EDN events, or simulated Business events from a CSV file
Stream Explorer Terminology for Business Users
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. 26
• Exploration: An application that correlates events from streams, data from data
sources, even other Explorations. It uses filters, groupings, summaries, ranges,
and more to Identify, Qualify and Expose a Real Time Business Solution
Stream Explorer Terminology for Business Users
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. 27
• Pattern: A pre-built Exploration that addresses a particular business scenario in a
focused and simplified User Interface
Stream Explorer Terminology for Business Users
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. 28
Stream Explorer: Empowers Business Users for Real-Time Streaming Data Analytics and IOT
Proactively identify and act on emerging threats and opportunities in the
Streaming data related to your enterprise
Improve operational efficiencies with actionable insight from real-time
information
Copyright © 2014 Oracle and/or its affiliates. All rights reserved.
information
Improve signal-to-noise ratio by only processing and storing data that is
relevant
Build real-time applications in half the time and with no complexity
Business Problem
Monitor a network of local and remote (Internet of Things)
Equipment/Devices to identify any equipment that continuously
indicates persistent Faults
Demonstration: Equipment Monitoring Solution
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. 30
DeviceID=USCARSORCL8
Device_status_Code=0000
Msg=“Devices in Healthy State from heartB”
DeviceID=ITROMETELI5
Device_status_code=7B90
Msg=“Drive Motor Malfunction detected HDR” DeviceID=ITROMETELI5
Device_status_code=7B90
Msg=“Drive Motor Malfunction detected HDR”
Our Oracle Stream Explorer Analysis Steps for Success
Step 1) Identify Device Stream Source (JMS) and Database Device Reference Tables (Device Codes/Details)
Step 2) EXPLORATION 1: Build the complete Business Context relating to every Device (Equipment) and Display
• Join the live device stream with more information for each device with historical reference data in a database table,
such as location of the specific failing equipment and details relating to each Error Code
• Adjust information elements and push for downstream BAM Dashboard
Step 3) Severe Errors Exploration: Interrogate Device Business Data Monitoring for Severe Errors
Demonstration: Equipment Monitoring Solution
Copyright © 2014 Oracle and/or its affiliates. All rights reserved.
Step 3) Severe Errors Exploration: Interrogate Device Business Data Monitoring for Severe Errors
• Select Devices that indicate a specific Error code
Step 4) Many Severe Errors Exploration: Immediately Identify Error Analysis Pattern and Display
• We will maintain a count of each unique DeviceID
• In a 3 hour time window (from now) identify when a device sends fault messages more than or equal to 3 times?
Step 5) Many Severe Errors Details Exploration: Augment Device having Severe Errors with Persisted Information and Display
• Join the live device Analysis stream with information for each device with historical reference data in a database table
• Push seriously failing devices resultant data stream and information downstream to Dashboard
Fast Data @ Oracle Openworld 2014
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. 32
OEPBOF SOA Event Delivery Network
empowered by Fast Data
Lloyd Williams, Simone Geib Oracle TUESDAY
07:00 PM
Moscone South -
302
How Fast Data Is Turned into Fast Information
and Timely Action
Lucas Jellema AMIS Holding B.V. WEDNESDAY
02:00 PM
Moscone South -
236
Hands-on Fast Data Development with Oracle
Event Processing 12c
Robin Smith, Lloyd Williams, Prabhu Thukkaram, Bing
Song, Sandeep Bishnoi
Oracle THURSDAY
08:30 AM
Hotel Nikko -
Nikko Ballroom III
Fast Data: A Customer’s Journey to Delivering
a Compelling Real-Time Solution
Lloyd Williams, Guido Schmutz, Rui Pereira Oracle, Trivadis AG THURSDAY
01:15 PM
Moscone South -
270
Canon at OOW 2014
• Canon Booth, Moscone South # 2101
� Business Process Automation (P2P, O2C)
� Canon’s Enterprise Imaging Platform
� Field Service Automation
� Mini Theatre Presentations on the ½ hour
• JDE Pavilion, Moscone West # 3817
Procure to Pay /Order to Cash� Procure to Pay /Order to Cash
� Inventory Management
• Sessions:
� Fast Data: Best Practices…Mon at 2:45
Moscone South #236
� JDE Wearables…Thurs at 12:00
Moscone West #2024