Oracle Big Data Building A Big Data Management...
Transcript of Oracle Big Data Building A Big Data Management...
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. |
Effi Psychogiou ECEMEA Big Data Product Director May, 2015
Oracle Big Data Building A Big Data Management System
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. |
Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Big Data Disruption
Digitization × Datafication
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Customer Experience
Operational Improvement
New Business Models
44% 30% 26%
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Traditional Currency
Photo Film
Postal Services
Printing Press
Record Industry
Digital Currency
Web Publishing
Email Digital Camera
Digital Download
Entire Industries are Being Disrupted
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 6
de Persgroep Customer 360 Improve prospecting Better content Improve subscriber retention
Increase Share
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Bigger Smarter
Easier
Cheaper Better
Faster VALUE FROM DATA
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. |
Why Is Big Data Important? Value Creation
HEALTH CARE AUTOMOTIVE COMMUNICATIONS
“In a big data world, a competitor that fails to sufficiently develop its capabilities will be left behind.”
Reduce Prescription Fraud
Predict Failures
Gain Customer sentiment insight
Offering New Services based on Location
Data
McKinsey Global Institute
RETAIL
Better Predict Product Success
BANKING
Better understand customers
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. |
Big Data is a Strategic Initiative, not just a Tactic Why is Big Data Important for Organisations
“…CaixaBank has partnered with Oracle to develop a new technology platform that can help improve the business and enable the bank to anticipate the needs of customers with a 360 view of the customer*”
Juan Maria Nin
CEO CaixaBank
(*) Mentioned in a business review with financial analysts in London, 26 March 2014
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 10
CREATE VALUE
SILOS OF INNOVATION SYSTEMS OF RECORD
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 11
Preserving Customer Investment & Managing All Types of Data
Fourth Generation Oracle Data Architecture
Generation 4 Generation 3 Generation 2 Generation 1 Database Cloud Service
Multitenant
Internet Architecture
Thin Clients
Client/Server
PCs and Servers
Minicomputer &
Mainframe Database • Big Data In-Memory
• Hadoop & NoSQL • Unstructured Data • Objects, XML
• PL/SQL • Text, Images
• Relational • SQL
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | #StrataHadoop - Oracle Big Data Architecture
Use the Right Tool for the Job and benefit from the Power of “AND”
Relational Hadoop NoSQL
Run the Business Integrate existing
systems
Mission-critical tasks
Use existing
investments
Ensure skills relevance
Change the Business
Disrupt competitors
Disintermediate supply
chains
Leverage new paradigms
Exploit new analyses
Scale the Business
Serve data faster
Persist data streams
Meet mobile and device
challenges
Scale-out economically
4th Generation Data Architecture Technologies for Big Data
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Execution
Innovation
#StrataHadoop - Oracle Big Data Architecture
4th Generation Data Architecture for Big Data
Warehouse Data Factory Reservoir
Data Streaming
Data Platform
Discovery Lab
Analytics
Enterprise Data
Other Data Sources
Data Streams
Business Data
Social/Log Data
Model First Analytics
• Reporting-oriented • Often enterprise wide
in scope, cross LoB • “you know the
questions to ask”
Reports & Dashboards
Data First Analytics
• Data Exploration • Highly visual and/or
interactive • “you don’t know the
questions to ask”
Discovery
• Telematics • Industry Services • Internet of Things • Sentiment
Data Services
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Execution
Innovation
#StrataHadoop - Oracle Big Data Architecture
Comprehensive Oracle Solution for Big Data
Warehouse Factory Reservoir
Data Streaming
Data Platform
Discovery Lab
Analytics
Enterprise Data
Other Data Sources
Data Streams
Business Data
Social/Log Data
Model First Analytics
• Reporting-oriented • Often enterprise wide
in scope, cross LoB • “you know the
questions to ask”
Reports & Dashboards
Data First Analytics
• Data Exploration • Highly visual and/or
interactive • “you don’t know the
questions to ask”
Discovery
• Telematics • Industry Services • Internet of Things • Sentiment
Data Services
Apache Oracle
NoSQL & OEP
Oracle Data Integration & Governance
Oracle Database & Big Data SQL
Oracle R
Oracle Big Data
Discovery
Oracle Business
Intelligence
Oracle Big Data
Discovery
Apache
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Execution
Innovation
#StrataHadoop - Oracle Big Data Architecture
Integrated Oracle Engineered Systems for Big Data
Data Streaming
Data Platform
Discovery Lab
Analytics
Enterprise Data
Other Data Sources
Data Streams
Business Data
Social/Log Data
Model First Analytics
• Reporting-oriented • Often enterprise wide
in scope, cross LoB • “you know the
questions to ask”
Reports & Dashboards
Data First Analytics
• Data Exploration • Highly visual and/or
interactive • “you don’t know the
questions to ask”
Discovery
• Telematics • Industry Services • Internet of Things • Sentiment
Data Services
Analytics
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Execution
Innovation
#StrataHadoop - Oracle Big Data Architecture
Visionary Oracle Cloud for Big Data
Data Platform
Discovery Lab
Analytics
Enterprise Data
Other Data Sources
Data Streams
Business Data
Social/Log Data
Model First Analytics
• Reporting-oriented • Often enterprise wide
in scope, cross LoB • “you know the
questions to ask”
Reports & Dashboards
Data First Analytics
• Data Exploration • Highly visual and/or
interactive • “you don’t know the
questions to ask”
Discovery
• Telematics • Industry Services • Internet of Things • Sentiment
Data Services
Data Streaming
Big Data Platform as a
Service
Big Data Discovery Platform as a
Service
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 17 Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
BIG DATA MANAGEMENT
BIG DATA ANALYTICS
BIG DATA APPLICATIONS
BIG DATA INTEGRATION
DATA CAPITAL
Connect And Govern Any Data Streaming + Batch
Simplify Access To All Data
Data Reservoir + Data Warehouse
Discover And Predict, Fast
Discovery + Business Analytics
Accelerate Data-Driven Action Mobile + Web + On-device
Enterprise Class Big Data Capabilities For Organizations Creating Value from the Data Capital
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | #StrataHadoop - Oracle Big Data Architecture
Oracle Brings Business Value to Big Data
Enterprise-Grade Capabilities
Discover and Predict – Fast
Govern and Secure All Data
Simplify Access to All Data
Performance Integration Availability Scalability Manageability
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Discover and Predict, Fast
19
BIG DATA MANAGEMENT
BIG DATA ANALYTICS
BIG DATA APPLICATIONS
BIG DATA INTEGRATION
DATA CAPITAL
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 20
What if we could make data preparation 20% of the effort so you can focus 80% of your time on executing and improving your business?
Inverting Data Access Cycles
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. |
Oracle Big Data Discovery The Visual Face of Hadoop – Making data preparation 20% of the effort
find explore transform discover share
#StrataHadoop - Oracle Big Data Architecture
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Hadoop / Big Data Appliance
• Oracle R Distribution1
• Oracle R Advanced Analytics for Hadoop2
• SAS High Performance Analytics
• Oracle SQL Analytic functions
1 Included with BDA 2 Included w/Oracle Big Data Connectors
Oracle Database / Exadata
• Oracle Advanced Analytics Option
• SAS High Performance Analytics
• Oracle SQL Analytic functions
Statistical & Predictive Analytics Bring the Analytics to the Data
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 23
Stubhub Predictive analytics means winning the fraud arms race
90% Fraud Cut
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 24
BIG DATA MANAGEMENT
BIG DATA ANALYTICS
BIG DATA APPLICATIONS
BIG DATA INTEGRATION
DATA CAPITAL
Simplify access to all data
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Big Data Management Hadoop + NoSQL + Relational
25
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Oracle Big Data SQL One Fast Query for All Your Data
26
NoSQL
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 27
Extracting Value from Data in Unexpected Ways
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 28
BIG DATA MANAGEMENT
BIG DATA ANALYTICS
BIG DATA APPLICATIONS
BIG DATA INTEGRATION
DATA CAPITAL
Govern and Secure All Data
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | #StrataHadoop - Oracle Big Data Architecture
Comprehensive Integration and Governance
Fast Load
Speed Layer
Batch Layer
Oracle Data Integrator (Transform)
Oracle GoldenGate (Move & Ingest)
Data Governance Foundation
Enterprise Data Quality (Profile & Cleanse)
Enterprise Metadata Management & Business Glossary (Business Glossary, Data Lineage, Impact Analysis and Data Provenance)
Veridata (Verify)
Data Enrichment (Prepare)
Real-Time Data Movement – Low impact capture, stage in Hadoop – Continuous data availability
Data Transformation – Bulk data movement – Pushdown data processing
Data Governance – Prepare unstructured data – Profile data with sampling – Clean data in real time or batch – Verify data for consistency – Trace lineage of all data – Define glossary of business terms
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Securing Hadoop and NoSQL
30
NoSQL
Extending the Oracle Database security umbrella
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. |
18 Sun Oracle X5-2L Servers with per server:
• 2 * 18-core Intel® Xeon® Haswell-EP - fastest Intel processor ever shipped
• 128 GB Memory (SR: 768GB, FR: 2304GB)
• 48TB Disk space (SR: 288TB, FR: 864TB)
Integrated Software (4.1):
• Oracle Linux6.5, Oracle JDK 7u72
• Cloudera Distribution of Apache Hadoop 5.3 – EDH Edition, Cloudera Manager 5.3
• Oracle Big Data SQL 1.1, Oracle R Distribution 3.1.1-2, Oracle NoSQL Database CE 3.2.4
Oracle Big Data Appliance X5-2 Available in 6 / 12 / 18 node Configurations
#StrataHadoop - Oracle Big Data Architecture
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | #StrataHadoop - Oracle Big Data Architecture
Proven, Cost Effective Solution
“Oracle Big Data Appliance is an excellent choice for customers looking to work with the full suite of Cloudera’s leading Hadoop-based technology. It’s more cost-effective and quicker to deploy than a DIY cluster.”
⁻ Mike Olson, Cloudera founder, Chief Strategy Officer, and Chairman of the Board
21% Cost Savings
33% Faster Time
to Value
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 33
Where to Start?
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 34
Decide on Your Big Data Approach
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
BIG DATA INTEGRATION
1. Transform the business
2. Lay the foundation
3. Pilot
BIG DATA ANALYTICS
BIG DATA APPLICATIONS
CREATE VALUE FROM DATA
BIG DATA MANAGEMENT
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Find Your Big Data Project Project Roadmap
• Define the Question
• Define the Ideal Data Set
• Determine what Data you can Access
• Obtain & Clean the Data
• Perform Exploratory Analysis (identify patterns in the data)
• Perform Statistical Prediction/Modeling (intuition on what will happen)
• Interpret & Challenge Results
• Write Up & Distribute Results
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Make Up The Big Data Project Team Skills Profile
Business
Data Analytics
• Motivating Questions
• Hypothesis on Data
• Results Communication
• Maths & Statistics
• Data Exploration
• Prediction Modeling
• Results Interpretation
• Computer Science
• Acquisition & Integration
• Preparation
• Quality Assurance
+ Curiosity
+ Tenacity
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Build On Big Data Skills & Technologies Data & Analytics
• Data
– Hadoop & MapReduce
– NoSQL (e.g. Oracle NoSQL Database)
– Database (e.g. Oracle Database)
– Programming Languages: SQL, Java/C++
– Scripting languages: PHP, Python, Perl, JavaScript,
• Analytics – Understanding of statistical data analysis
– Experience with packages such as R, MATLAB, SPSS, SAS, Oracle Advanced Analytics
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Oracle BigDataLite Virtual Machine
An integrated environment to help you get started with the Oracle Big Data platform.
Many Oracle Big Data platform components have been installed and configured - allowing you to begin using the system right away.
Download Oracle BigDataLite
http://www.oracle.com/technetwork/database/bigdata-appliance/oracle-bigdatalite-2104726.html
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. |
The Big Opportunity of the Future is Data Capital
39 Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | #StrataHadoop - Oracle Big Data Architecture
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | 40
Oracle Can Help You Find Unique Value From Your Data Capital