Oracle Big Data Building A Big Data Management...

Effi Psychogiou ECEMEA Big Data Product Director May, 2015

Oracle Big Data Building A Big Data Management System

Safe Harbor Statement

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

Big Data Disruption

Digitization × Datafication

Customer Experience

Operational Improvement

New Business Models

44% 30% 26%

Traditional Currency

Photo Film

Postal Services

Printing Press

Record Industry

Digital Currency

Web Publishing

Email Digital Camera

Digital Download

Entire Industries are Being Disrupted

de Persgroep Customer 360 Improve prospecting Better content Improve subscriber retention

Increase Share

Bigger Smarter

Easier

Cheaper Better

Faster VALUE FROM DATA

Why Is Big Data Important? Value Creation

HEALTH CARE AUTOMOTIVE COMMUNICATIONS

“In a big data world, a competitor that fails to sufficiently develop its capabilities will be left behind.”

Reduce Prescription Fraud

Predict Failures

Gain Customer sentiment insight

Offering New Services based on Location

McKinsey Global Institute

RETAIL

Better Predict Product Success

BANKING

Better understand customers

Big Data is a Strategic Initiative, not just a Tactic Why is Big Data Important for Organisations

“…CaixaBank has partnered with Oracle to develop a new technology platform that can help improve the business and enable the bank to anticipate the needs of customers with a 360 view of the customer*”

Juan Maria Nin

CEO CaixaBank

(*) Mentioned in a business review with financial analysts in London, 26 March 2014

CREATE VALUE

SILOS OF INNOVATION SYSTEMS OF RECORD

Preserving Customer Investment & Managing All Types of Data

Fourth Generation Oracle Data Architecture

Generation 4 Generation 3 Generation 2 Generation 1 Database Cloud Service

Multitenant

Internet Architecture

Thin Clients

Client/Server

PCs and Servers

Minicomputer &

Mainframe Database • Big Data In-Memory

• Hadoop & NoSQL • Unstructured Data • Objects, XML

• PL/SQL • Text, Images

• Relational • SQL

Use the Right Tool for the Job and benefit from the Power of “AND”

Relational Hadoop NoSQL

Run the Business Integrate existing

systems

Mission-critical tasks

Use existing

investments

Ensure skills relevance

Change the Business

Disrupt competitors

Disintermediate supply

chains

Leverage new paradigms

Exploit new analyses

Scale the Business

Serve data faster

Persist data streams

Meet mobile and device

challenges

Scale-out economically

4th Generation Data Architecture Technologies for Big Data

Execution

Innovation

#StrataHadoop - Oracle Big Data Architecture

4th Generation Data Architecture for Big Data

Warehouse Data Factory Reservoir

Data Streaming

Data Platform

Discovery Lab

Analytics

Enterprise Data

Other Data Sources

Data Streams

Business Data

Social/Log Data

Model First Analytics

• Reporting-oriented • Often enterprise wide

in scope, cross LoB • “you know the

questions to ask”

Reports & Dashboards

Data First Analytics

• Data Exploration • Highly visual and/or

interactive • “you don’t know the

questions to ask”

Discovery

• Telematics • Industry Services • Internet of Things • Sentiment

Data Services

Execution

Innovation

Comprehensive Oracle Solution for Big Data

Warehouse Factory Reservoir

Data Streaming

Data Platform

Discovery Lab

Analytics

Enterprise Data

Other Data Sources

Data Streams

Business Data

Social/Log Data

questions to ask”

Discovery

Data Services

Apache Oracle

NoSQL & OEP

Oracle Data Integration & Governance

Oracle Database & Big Data SQL

Oracle R

Oracle Big Data

Discovery

Oracle Business

Intelligence

Oracle Big Data

Discovery

Apache

Execution

Innovation

Integrated Oracle Engineered Systems for Big Data

Data Streaming

Data Platform

Discovery Lab

Analytics

Enterprise Data

Other Data Sources

Data Streams

Business Data

Social/Log Data

questions to ask”

Discovery

Data Services

Analytics

Execution

Innovation

Visionary Oracle Cloud for Big Data

Data Platform

Discovery Lab

Analytics

Enterprise Data

Other Data Sources

Data Streams

Business Data

Social/Log Data

questions to ask”

Discovery

Data Services

Data Streaming

Big Data Platform as a

Service

Big Data Discovery Platform as a

Service

BIG DATA MANAGEMENT

BIG DATA ANALYTICS

BIG DATA APPLICATIONS

BIG DATA INTEGRATION

DATA CAPITAL

Connect And Govern Any Data Streaming + Batch

Simplify Access To All Data

Data Reservoir + Data Warehouse

Discover And Predict, Fast

Discovery + Business Analytics

Accelerate Data-Driven Action Mobile + Web + On-device

Enterprise Class Big Data Capabilities For Organizations Creating Value from the Data Capital

Oracle Brings Business Value to Big Data

Enterprise-Grade Capabilities

Discover and Predict – Fast

Govern and Secure All Data

Simplify Access to All Data

Performance Integration Availability Scalability Manageability

Discover and Predict, Fast

BIG DATA MANAGEMENT

BIG DATA ANALYTICS

DATA CAPITAL

What if we could make data preparation 20% of the effort so you can focus 80% of your time on executing and improving your business?

Inverting Data Access Cycles

Oracle Big Data Discovery The Visual Face of Hadoop – Making data preparation 20% of the effort

find explore transform discover share

Hadoop / Big Data Appliance

• Oracle R Distribution1

• Oracle R Advanced Analytics for Hadoop2

• SAS High Performance Analytics

• Oracle SQL Analytic functions

1 Included with BDA 2 Included w/Oracle Big Data Connectors

Oracle Database / Exadata

• Oracle Advanced Analytics Option

• SAS High Performance Analytics

• Oracle SQL Analytic functions

Statistical & Predictive Analytics Bring the Analytics to the Data

Stubhub Predictive analytics means winning the fraud arms race

90% Fraud Cut

BIG DATA MANAGEMENT

BIG DATA ANALYTICS

DATA CAPITAL

Simplify access to all data

Big Data Management Hadoop + NoSQL + Relational

Oracle Big Data SQL One Fast Query for All Your Data

Extracting Value from Data in Unexpected Ways

BIG DATA MANAGEMENT

BIG DATA ANALYTICS

DATA CAPITAL

Govern and Secure All Data

Comprehensive Integration and Governance

Fast Load

Speed Layer

Batch Layer

Oracle Data Integrator (Transform)

Oracle GoldenGate (Move & Ingest)

Data Governance Foundation

Enterprise Data Quality (Profile & Cleanse)

Enterprise Metadata Management & Business Glossary (Business Glossary, Data Lineage, Impact Analysis and Data Provenance)

Veridata (Verify)

Data Enrichment (Prepare)

Real-Time Data Movement – Low impact capture, stage in Hadoop – Continuous data availability

Data Transformation – Bulk data movement – Pushdown data processing

Data Governance – Prepare unstructured data – Profile data with sampling – Clean data in real time or batch – Verify data for consistency – Trace lineage of all data – Define glossary of business terms

Securing Hadoop and NoSQL

Extending the Oracle Database security umbrella

18 Sun Oracle X5-2L Servers with per server:

• 2 * 18-core Intel® Xeon® Haswell-EP - fastest Intel processor ever shipped

• 128 GB Memory (SR: 768GB, FR: 2304GB)

• 48TB Disk space (SR: 288TB, FR: 864TB)

Integrated Software (4.1):

• Oracle Linux6.5, Oracle JDK 7u72

• Cloudera Distribution of Apache Hadoop 5.3 – EDH Edition, Cloudera Manager 5.3

• Oracle Big Data SQL 1.1, Oracle R Distribution 3.1.1-2, Oracle NoSQL Database CE 3.2.4

Oracle Big Data Appliance X5-2 Available in 6 / 12 / 18 node Configurations

Proven, Cost Effective Solution

“Oracle Big Data Appliance is an excellent choice for customers looking to work with the full suite of Cloudera’s leading Hadoop-based technology. It’s more cost-effective and quicker to deploy than a DIY cluster.”

⁻ Mike Olson, Cloudera founder, Chief Strategy Officer, and Chairman of the Board

21% Cost Savings

33% Faster Time

to Value

Where to Start?

Decide on Your Big Data Approach

1. Transform the business

2. Lay the foundation

3. Pilot

BIG DATA ANALYTICS

CREATE VALUE FROM DATA

BIG DATA MANAGEMENT

Find Your Big Data Project Project Roadmap

• Define the Question

• Define the Ideal Data Set

• Determine what Data you can Access

• Obtain & Clean the Data

• Perform Exploratory Analysis (identify patterns in the data)

• Perform Statistical Prediction/Modeling (intuition on what will happen)

• Interpret & Challenge Results

• Write Up & Distribute Results

Make Up The Big Data Project Team Skills Profile

Business

Data Analytics

• Motivating Questions

• Hypothesis on Data

• Results Communication

• Maths & Statistics

• Data Exploration

• Prediction Modeling

• Results Interpretation

• Computer Science

• Acquisition & Integration

• Preparation

• Quality Assurance

+ Curiosity

+ Tenacity

Build On Big Data Skills & Technologies Data & Analytics

• Data

– Hadoop & MapReduce

– NoSQL (e.g. Oracle NoSQL Database)

– Database (e.g. Oracle Database)

– Programming Languages: SQL, Java/C++

– Scripting languages: PHP, Python, Perl, JavaScript,

• Analytics – Understanding of statistical data analysis

– Experience with packages such as R, MATLAB, SPSS, SAS, Oracle Advanced Analytics

Oracle BigDataLite Virtual Machine

An integrated environment to help you get started with the Oracle Big Data platform.

Many Oracle Big Data platform components have been installed and configured - allowing you to begin using the system right away.

Download Oracle BigDataLite

http://www.oracle.com/technetwork/database/bigdata-appliance/oracle-bigdatalite-2104726.html

The Big Opportunity of the Future is Data Capital

Oracle Can Help You Find Unique Value From Your Data Capital

Oracle Big Data Building A Big Data Management...

Documents

Transcript of Oracle Big Data Building A Big Data Management...

2016 Big Data For Beginners Understanding SMART Big Data, Data Mining & Data Analytics2016 Big Data for Beginners Understanding SMART Big Data, Data Mining & Data Analytics

Big Success With Big Data - Executive Summary · Big Success with Big Data 3 Big success with big data Big data is clearly delivering significant value to users who have actually

Big Data to Big Results - AMT-SYBEX · Big Data – really? Big Data – a bigger definition Pioneers of Big Data ... 16 May 2012 From Big Data to Big Results 9 Smart meters, security

Introduction to Big Data, Big Data Processing, and Big ...eecs.csuohio.edu/~sschung/CIS660/Lecture1_IntroBig... · What’s Big Data? From Wikipedia: • Big data is the term for

Big Data Technology Big Data - aakritsubedi9.com.npaakritsubedi9.com.np/files/Big Data Technology.pdf · Big Data Technology Big Data 1"Big data" is a field that treats ways to analyze,

Real Time Big data Applications: file · Web viewUNIT I. INTRODUCTION TO BIG DATA. Big Data – Definition, Characteristic Features – Big Data Applications - Big Data vs. Traditional

MSA220/MVE440 Statistical Learning for Big Data - Lecture 1 · 2018. 3. 19. · Statistical Learning for Big Data Big Data BIG DATA: can’t t on a HD Big Data: 10Gb+1Tb big data:

Big Data Madison: Architecting for Big Data

· for executive: box big data ussuiu lla:ansnnns1ðxnu big data -big data big -wifñuiaÖ big data big data • hadoop big clouderâ manager hive impala big data 22 airuntju 2559

Big Success With Big Data - Accenture · Big Success with Big Data 3 Big success with big data Big data is clearly delivering significant value to users who have actually completed

Energy Effi 2'

Boiler Effi

Big Data Meets Big Data Analytics

Big Data Curation - pdfs.semanticscholar.org · Big Data Curation Webinar 19/12/2013 BIG Big Data Public Private Forum BIG DATA INSIGHTS Coping with data variety and verifiability

Big Data meets Big Data

Introduction to Big Data. Reference: What is “Big Data”?What is “Big Data”?

การประยุกต์ใช้ Big Data · การประยุกต์ใช้ Big Data ในการบริหารจัดการฐานข้อมูลทางด้าน

Document Scanners - Fujitsu€¦ · Scans everything from business cards to A4 sized documents Effi ciently manages digitized data Effi ciently organizes business card information

CS 7265 BIG DATA ANALYTICS BIG DATA

Effi Cycle Presentation