Big Data Next Frontier for Innovation 032714 · 2017-12-23 · Implementing analytics and applying...

Big Data: Next Frontier for Innovation

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. 1

Next Frontier for Innovation

Selim Burduroğlu

Global Innovation Evangelist & Architect

Education & Research Industries

03.26.14

@theselimb

Big Things!


Big Things!

“The implementation of a state-of-the-art Data

Analytics program is the foundational platform

required for the three Discovery Themes to have a

transformative impact on the advancement of science

and technology research, education, and outreach


and technology research, education, and outreach

across the university.”

—David Cole, Professor and Ohio Research Scholar, School of Earth

Sciences, College of Arts and Sciences

“The notion of “Big Data” has created a stir and

promises to revolutionize all walks of human endeavor

ranging from the financial industry to the health-care

industry, from the social sciences (e.g., study of

personalized and social interactions) to engineering (e.g.,

analyzing sensory data from the manufacturing process),


analyzing sensory data from the manufacturing process),

and from scientific discovery to cyber-security.”

—David Tomasko, Professor of Chemical and Biomolecular Engineering, Associate Dean for

Undergraduate Education and Student Services, College of Engineering

“Data Analytics includes the set of skills necessary to

identify how to manage, represent and manipulate large

and complex data stores, how to abstract, model, and

effectively analyze such data to facilitate the identification

and evaluation of appropriate hypothesis and actionable

patterns, and how to create quantitative visual cues to


patterns, and how to create quantitative visual cues to

help explain and take informed decisions from those

data.”

—David Tomasko, Professor of Chemical and Biomolecular Engineering, Associate Dean for

Undergraduate Education and Student Services, College of Engineering

Big Data Defined


Big Data Defined


Source - http://jeffhurtblog.com

Where does Big Data


Big Data

come from?

#Genlike Generation

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.23

Affordability and Transparency


http://www.whitehouse.gov/issues/education/higher-education/college-score-card

The Rise of the MOOCs


Google announces Android software

for wearable techLaunching a new software development kit, Google is preparing

for a new market of smartwatches and other wearable

technologies - starting with a Motorola ‘moto 360’ watch in

summer 2014


summer 2014

2014 Survey of College and University Presidents

50%


50% of campus leaders agree that President Obama's plan to

collect and report data on college outcomes is appropriate

- but just 13 percent are confident that the data will be accurately

collected and reported.

Machine to Machine EraInfinite Possibilities – By 2020

People in the WORLD


CONNECTED Devices

History of Big Data


Big Data

1943


Records Department of FBI

1998


Implementing analytics and applying it to

make data driven decisions is a major

differentiator between high performing and


differentiator between high performing and

low performing organizations.

Big Data: The Next Frontier for Innovation, Competition and Productivity

McKinsey Global Institute. 2012

What Makes it Big Data?

SOCIAL

BLOG

101100101001

001001101010


VOLUME VELOCITY VARIETY VALUE

SMART

METER

001001101010

101011100101

010100100101

Thoughts Things Processes


People to Machine (P2M)Ohio State Doctor Shows Promise of Google Glass in Live Surgery


Islands

of DataStale Data

Drowning in

Spreadsheets


Gather and

Organize All Data

of Data

Lack of

Data Skill

Stale DataSpreadsheets

12%

Produce Data

The Big Data Problem and Opportunity


Use Data

12%

Executives who feel they

understand the impact data

will have on their organizations

Capture massive data volumes

Produce Data

How do you shrink this gap?

Oracle’s Strategy for Big Data


Analyze all data

Secure and unify the data platform

Use Data

Big Data Connectors and Data Integrator


Big Data Appliance+

Hadoop / NoSQL

Exadata+

Oracle Database

Technically, Hadoop consists of

two key services:

Reliable data storage using the

Hadoop Distributed File System


Hadoop Distributed File System

(HDFS) and high-performance

parallel data processing using a

technique called MapReduce

Hadoop is a large-scale distributed

batch processing infrastructure. While it

can be used on a single machine, its

true power lies in its ability to scale to

hundreds or thousands of computers,


hundreds or thousands of computers,

each with several processor cores.

Hadoop is also designed to efficiently

distribute large amounts of work across

a set of machines.


Produce Data




Analyze all data


Use Data

Analyze All Your Data In-Place

Advanced

Analytics


Big Data Appliance+

Hadoop / NoSQL

Exadata+

Oracle Database

Expose All Data to End Users

Endeca

OBI EE


Big Data Appliance+

Hadoop / NoSQL

Exadata+

Oracle Database


Produce Data




Analyze all data


Use Data

Large, Research Intensive University


Exadata+

Oracle Database

Data Reservoir

Big Data Appliance+

Hadoop

Securing Big Data

� Increasingly, Big Data solutions

are capturing sensitive information

must be protected and audited

� This is no different than critical


� This is no different than critical

data stored in an RDBMS

Enhanced Big Data Security

Authenticateusers with secure Kerberos protocol

Authorizeaccess to data with fine grained controls


Auditactivity and access with Oracle Audit Vault and Database Firewall

Encryptdata as it flows thru the system


Produce Data


Oracle Strategy for Big Data


Analyze all data

Secure and unify the data platformUse Data

Advanced Query & Analysis Full Power of SQL and Advanced Analytics

Transparent to ApplicationsNo Changes to Application Code

Single View of All Data Unified Metadata Across RDBMS & Hadoop


Unified Data Platform

Unified Metadata Across RDBMS & Hadoop

Fastest Performance Utilize SQL Processing Across the Platform

Leverage Existing Skills Lower Cost & Complexity of Big Data Adoption

Skills Gap


Skills Gap

190,000Projected Shortage

In Data Scientists

By 2018


“Data ScientistN.the sexiest job

in the 21st century”

Big Data…


Big Data…

“Every day I wake up and ask, How can I

flow data better, manage data better,

analyze data better?”


Retail and Consumer

Insights with Big Data

analyze data better?”

Rollin Ford, CIO, WalMartSource: The Economist, “Data, Data Everywhere”

Analytics 3.0


Analytics 3.0

Analytics 3.0 – The Era of ImpactTom Davenport – IIA


http://iianalytics.com/a3/

“N In the coming years, 75 to 80 percent of

new cloud applications will be data-intensive, and data is


new cloud applications will be data-intensive, and data is

becoming much more strategic than applications.”

Frank Gens – International Data Corporation (IDC)) Analyst

Analytics 3.0 Reference Architecture

SocialSocial

Expert System

Real-Time Decisions

Event Processing


Information

Discovery

Sensors

Oracle Integrated Solution for Big Data

Hadoop

Data

base

Analy

tics

Data

Warehouse

Analytic

Applications

Oracle NoSQLDatabase

HDFS


ORGANIZE

Oracle Big Data

Connectors

ANALYZE

In-D

ata

base

Analy

tics

Warehouse

DECIDE

Interactive

Discovery

ACQUIRE

Database

EnterpriseApplications

Ma

na

ge

men

tM

an

ag

em

en

t

Se

cu

rity

, G

ove

rna

nc

eS

ec

uri

ty, G

ove

rna

nc

e

Ma

na

ge

men

tM

an

ag

em

en

t

Se

cu

rity

, G

ove

rna

nc

eS

ec

uri

ty, G

ove

rna

nc

e

WarehouseWarehouse

ODSODS

AnalyzeAnalyze

Text AnalyticsText AnalyticsText AnalyticsText Analytics

ScorecardsScorecards

DashboardsDashboards

Query ReportingQuery Reporting

ScorecardsScorecards

DashboardsDashboards

Query ReportingQuery Reporting

RealReal--Time Time

DecisionsDecisions

RealReal--Time Time

DecisionsDecisions

EPM, BI, SocialEPM, BI, Social

ApplicationsApplications

EPM, BI, SocialEPM, BI, Social

ApplicationsApplications

DecideDecide

RealReal--TimeTimeRealReal--TimeTime

Streaming Streaming Streaming Streaming

ETL/ELTETL/ELTETL/ELTETL/ELT

ChangeDCChangeDCChangeDCChangeDC

OrganizeOrganize

TransactionsTransactions

Master &

Reference

Master &

Reference

Str

uctu

red

Machine

Generated

Machine

Generated

Sem

i-str

uctu

red

DataData

DBMS

(OLTP)

DBMS

(OLTP)

AcquireAcquire

Files

Oracle Big Data Architecture Capabilities


Ma

na

ge

men

tM

an

ag

em

en

t

Se

cu

rity

, G

ove

rna

nc

eS

ec

uri

ty, G

ove

rna

nc

e

Ma

na

ge

men

tM

an

ag

em

en

t

Se

cu

rity

, G

ove

rna

nc

eS

ec

uri

ty, G

ove

rna

nc

e

InIn--Database Database

AnalyticsAnalytics

InIn--Database Database

AnalyticsAnalytics

Graph ModelGraph ModelAdvancedAdvanced

AnalyticsAnalytics

AdvancedAdvanced

AnalyticsAnalytics

InteractiveInteractive

DiscoveryDiscovery

InteractiveInteractive

DiscoveryDiscovery

Text AnalyticsText Analytics

and Searchand Search

Text AnalyticsText Analytics

and Searchand SearchStreaming Streaming

Event Event

ProcessingProcessing

Streaming Streaming

Event Event

ProcessingProcessing

Hadoop Hadoop

(MapReduce)(MapReduce)

Hadoop Hadoop

(MapReduce)(MapReduce)

GeneratedGenerated

Social MediaSocial Media

Text, Image

Video, Audio

Text, Image

Video, AudioUn

str

uctu

red

Sem

istr

uctu

red

Specialized

Hardware

Specialized

HardwareIn MemoryIn Memory

AnalyticsAnalytics

In MemoryIn Memory

AnalyticsAnalytics

RDBMSRDBMS

ClusterCluster

RDBMSRDBMS

ClusterCluster

Big DataBig Data

ClusterCluster

Big DataBig Data

ClusterCluster

High SpeedHigh Speed

NetworkNetwork

High SpeedHigh Speed

NetworkNetwork

NoSQLNoSQL

HDFSHDFS

• Demand for Accountability and Transparency

• Fueled by Funding Shortages

• Increased Consumer Like Services

Why Now?Big – Fast – Smart – Hyper Data

• To be Competitive in Global Knowledge Economy

• 7 Billion People in the World only 317 Millions are Americans


• 7 Billion People in the World only 317 Millions are Americans

• To Lead – Everyone needs to be educated and equipped with the skills

of the future

• Innovates use of disruptive technologies such as Cloud, Social,

Analytics, and Mobile...can make Education

• More Accessible, Affordable, and Relevant

21ST Century LearningEssential Ingredients

�Proficiency

�Personalized

�Data-Driven


�Science of Learning

�Data-Driven

�Exploit Technology to Enhance Learning Experience

Big Idea About Big Data for Education & ResearchWhy?

• Increase the quality of decisions made by:

• Students

• Faculty

Advisors/Counselors


• Advisors/Counselors

• Chief Business Officers

• Colleges

• Principal Investigators (PIs)

Big Data in EducationK

� Help predict student success

� Improve graduation rates and student retention

� Determine what learner does know and does not know

� Monitor student’s behavior and level of engagement

The Future is Now!


� Monitor student’s behavior and level of engagement

� Trigger alerts when the learner is getting of track, bored, or

frustrated

� Increase engagement with game mechanics

� And moreN

Closed-Loop Student Success & Experience

Consolidate

IDEN

ANA

LYZ

E

ENG

ACQUIRE

Knowled

ge &

Skills

ADV

INT

ERV

ENE

ENH

GROW

Profess

ional &

Person

al

PREDICT

ANALYZEACQUIREEMPOWER

Knowledge &

INTERVENE

GROWProfessional &


IDEN

TIFY

ENG

AGE

ADV

ANC

E

ENH

ANC

E

al

IDENTIFYENGAGE

Knowledge &

Skills

SUCCEED ENHANCE

Professional &

Personal

When we understand the differences in

our student needs, and drive our services

based on that fact based decision making,


based on that fact based decision making,

we will give them the soil they need to

flourish.

Anonymous

Oracle Big Data ApplianceCost Effective High Performance Hadoop Appliance

� Fastest, Pre-Configured Hadoop Appliance

‒ Best-in-Class Pre-Integrated Software

� Superfast connectivity to Exadata: 15TB/Hour

‒ Partitioned & Non-partitioned; Online & Offline Loads


‒ Partitioned & Non-partitioned; Online & Offline Loads

� Pre-integrated Software

‒ Linux, Java VM, Cloudera Distribution of Hadoop

‒ Oracle R Distribution & NoSQL Database

� Start Small, Add Servers, Add Storage

Oracle ExadataCost Effective Fastest Database Machine

� Speed Up Query Performance 10-100X

‒ Smart-Scan eliminates IO Bottlenecks

‒ Flash Cache enable In-Memory Data Access

‒ Parallel Query provides Scale out Processing


‒ Parallel Query provides Scale out Processing

� Fast, Cheap Storage

‒ Columnar Compression provides 10X Savings

‒ Capacity of Disk; IOs of Flash; Speed of D-RAM

� Start Small, Add Servers, Add Storage

Oracle In-Memory DBMSFastest Query Performance

In-Memory Column Store

State columnSales

>100X Faster

� Scales Up or Scales out

for very large data sets

� Scans use super fast

SIMD vector instructions


SIMD Compare all values in 1

cycle

Vector Compare all values in 1 cycle

Load multiple State values V

ecto

rR

eg

iste

r

“CA”

CPU

SIMD vector instructions

� Billions of rows/sec

scan rate per CPU core

� Joins up to 10X Faster

Oracle DBMS SQL & RAnalyze Data across all your Systems

SQL

Hadoop Oracle Database

R � Expand the data and

users who can analyze

on Hadoop

� Use Full Power of Oracle


� Use Full Power of Oracle

SQL and R on all data

� Stream Hadoop Resident

data through

Fast Big Data Connectors

IB

Customer Examples


National Cancer InstituteIdentifying Relationship between Gene to Cancer Interaction

17,000 Genes

5 Major Cancer Types


60M Patients

20M Medical Publications

5 Major Cancer Types

Location-based Mobile Billboard on Oracle Event Processing

Turkcell

1.5B Events Per Day

800K Events per Second


800K Events per Second

50 Simultaneous Campaigns

Big Data Next Frontier for Innovation 032714 · 2017-12-23 · Implementing analytics and applying...

Documents

Transcript of Big Data Next Frontier for Innovation 032714 · 2017-12-23 · Implementing analytics and applying...