Integrating BI - Data Warehouse and Big Data

Post on 14-Jun-2015

377 views 9 download

Tags:

description

Towards the integration of traditional Business Intelligence Systems and Big Data. An introduction for young big data fans.

Transcript of Integrating BI - Data Warehouse and Big Data

Dr. Raúl Arrabales

Academic / Innovation Director@MbitSchool

Integrating BI/DW & Big Data

(for young big data fans)

BIG & OPEN DATA. Análisis y

Programación con R. Jul. ‘14

There seem to be two different worlds out there

“Plumbers” “Real IT crowd”

BI vs. Big Data

Is it all about trends?Are there different needs?Should they be integrated?

Can these guys really talk to each other?

Different perspectivesIT crowd standpoint

“Legacy” BI/DW

Pre-existing Boiler Room interior. Ford Assembly Building in Richmond - Photo by Billy Hustace.

Different perspectivesPlumbers standpoint

What’s the real deal with traditional BI and Big Data?

What’s the real deal with traditional BI and Big Data?

Big Data Marketing and Media

Created Bubble

What’s the real deal with traditional BI and Big Data?

Big Data Hype

BI Plateau

We are lighter during high tide…

Let’s have a look to real needs

Increased data flow (volume, velocity)

Let’s have a look to real needs

Let’s have a look to real needs

Increased need to process

un-structured

data (variety,

viscosity)

Yes, we need real-time big data sometimes

But careful! You might get the goodies analyzing small data

(cheaper and faster)

Avoid data hoarding!

Remember…

Compulsive hoarding in a private apartment - Photo by Thomas Haemmerli.

Compulsive hoarding in its

worst forms can cause fires,

unclean conditions (e.g. rat and

roach infestations), injuries from

tripping on clutter, and other

health and safety hazards.

OK, what we need is…,

sometimes it’s “traditional” BI, sometimes it’s Big Data,

sometimes it is…

Different worlds?

Different worlds?

The three worlds that need to be connected

Online analytical processing (OLAP)Online Transaction Processing (OLTP)

The magic of integration

Predictive analysis

Enterprise BI

Departamental BI

Personal BI

Mobile BI

Business Analytics

Big Data

Ops

BI as a Service

The magic of integration

Predictive analysis

Enterprise BI

Departamental BI

Personal BI

Mobile BI

Business Analytics

Big Data

Ops

TOOLS NEED TO CONVERGE

BI as a Service

BI Tools are now mature and well tested

Big Data still needs some refinement

And current integrations… Look like this

Well trained IT professionals are needed

Well trained IT professionals are needed

Módulo 1:

El entorno de la Inteligencia de Negocio (BI) y el Big Data.

Módulo 2:

Arquitecturas BI y Big Data.

Módulo 3:

Implantación de soluciones BI y Big Data.

Módulo 4:

Análisis de la Información y Extracción de Conocimiento.

Módulo 5:

Visualización y Reporting.

Módulo 6: Integración de conocimientos y competencias –

Proyecto Final de Máster.

All BI vendors are

now also Big Data converts

By 2015, the shifting tide of BI platform

requirements, moving from reporting-centric

to analysis-centric, will mean the majority of

BI vendors will make governed data discovery

capabilities an expansion of, and the prime

competitive capability for, their BI platform

offerings*.

* Gartner Magic Quadrant for Business Intelligence and Analytics Platforms” by Rita L. Sallam, Joao Tapadinhas, Josh Parenteau, Daniel Yuen and Bill Hostmann, 20 February 2014.

BI reporting analytics

Big Data

data set size

analytics

Same goals: extract value from data.

Analytics

Structured Data

Unstructured Data

Reporting

Real-Time

Customized

Visualization

Interactive

Customized

Technological hype provides exciting

learning opportunities… Take advantage of it.

Dr. Raúl Arrabales

Academic / Innovation Director@MbitSchool

Integrating BI/DW & Big Data

(for young big data fans)

BIG & OPEN DATA. Análisis y

Programación con R. Jul. ‘14