Integrating BI - Data Warehouse and Big Data

33
Dr. Raúl Arrabales Academic / Innovation Director @MbitSchool Integrating BI/DW & Big Data (for young big data fans) BIG & OPEN DATA. Análisis y Programación con R. Jul. ‘14

description

Towards the integration of traditional Business Intelligence Systems and Big Data. An introduction for young big data fans.

Transcript of Integrating BI - Data Warehouse and Big Data

Page 1: Integrating BI - Data Warehouse and Big Data

Dr. Raúl Arrabales

Academic / Innovation Director@MbitSchool

Integrating BI/DW & Big Data

(for young big data fans)

BIG & OPEN DATA. Análisis y

Programación con R. Jul. ‘14

Page 2: Integrating BI - Data Warehouse and Big Data

There seem to be two different worlds out there

“Plumbers” “Real IT crowd”

Page 3: Integrating BI - Data Warehouse and Big Data

BI vs. Big Data

Is it all about trends?Are there different needs?Should they be integrated?

Can these guys really talk to each other?

Page 4: Integrating BI - Data Warehouse and Big Data

Different perspectivesIT crowd standpoint

“Legacy” BI/DW

Pre-existing Boiler Room interior. Ford Assembly Building in Richmond - Photo by Billy Hustace.

Page 5: Integrating BI - Data Warehouse and Big Data

Different perspectivesPlumbers standpoint

Page 6: Integrating BI - Data Warehouse and Big Data

What’s the real deal with traditional BI and Big Data?

Page 7: Integrating BI - Data Warehouse and Big Data

What’s the real deal with traditional BI and Big Data?

Big Data Marketing and Media

Created Bubble

Page 8: Integrating BI - Data Warehouse and Big Data

What’s the real deal with traditional BI and Big Data?

Big Data Hype

BI Plateau

Page 9: Integrating BI - Data Warehouse and Big Data
Page 10: Integrating BI - Data Warehouse and Big Data

We are lighter during high tide…

Page 11: Integrating BI - Data Warehouse and Big Data

Let’s have a look to real needs

Increased data flow (volume, velocity)

Page 12: Integrating BI - Data Warehouse and Big Data

Let’s have a look to real needs

Page 13: Integrating BI - Data Warehouse and Big Data

Let’s have a look to real needs

Increased need to process

un-structured

data (variety,

viscosity)

Page 14: Integrating BI - Data Warehouse and Big Data
Page 15: Integrating BI - Data Warehouse and Big Data

Yes, we need real-time big data sometimes

But careful! You might get the goodies analyzing small data

(cheaper and faster)

Avoid data hoarding!

Page 16: Integrating BI - Data Warehouse and Big Data

Remember…

Page 17: Integrating BI - Data Warehouse and Big Data

Compulsive hoarding in a private apartment - Photo by Thomas Haemmerli.

Compulsive hoarding in its

worst forms can cause fires,

unclean conditions (e.g. rat and

roach infestations), injuries from

tripping on clutter, and other

health and safety hazards.

Page 18: Integrating BI - Data Warehouse and Big Data

OK, what we need is…,

sometimes it’s “traditional” BI, sometimes it’s Big Data,

sometimes it is…

Page 19: Integrating BI - Data Warehouse and Big Data

Different worlds?

Page 20: Integrating BI - Data Warehouse and Big Data

Different worlds?

Page 21: Integrating BI - Data Warehouse and Big Data

The three worlds that need to be connected

Online analytical processing (OLAP)Online Transaction Processing (OLTP)

Page 22: Integrating BI - Data Warehouse and Big Data

The magic of integration

Predictive analysis

Enterprise BI

Departamental BI

Personal BI

Mobile BI

Business Analytics

Big Data

Ops

BI as a Service

Page 23: Integrating BI - Data Warehouse and Big Data

The magic of integration

Predictive analysis

Enterprise BI

Departamental BI

Personal BI

Mobile BI

Business Analytics

Big Data

Ops

TOOLS NEED TO CONVERGE

BI as a Service

Page 24: Integrating BI - Data Warehouse and Big Data

BI Tools are now mature and well tested

Page 25: Integrating BI - Data Warehouse and Big Data

Big Data still needs some refinement

Page 26: Integrating BI - Data Warehouse and Big Data

And current integrations… Look like this

Page 27: Integrating BI - Data Warehouse and Big Data

Well trained IT professionals are needed

Page 28: Integrating BI - Data Warehouse and Big Data

Well trained IT professionals are needed

Módulo 1:

El entorno de la Inteligencia de Negocio (BI) y el Big Data.

Módulo 2:

Arquitecturas BI y Big Data.

Módulo 3:

Implantación de soluciones BI y Big Data.

Módulo 4:

Análisis de la Información y Extracción de Conocimiento.

Módulo 5:

Visualización y Reporting.

Módulo 6: Integración de conocimientos y competencias –

Proyecto Final de Máster.

Page 29: Integrating BI - Data Warehouse and Big Data

All BI vendors are

now also Big Data converts

Page 30: Integrating BI - Data Warehouse and Big Data

By 2015, the shifting tide of BI platform

requirements, moving from reporting-centric

to analysis-centric, will mean the majority of

BI vendors will make governed data discovery

capabilities an expansion of, and the prime

competitive capability for, their BI platform

offerings*.

* Gartner Magic Quadrant for Business Intelligence and Analytics Platforms” by Rita L. Sallam, Joao Tapadinhas, Josh Parenteau, Daniel Yuen and Bill Hostmann, 20 February 2014.

BI reporting analytics

Big Data

data set size

analytics

Page 31: Integrating BI - Data Warehouse and Big Data

Same goals: extract value from data.

Analytics

Structured Data

Unstructured Data

Reporting

Real-Time

Customized

Visualization

Interactive

Customized

Page 32: Integrating BI - Data Warehouse and Big Data

Technological hype provides exciting

learning opportunities… Take advantage of it.

Page 33: Integrating BI - Data Warehouse and Big Data

Dr. Raúl Arrabales

Academic / Innovation Director@MbitSchool

Integrating BI/DW & Big Data

(for young big data fans)

BIG & OPEN DATA. Análisis y

Programación con R. Jul. ‘14