1HP Confidential THE BIG DATA ECOSYSTEM AND YOU!.

1 HP Confidential

THE BIG DATA ECOSYSTEM AND YOU!

2 HP Confidential

BIG DATA ECOSYSTEM OVERVIEW DIAGRAM:

Statistics

Transactional Data (OLTP)

ETL Business Intelligenc

e

Unstructured Data

Data Warehouse

Internal Users

Transactional

Applications

External Users

Backoffice(ERP)

Social Media and Consumer Sentiment

http://images.google.com/imgres?imgurl=http://linux.softpedia.com/screenshots/Talend-Open-Studio_1.png&imgrefurl=http://linux.softpedia.com/progScreenshots/Talend-Open-Studio-Screenshot-19135.html&h=598&w=768&sz=130&hl=en&start=12&sig2=fectlnlgp7ogqTwkTgmOGw&tbnid=x2Jye0DbxrcydM:&tbnh=111&tbnw=142&ei=iO5GSI_rCY2EpASfuOXOBQ&prev=/images?q=talend&gbv=2&hl=en

3 HP Confidential


Statistics



e

Unstructured Data

Data Warehouse

Internal Users

Transactional

Applications

External Users

Backoffice(ERP)


Transactional Data – Source Systems and/or Point of Sale• Vary Greatly from Company

to company • EX: Insurance Policy and

Claims Systems, Brokerage Trade Systems, Academic Enrollment Systems, Enery Smart Grids, Hospital Patient Management Systems, etc, etc…..ERP Data – Operational Management,

Planning and Feedback• EX: Supply Chain, Finance &

Accounting, Inventory Management, HR, CRM, etc, etc...


4 HP Confidential

Big Data Decision Point! – Data Mart or EDW

Key Drivers:• What is the Size of your Source Data?

• Should Big Data sit inside or Outside of your EDW?

• Normalize or Denormalize?

• Integrated Reporting or Isolated Reporting?

P

Enterprise Data Warehouse

ETL, Replication, Data Quality

BI or Reporting Interface

SQL,

ODBC,

JDBC

Bulk &

Trickle

Loads

App./Reporting front-end

ETL, Replica

tion, Data

Quality



5 HP Confidential


Statistics



e

Unstructured Data

Data Warehouse

Internal Users

Transactional

Applications

External Users

Backoffice(ERP)


Moving data from one system to another and getting it right is often the most frustrating and time consuming piece of the BI Ecosystem puzzle

Quality - Time - $$$ (is good enough… good enough?)

ETL – Extraction, Transformation, Loading

Or

ELT – Extraction, Loading, Transformation


6 HP Confidential

Big Data Decision Point! – ETL, ELT or Data Virtualization?

Key Drivers:• What is the Quality of your Source Data?

• How complex is the model?

• Can the database handle ELT batch rework in time?

• Do you have the right tools (Informatica, CompositeSW)?

• Can you live with the maintenance overhead, performace?

7 HP Confidential


Statistics



e

Unstructured Data

Data Warehouse

Internal Users

Transactional

Applications

External Users

Backoffice(ERP)


Often very difficult to ROI: “Are your users satisfied with your company’s BI delivery?” - Gartner

Data Warehouse(s?)

Central Storage Tank for most the company’s most critical data

True success requires Executive Evangelism

The ecosystem lives or dies based on the performance of your data warehouse!


8 HP Confidential

Old School Tech (Row Store) or New School Tech (Columnar, NoSQL)?

Key Drivers:

• Can your database handle your data volumes?

• Does the cost of performance tuning justify status quo?

• Real-time or batch?

• Commodity MPP or Big Iron?

• Are you monetizing your data or heating your data center?

AAPLAAPLBBYBBY

AAPL NYASE NYAASE NYSE NYASE NGGYSE NYGGGSE NYSE NYSE NYSE 143.74 NYSE NYSE NYSE 5/05/09

9 HP Confidential


Statistics



e

Unstructured Data

Data Warehouse

Internal Users

Transactional

Applications

External Users

Backoffice(ERP)


Business Intelligence and Advanced Analytics

Is your corporate culture one that views Business Intelligence output as a key driver to your company’s success?

Can analysts use BI output to make positive, effective, fact-based decisions?


10 HP Confidential

In-Database Analytics or Application Based Analytics?

Key Drivers:• Performance – Cubes or Relational?

• Are you living in a canned report or ad-hoc world?

• Does your business have highly advanced, specialized analytics needs?

• Do your data mining users require the aid of an analytics GUI?

11 HP Confidential


Statistics



e

Unstructured Data

Data Warehouse

Internal Users

Transactional

Applications

External Users

Backoffice(ERP)


Unstructured Data:

The final piece of the big-data puzzle?

Is there data floating around the you need to understand but can’t figure out how to analyze?

Do you know what’s happening on your company’s network? How consumers feel about your product? If your call centers are actually helping your business?

Web logs / Clickstream

Social Media

Call Center

Consumer Sentiment

Lobs, Blobs, and Clobs


12 HP Confidential

Hadoop or not to Hadoop?

Key Drivers:• Is it critical you understand your company’s messiest data?

• Do you have the skills and know-how?

• HDFS vs MapReduce

• Could you take action on the information if you had it?

• Exposing MapReduce results through BI or EDW

• Are there alternatives to Hadoop?

Hadoop / Vertica: Advanced Analytics

Computer Cluster

DFS Block 1DFS Block

1

DFS Block 1

DFS Block 2

DFS Block 2

DFS Block 2

DFS Block 3

DFS Block 3

Map

Map

Map

Reduce

Data

data data data data da

data data data data data

data data data data data data










Computer Cluster

DFS Block 1DFS Block

1

DFS Block 1

DFS Block 2

DFS Block 2

DFS Block 2

DFS Block 3

DFS Block 3

Map

Map

Map

Reduce

Hadoop / Vertica: ETL

13 HP Confidential

Big Data Trends - Data Governance:

Data About Your Data• Do you really understand your data? Do your users?

• How many versions of the truth are there?

• Does your organization have the commitment to build adhere to standards?

14 HP Confidential

Big Data Trends - Cloud:

You *MAY* put your data in the Cloud, but DON’T put your Head there!

• Public cloud vs. Private Cloud vs. SaaS – What’s best for you?

• Is it secure? Is it disaster-proof?

• Does is perform?

• Is it cost effective?

15 HP Confidential

Big Data Trends – Mobile:

If you’re not delivering Mobile BI to your user and customers, you’ve fallen behind.

• Tools are making Mobile Delivery easier every day.

• Your customers expect it. Your internal users *should* expect it.

• Do you have a Mobile Data Security Strategy?

16 HP Confidential

Advice for Survival in the Big-Data world:

• BE PROACTIVE IN TRANSFORMING YOUR BUSINESS!

• STAY ON TOP OF NEW TECHNOLOGIES!

• PARTNER WITH THE BUSINESS!

• BE AWARE OF THE BIG DATA TECHNOLOGY YOU INTERACT WITH EVERY

DAY, AND APPLY IT TO YOUR BUSINESS!

17 HP Confidential

THANK YOU FOR YOUR TIME…

AND GOOD LUCK IN YOUR BIG DATA

EFFORTS!

18 HP Confidential18 HP Confidential

Q&A

1HP Confidential THE BIG DATA ECOSYSTEM AND YOU!.

Documents

Transcript of 1HP Confidential THE BIG DATA ECOSYSTEM AND YOU!.