01 big dataoverview

© 2015 IBM Corporation

Big Data & Analytics DayPresenter name and contact info

© 2015 IBM Corporation2

Untapped Resource Empower Everyone Increased Value

The World of Big Data & AnalyticsIs Rapidly Expanding


Data at Scale Data in Many Forms Data in Motion Data Uncertainty

Big Data Is All Data

Volume Variety Velocity Veracity


Today’s IT challenges and market shifts introduce different data economics

Traditional workloads New workloads

Systems of Engagement

▪ Require massive scale and rapid pace ▪ Accelerate business insights ▪ Rely on data elasticity, supporting

diverse hardware

Systems of Record

▪ Benefit from simplified infrastructure ▪ Require cost efficiency through

improved virtualization and automation

▪ Drive controlled data growth

Transactional systems

Email, supply chain, HR

Virtual servers and desktops

Social and media

Mobile applications

Big Data & AnalyticsIntegrated approach

Exploding Data Volumes

Diverse Data Types

Increasing Value of Information

Mobile & Social Engagement


Why Act Now?

Create IT AgilityManage RiskOutperform

Only 1 in 5 organizations allocate more than 50% of IT budget to new projects

Of leaders cite growth as the key source of value

from analytics

Source:1 - IBM IBV Study: Analytics: A blueprint for value, October 2013 2 - IBM Global Study on the Economic Impact of IT Risk, 2013 3 - IBM Global Data Center Study, 2012

Of respondents were impacted by a cyber security breach over

the past 24 months

46%75% 1in5


Business Tech Trends: Pacesetters

Since the 2012 Tech Trends study, Big Data & Analytics deployment has grown by 39%, with 40% now deploying a significant range of Big Data & Analytics solutions capabilities. Just as crucially, Pacesetters report they are better at achieving key business objectives with Big Data & Analytics.


*Notes: To obtain a global understanding of approaches to these transformational technologies, we surveyed 1447 IT and line of business (LOB) decision-makers — spanning 5 continents and 15 industries.

Leveraging skills from the ecosystem

"Pacesetters run their enterprises on insight

CAMS integration for greater effect

Business Tech Trends 2014 – Pacesetters: Three key characteristics that set them apart

Partnering is in their DNA

Analytics is their fuel

Integration is their breakaway move


Big Data & Analytics on Bluemix https://ace.ng.bluemix.net/#/home

You can launch Big Data services and build applications in minutes on Bluemix. Use only what you need.

https://ace.ng.bluemix.net/%23/home


as likely to have mature analytics capabilities

as likely to have most of skills they need

as likely have deployed a significant range of solutions

Analytics is their fuel Pacesetters run their enterprises on insight

Source: IBM Center for Applied Insights “Raising the game: The IBM Business Tech Trends Study” | www.ibm.com/ibmcai/biztechtrends

7 in 10 say data-driven insights are a significant part of their organization’s decision making process

http://www.ibm.com/ibmcai/biztechtrends


CAMS: the business imperative appears

CAMS technologies: rapidly emerging but lack of skills

Business Tech Trends – Pacesetters are strategically integratingCloud, Analytics, Mobile, and Social (CAMS)

Pacesetting companies: partnering, insight-driven, integrate CAMS

2012

2011

2014

Pacesetters believe technologies are critical to their business

success

AND DRIVE REAL

BUSINESS OUTCOMES


How pacesetters like you can leverage the IBM ecosystem

Use IBM Bluemix to broaden your partnering

experience

Leverage IBM portfolio, skills and data challenges

Maximize CAMS with IBM integration support

Partnering is in their DNA

Analytics is their fuel

Integration is their breakaway move

Enter the Mobile Bluemix App Challenge

Sign up for Watson Analytics beta

List your solutions on the Cloud marketplace

https://ibm.biz/biztechjam http://watsonanalytics.com/ https://ibm.biz/Cloudmkt

https://ibm.biz/biztechjam

http://watsonanalytics.com/

https://ibm.biz/Cloudmkt


About the Authors:

"➢Entrepreneur Huddle Webcast:

https://ibm.biz/techhuddle

➢“Raising the game: The IBM Business Tech Trends Report” https://ibm.biz/IBMBTT14 ➢The IBM Tech Trends interactive Dashboard

http://bit.ly/tt14dashboard

The IBM 2014 Business Tech Trends links & contacts:

Susanne Hupfer, Ph.D. is a consultant with the IBM Center for Applied Insights, where she conducts fact-based research for innovation leaders. @cybersooz

https://ibm.biz/techhuddle

https://ibm.biz/IBMBTT14

http://bit.ly/tt14dashboard

© 2015 IBM Corporation‹#›

Big Data & Analytics is a journey.

Be proactive about privacy, security and governance

Build a culture that infuses

analytics everywhere

Invest in a big data & analytics platform

Imagine It. Realize It. Trust It.


the possibilities of analyzing all available data

Real-time Traffic Flow Optimization

Fraud & risk detection

Accurate and timely threat detection

Predict and act on intent to purchase

Understand and act on customer

sentiment

Low-latency network analysis

Imagine It.


Key Business Imperatives

Create new business models

Optimize operations; counter fraud & threats

Attract, grow, retain customers

Transform financial &

management processes

Manage risk

Improve IT economics

Big Data & Analytics

Big Data & Analytics

Imagine It.


• Acquisition "• Personalization "• Profitability "• Retention

Acquire, grow, retain customers

Optimize operations;

counter fraud & threats

Maximize insight, ensure trust, improve IT economics

Transform management

processes

Create new business models

• Business process operations "

• Infrastructure & asset efficiency "

• Counter fraud "• Public safety & defense

• Harness and analyze all data "

• Enable full spectrum of analytics "

• Govern & protect all data "

• Optimize Big Data & Analytics infrastructure

• Planning & performance management "

• Disclosure management & financial close "

• Incentive compensation management "

• Human capital management

• Data-driven products and services "

• Non-traditionalpartnerships "

• Mass experimentation

Manage risk

• Risk adjusted performance "

• Financial risk "• Operational risk "• Financial crimes "• IT risk & security

Insight Drives Key Business ImperativesImagine It.


Every Industry can Leverage Big Data and Analytics.

Insurance

• 360˚ View of Domain or Subject

• Catastrophe Modeling • Fraud & Abuse

Banking

• Optimizing Offers and Cross-sell

• Customer Service and Call Center Efficiency

Telco

• Pro-active Call Center • Network Analytics • Location Based Services

Energy & Utilities

• Smart Meter Analytics • Distribution Load

Forecasting/Scheduling • Condition Based

Maintenance

Media & Entertainment

• Business process transformation

• Audience & Marketing Optimization

Retail

• Actionable Customer Insight • Merchandise Optimization • Dynamic Pricing

Travel & Transport

• Customer Analytics & Loyalty Marketing

• Predictive Maintenance Analytics

Consumer Products

• Shelf Availability • Promotional Spend

Optimization • Merchandising Compliance

Government

• Civilian Services • Defense & Intelligence • Tax & Treasury Services

Healthcare

• Measure & Act on Population Health Outcomes

• Engage Consumers in their Healthcare

Automotive

• Advanced Condition Monitoring

• Data Warehouse Optimization

Life Sciences

• Increase visibility into drug safety and effectiveness

Chemical & Petroleum

• Operational Surveillance, Analysis & Optimization

• Data Warehouse Consolidation, Integration & Augmentation

Aerospace & Defense

• Uniform Information Access Platform

• Data Warehouse Optimization

Electronics

• Customer/ Channel Analytics • Advanced Condition

Monitoring

Imagine It.


Big Data Exploration Find, visualize, understand all big data to improve decision making

Enhanced 360o View of the Customer Extend existing customer views (MDM, CRM, etc) by incorporating additional internal and external information sources

Operations Analysis Analyze a variety of machine data for improved business results

Data Warehouse Augmentation Integrate big data and data warehouse capabilities to increase operational efficiency

Security/Intelligence Extension Lower risk, detect fraud and monitor cyber security in real-time

The 5 Key Analytical Use Cases


IBM Big Data & Analytics Portfolio

Innovative – easy to consume

Complete – enterprise-ready

Fast – start anywhere and grow


IBM Watson Foundations

Systems, Security, StorageIBM Big Data & Analytics Infrastructure

Reporting, Analysis, Content Analytics

Cognitive

Exploration & Discovery

Decision Management

Predictive Analytics & Modeling

Information Governance Zone

New/ Enhanced

Applications

Real-time Analytics

Zone

Exploration, Landing &

Archive Zone

Information Ingestion & Operational Information

Zone

Enterprise Warehouse, Data Mart &

Analytic Appliance

Zone

Realize It. Invest in a Big Data & Analytics platform. All Data

Transaction and application data

Social data

Image, geospatial, video

Enterprise content

Machine, sensor data

Enterprise content

Third-party data


Realize It. Invest in a Big Data & Analytics platform.

New/ Enhanced

Applications

Why did it happen? Reporting, Analysis, Content Analytics

What did I learn, what’s best? Cognitive

What is happening? Exploration & Discovery

What action should I take? Decision Management

What could happen? Predictive Analytics & Modeling

Be More Right, More Often


Tools to address practical challenges managing Big Data

DB2 with BLU Acceleration ▪ In-memory computing ▪ 35x to 73x faster analytics1, with some queries running more than

1400x faster ▪ instant insight from real-time operational data and historical data ▪ No need for indexes, aggregates, or tuning ▪ Ultimate operational simplicity with “load and go” performance ▪ Available for on-premises or via the cloud

IBM Puredata For Analytics ▪ Simple data appliance for serious analytics. ▪ It simplifies and optimizes performance of data

services for analytic applications, enabling very complex algorithms to run in minutes not hours. ▪ In-Database Geospatial Analytics compatible

with industry standard ESRI GIS formats.


Tools to address practical challenges managing Big Data

InfoSphere BigInsights for Hadoop ▪ For data at rest ▪ 100% standard Hadoop ▪ IBM Big SQL, BigSheets ▪ Developer tools, Accelerators ▪ Ease of use for all roles

InfoSphere Streams ▪ For data in motion ▪ Agile development environment ▪ Sub-millisecond response ▪ Live graph, streams debugger ▪ Packaged adapters and toolkits ▪ Geospatial Toolkit


4x IBM InfoSphere BigInsights delivers performance gain1

1.Audited STAC® Report Securities Technology Analysis Center

Of database queries for reporting2

InfoSphere BigInsights for Hadoop

Realize It. Optimize your Big Data & Analytics infrastructure.

Open Source Hadoop

38xAverage Acceleration

2. Based on internal tests.

DynamicQuery

CompatibleQuery

DynamicCubes

DB2 with BLU

Cognos BI

+"DB2 BLU

+Power


Do you Trust your infrastructure ?


Power Systems with POWER8

Power Systems introduces the first generation of systems built with open innovation to put data to work across the enterprise.

Power S824L

IBM Data Engine for Analytics – Power Systems Edition NEW!

IFL

Power E880

NEW!

IFL

Power E870

NEW! NEW!

IBM Cloud Mgt w Open Stack v4.2E

EEE

E BLU Acceleration – Power System Edition

Value-Propositions for Partners ▪ Larger in-memory databases – up to 2TB (SCO) & up to 16TB (Enterprise) - support

big data demands and mission critical apps securely and with resilience ▪ Run analytics 8X faster w/ NVDIA’s GPU – helps clients quickly discover fresh

opportunities and enter new markets ▪ Achieve 24X infrastructure consolidation vs X86 -- saving your clients money ▪ Simplified cloud management and secure path to hybrid cloud protecting client

investment while reducing resource investment ▪ Develop, build & easily migrate apps on LoP from x86

▪ Easy access to extensive business partner support – i.e. a. IICs/Power Linux Centers make it simpler for software developers to

build and deploy new Linux on Power apps; b. Chiphopper offers no-cost validation of apps onto Linux on Power &

SW middleware; c. Power Development Cloud offers no-charge remote access to

Power Systems for all AIX, IBM i, Linux and Ubuntu to develop, port or migrate apps

NEW!CAPI-attached flash memory

IBM Confidential Until Day of Announcement

E IBM Solution for Analytics – Power System Edition

Designed for Big Data Big Data needs big memory

Open Innovation Platform Continuous innovations, open server ecosystem, collaborative community

Superior Cloud Economics Simplified hybrid Cloud Management

- NEW! Oct 6th launch E - means “enhanced or updated NEW!


IBM Opens POWER8 Processor Architecture for Innovation with OpenPOWER Foundation

POWER8 Provides More Reasons to Run Linux on Power

Foundation: Opening the IBM Power Chip Architecture to Market Innovators

▪ Innovate across a complete server stack based upon the IBM POWER architecture ▪ Produce open hardware, software, firmware and tools through “collaborative innovation” ▪ Innovate customized and highly advanced servers, subsystems, components ▪ Leverage complementary skills and investment from the member companies ▪ Become operational this year

OpenPOWER Foundation is an industry body comprised of passionate innovators who come together to pool their resource around a single purpose to:

• 55 Members and growing http://openpowerfoundation.org/ "

• Servergy becomes first company outside of IBM to build Power server http://www.networkworld.com/news/2014/032414-servergy-becomes-first-company-outside-280008.html

Platinum Members

http://openpowerfoundation.org/press-releases/openpower-foundation-unveils-first-innovations-and-roadmap/

http://www.networkworld.com/news/2014/032414-servergy-becomes-first-company-outside-280008.html


Paradigm shifts enabled by big dataLeverage more of the data being captured

TRADITIONAL APPROACH BIG DATA APPROACH

Analyze small subsets of information

Analyze all information

Analyzedinformation

All available information

All available informationanalyzed


Paradigm shifts enabled by big dataReduce effort required to leverage data


Carefully cleanse information before any analysis

Analyze information as is, cleanse as needed

Small amount of carefully

organized information

Large amount of

messy information


Paradigm shifts enabled by big dataData leads the way—and sometimes correlations are good enough


Start with hypothesis and test against selected data

Explore all data and identify correlations

Hypothesis Question

DataAnswer

Data Exploration

CorrelationInsight


Paradigm shifts enabled by big dataLeverage data as it is captured


Analyze data after it’s been processed and landed in a warehouse or mart

Analyze data in motion as it’s generated, in real-time

Repository InsightAnalysisData

Data

Insight

Analysis


A New Analytical Approach

Information Integration & Governance

Systems SecurityOn premise, Cloud, As a service

Storage

New/Enhanced ApplicationsAll Data

What action should I take?

Decision management

Landing, Exploration and Archive data zone

EDW and data mart

zone

Operational data zone

Real-time Data Processing & Analytics What is happening? Discovery and

exploration

Why did it happen?

Reporting and analysis

What could happen? Predictive

analytics and modeling

Deep Analytics data

zone What did I learn,

what’s best? Cognitive

The 5 W’s


"•Big data requires analytics to surface relevant data and make it actionable "•Business requires blend of analytics and data – not siloed by data store or limited by programmer availability "•Demands for fast performance require querying data where it resides and running processing closer to the data "•Analytics must demonstrate value quickly and grow to support the clients’ analytics journey

Analytics Have Evolve and Expand with Big Data

© 2015 IBM Corporation‹#› Degree of Complexity

Com

petit

ive

Adv

anta

ge

Standard Reporting

Ad hoc reporting

Query/drill down

Alerts

Simulation

Forecasting

Statistics

Optimization

What exactly is the problem?

What will happen next and WHY ?

What if these trends continue?

What could happen…. ?

What actions are needed?

How many, how often, where?

What happened?

Stochastic Optimization

Descriptive

Prescriptive

Predictive

How can we achieve the best outcome?

How can we achieve the best outcome including the effects of variability?

The Analytic Landscape

What did i learned, and what is the best? CognitiveStandard Reporting


Combine data in motion and at rest "Optimized access to: BigInsights via Big SQL and SAP HANA

IBM Cognos Business Intelligence V10.2.2

IBM® Business Analytics

IBM Big Data Platform Other Big Data Sources Enterprise Data Sources

Stream Computing*

Hadoop Systems

Data Warehouse

Our business generates a lot of data, and the Cognos BI platform helps us understand all our "big data". As a result we have a complete view of what is happening in the business so that we can effectively communicate our transformation strategy . "Mark Lacks Manager, Strategy Analytics & Business Intelligence Mueller

Business Intelligence Get the Most Complete View of the Business


Rapidly Adaptive Visualization Engine - RAVE


Predictive AnalyticsGet more Accurate Models with bigger volume and variety of data

- Read Data from Hadoop "- Write back to Hadoop "- Export your Models to Streams

- Prepare your Data on Hadoop "- Few Models can run on Hadoop "- R analytic capabilities in SPSS """


dr5ru7|2013-01-01 00:00:00|2013-01-01 00:15:00

Geohash Start timestamp End timestamp

Geospatial Data Mining Get more Accurate Models with bigger volume and variety of data


Powerful Analytics for Everyone

Watson Analytics ▪ Single Business Analytics Experience -

Watson Analytics is a seamless, unified experience that brings together a set of self-service enterprise data and analytics capabilities on the cloud.

▪ Fully Automated Intelligence ▪ Natural Language Dialogue ▪ Guided Analytic Discovery ""

Visit WatsonAnalytics.com and get started for free

The ERA of cognitive Analytics


In Summary: Go Further and Faster with IBM

Resources

Accelerated Discovery Lab Ecosystem

Analytics Solution Centers

Expertise

9KConsultants

30KEngagements

2,500

Academic Initiative

1,000Partnerships

Business Partners

01 big dataoverview

Education

Transcript of 01 big dataoverview