Big Data for Disruptive Models - Topsector Logistiek...IDC: Worldwide Business Analytics Software...

20
David de Santiago, Digital Transformation EMEA, Amazon Web Services April 2016 Big Data for Disruptive Models

Transcript of Big Data for Disruptive Models - Topsector Logistiek...IDC: Worldwide Business Analytics Software...

Page 1: Big Data for Disruptive Models - Topsector Logistiek...IDC: Worldwide Business Analytics Software 2012–2016 Forecast and 2011 Vendor Shares Available for analysis Generated data

© 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

David de Santiago, Digital Transformation EMEA, Amazon Web Services

April 2016

Big Data for Disruptive Models

Page 2: Big Data for Disruptive Models - Topsector Logistiek...IDC: Worldwide Business Analytics Software 2012–2016 Forecast and 2011 Vendor Shares Available for analysis Generated data

SOFTWARE IS EATING THE WORLD

DATA IS FUELING

SOFTWARE

Page 3: Big Data for Disruptive Models - Topsector Logistiek...IDC: Worldwide Business Analytics Software 2012–2016 Forecast and 2011 Vendor Shares Available for analysis Generated data

What to Expect from the Session

Page 4: Big Data for Disruptive Models - Topsector Logistiek...IDC: Worldwide Business Analytics Software 2012–2016 Forecast and 2011 Vendor Shares Available for analysis Generated data

“We use Amazon Machine Learning to analyze customer feedback on packaging and

create predictions to identify products that are suited for our

Frustration Free and eCommerce ready packaging

standards”

Page 5: Big Data for Disruptive Models - Topsector Logistiek...IDC: Worldwide Business Analytics Software 2012–2016 Forecast and 2011 Vendor Shares Available for analysis Generated data

Few Examples at Amazon…

It is what allows us to unload an entire truck full of products and

make them available for purchase in as little as 30 minutes

Page 6: Big Data for Disruptive Models - Topsector Logistiek...IDC: Worldwide Business Analytics Software 2012–2016 Forecast and 2011 Vendor Shares Available for analysis Generated data

It is what makes Amazon Echo able to respond to your voice

Page 7: Big Data for Disruptive Models - Topsector Logistiek...IDC: Worldwide Business Analytics Software 2012–2016 Forecast and 2011 Vendor Shares Available for analysis Generated data

50 Billions

Predictions

Per Week

Page 8: Big Data for Disruptive Models - Topsector Logistiek...IDC: Worldwide Business Analytics Software 2012–2016 Forecast and 2011 Vendor Shares Available for analysis Generated data

What does it take to be data driven?

ApplicationsDevOps

Agile

All DataLakes

For ALL

AnalyticsPreventPredict

Prescript

Page 9: Big Data for Disruptive Models - Topsector Logistiek...IDC: Worldwide Business Analytics Software 2012–2016 Forecast and 2011 Vendor Shares Available for analysis Generated data

Gartner: User Survey Analysis: Key Trends Shaping the Future of Data Center Infrastructure Through 2011 IDC: Worldwide Business Analytics Software 2012–2016 Forecast and 2011 Vendor Shares

Available for analysis

Generated data

Data volume - Gap

1990 2000 2010 2020

A Growing Gap

Volume

Velocity

Variety

Veracity

Value

Page 10: Big Data for Disruptive Models - Topsector Logistiek...IDC: Worldwide Business Analytics Software 2012–2016 Forecast and 2011 Vendor Shares Available for analysis Generated data

Extracting the value of the data

µs ms s min hour day month Year +

Value $

Time

Predict Prevent Prescript

Streams Operational Traditional Scientific

Comfort Zone

Page 11: Big Data for Disruptive Models - Topsector Logistiek...IDC: Worldwide Business Analytics Software 2012–2016 Forecast and 2011 Vendor Shares Available for analysis Generated data

Big Data is Breaking the Old Tools

Page 12: Big Data for Disruptive Models - Topsector Logistiek...IDC: Worldwide Business Analytics Software 2012–2016 Forecast and 2011 Vendor Shares Available for analysis Generated data

Lower cost,higher throughput

Highly constrained

Generation Collection & Storage

Analytics & Computation

Collaboration & Sharing

Page 13: Big Data for Disruptive Models - Topsector Logistiek...IDC: Worldwide Business Analytics Software 2012–2016 Forecast and 2011 Vendor Shares Available for analysis Generated data

Elastic and highly scalable

No upfront capital expense

Only pay for what you use+

+

Available on-demand+

=Remove constraints

Page 14: Big Data for Disruptive Models - Topsector Logistiek...IDC: Worldwide Business Analytics Software 2012–2016 Forecast and 2011 Vendor Shares Available for analysis Generated data

AnalyzeStore

Glacier

S3

DynamoDB

RDS, Aurora

AWS Big Data Portfolio

Data Pipeline

CloudSearch

EMR (Hadoop)

Redshift (DWH)

MachineLearning

ElasticSearchDatabase Migration QuickSight SQL over

Streams

Kinesis Firehose

Import Export (SnowBall)

Direct Connect

Collect

Kinesis (Streams)

Page 15: Big Data for Disruptive Models - Topsector Logistiek...IDC: Worldwide Business Analytics Software 2012–2016 Forecast and 2011 Vendor Shares Available for analysis Generated data

TRANSFORMATIONis treating Data as a

Production Assetas Capital

Page 16: Big Data for Disruptive Models - Topsector Logistiek...IDC: Worldwide Business Analytics Software 2012–2016 Forecast and 2011 Vendor Shares Available for analysis Generated data

Many Thousands of Companies Use AWS for Big Data

Page 17: Big Data for Disruptive Models - Topsector Logistiek...IDC: Worldwide Business Analytics Software 2012–2016 Forecast and 2011 Vendor Shares Available for analysis Generated data

“ • Wanted a platform to provide greater speed and scalability for analyzing petabyte-scale data

• Migrating mission-critical operations to AWS

• Can provide analysts with real-time access to 75 billion records collected daily

• Can move faster, more efficiently in serving core business processes

FINRA Performs Daily Petabyte-Scale Analysis on Trading Data Using AWS

The Financial Industry Regulatory Authority (FINRA) is the largest independent regulatory authority in the

United States. It is based in Washington, D.C.

We chose AWS to deliver innovation at a much larger

scale and much faster to our core business. Saman Michael Far

Sr. Vice President of Technology

Page 18: Big Data for Disruptive Models - Topsector Logistiek...IDC: Worldwide Business Analytics Software 2012–2016 Forecast and 2011 Vendor Shares Available for analysis Generated data

World’s leading online travel company, with a portfolio that includes more than 150 travel sites in 70 countries.

Page 19: Big Data for Disruptive Models - Topsector Logistiek...IDC: Worldwide Business Analytics Software 2012–2016 Forecast and 2011 Vendor Shares Available for analysis Generated data

Migrated off legacy DW to Redshift (start to finish) in 7 man-months

Redshift costs 43% of legacy DW for the same data set (legacy DW cost $1.2M/ year)

Tuned queries now running faster in Redshift than on legacy system

Page 20: Big Data for Disruptive Models - Topsector Logistiek...IDC: Worldwide Business Analytics Software 2012–2016 Forecast and 2011 Vendor Shares Available for analysis Generated data

TRANSFORMATION

underpinned by Big Data

Join me on next session for the disruption recipe