Data Culture Series - Keynote - 3rd Dec

61
DATA CULTURE SERIES

Transcript of Data Culture Series - Keynote - 3rd Dec

DATA CULTURE SERIES

?Who is using Data to drive the future of their business?

a) Yes

b) No

c) Not sure

?Who is using Predictive Analytics / Machine Learning yet?

a) Yes

b) No

Date Location

16 September READING Data Culture series

10 November LONDON FUTURE DECODED

27 November READING Data Culture Series

3 December READING Data Culture Series - first Azure Data Services track

inclusion

27 January LONDON Data Culture series

24 February LEEDS Data Culture series

24 March EDINBURGH Data Culture series

8 April BIRMINGHAM Data Culture series

12 May READING Data Culture series

19 May LONDON Data Culture series

UK Business Lead for Data Insights

6

Jon Woodward : Connect & Follow

6

@JLWoodward

www.linkedin.com/in/jonathanwoodward

#DataCulture

PowerBI

APS

AzureML

DocumentDB

Search

EventHub

Stream Analytics

Hadoop

#DataCulture

Interact & Post questions for the Panel

Time Location

10:30 – 11:30 KeynoteRic HoweAnthony Saxby

11:30 – 12:30 Big Data

Data Science

Business Intelligence

Data Insights

Azure Data Services

Immersion Tracks - Overview

12:30 – 13:15 Lunch & Expo

13:15 – 16:30 Immersion (as above) Immersion Hands on

15:00 - 15:15 Break & Expo

15:15 - 16:30 Immersion (as above) Immersion Hands on

16:30 – 17:00 Panel and Close

17:00 Finish

But what is Data Culture?1. Putting Data at the heart of the

organisational thinking

2. Being Data Driven – Taking decision using Data

3. Putting Data into the hands of as many employees as possible

4. Leverging data from the Edge

5. Empowering individuals to leverage their own data and self-serve against organisational data sets

6. Driving Data Culture from the top inc board level sponsor for Data (Chief Data Officer)

7. Leverging Data and Data Science to change your business models and to better compete against your peers

The Age of Data Culture

people

analytics

data

data culturefor everyone

Organization

Department

Individual

People

IT

Developers

ubiquitous computing + ambient intelligence

data fuel forambient intelligence

data exhaust fromubiquitous computing

technology gap

platform for ambient

intelligence

[ ]

speed[

speed[

speed[

speed[

data speed[

speed[

speed[

speed[

speed[

speed[

Data Science is far too complex today

Software Development

Data Exploration

Math & Statistics Knowledge

Machine Learning

Data Management

this must get simpler,

it simply won’t scale!

Excel, Power BI for Office 365

speed[

[

travel expenses

newest

Azure Machine Learning

Power BI Dashboards

Azure Intelligent Systems Service

Azure Data Factory

data platform

Office Azure SQL Server 2014

Excel

SharePoint

Power BI

Storage

SQL Database

Intelligent Systems Service

HDInsight

Machine Learning

Data Factory

Analytics Platform System

data culturefor everyone

Modernising your Data Platform

Anthony Saxby

Cloud Data Platform Lead

Microsoft UK

Big data

26BBy 2020, IoT will include 26B units, creating large quantities of data & generating >$300B in revenue for IoT suppliers

Mobility Apps Cloud

>50% More than half of information workers across 17 countries report using 3+ devices for work

25%one quarter of external app implementation spending will be on mobility, cloud, analytics, & social, by 2016

~50%nearly half of total IT spend will be cloud-related by 2020

Devices: “Info Workers Will Erase Boundary Between enterprise And Consumer Technologies.” Forrester Research. August 30, 2012

Apps: Gartner: “Predicts 2013: Business Impact of Technology Drives the Futures Application Services Market.” Nov. 21, 2012

Big data: Paraphrased from "The Impact of the Internet of Things on Data Centers." Gartner Research, Feb 27, 2014

Cloud: “Prepare For 2020: Transform Your IT Infrastructure And Operations Practice.” Forrester Research. Oct. 24, 2012

Cost Agility

Service Levels

Performance

CPU Performance Flattening OutDecreasing Cost of Memory$/GB of Memory

1

10

100

1,000

10,000

100,000

1,000,000

19

90

19

91

19

92

19

93

19

94

19

94

19

95

19

96

19

97

19

98

19

99

20

00

20

00

20

01

20

02

20

04

20

05

20

07

20

08

20

09

20

11

US$

/GB

0

1

10

100

1,000

10,000

100,000

1,000,000

10,000,000

1970 1975 1980 1985 1990 1995 2000 2005 2010

44

Drive Real-Time Business with Real-Time Insights

Over 100x query speed and

significant data compression with

In-Memory ColumnStore

Up to 30x faster transaction

processing with In-Memory OLTP

Greater

performance

with In-Memory

Analysis Services

Billions of rows

per second with

PowerPivot

In-Memory for

Excel

45

Faster InsightsIN-MEMORY ANALYTICS

Faster QueriesIN-MEMORY DW

Faster TransactionsIN-MEMORY OLTP

The entire DB doesn’t need to be In-Memory

10xFaster performance

In-Memory FlexibilityKey Benefits

Minimize capex as

data volumes grow

Access In-Memory and

on-disk with a single query

Don’t need to rewrite

entire appwith

scalability and

reduced

operating

costs

Exponential

growth

On-Disk

Application

Warm and

hot data

Cold DataSingle Query

47

In-Memory

OLTP

35x faster

performanceGames

No locks

and latches

“SQL Server 2014 has no

lock and latch problem,

meaning it can increase

CPU usage up to 90 percent.

What was even more

surprising was that it

ensured seamless handling

of all requests without an

error, even when CPU usage

exceeds 90 percent.”

- Lee Sangbong, Deputy Chief,

CJ E&M Database Team

Key Benefits

Quickly explore massive

data volumes

Dramatically compress data

Over 100x faster query

performance

Accelerated Analytics with In-Memory

“It can take up to 3 hours to aggregate

data from billions of table rows….

(Now) it takes 45 minutes to update

the index, and then reports can be run

on-demand with sub-second response.”

- Kevin Cornett, Stein Mart

Faster time to insights

Advanced data

compression

In-Memory

ColumnStore Advanced Analytics

with InMemory

49

10,800xfaster queries

340x faster queries

2,400xfaster queries

PH

YS

ICA

L H

AR

DW

AR

E L

AY

ER

DATACENTRE A

PH

YS

ICA

L H

AR

DW

AR

E L

AY

ER

SQL 2000

SQL 2000

SQL 2005SQL 2005 ClusterSQL 2008r2

SAN (High I/O Capacity)

DATACENTRE B

SQL 2005 Cluster SQL 2000 SQL 2000

SAN (High I/O Capacity)

SQL 2005

SQL 2005

SQL 2008r2 SQL 2008r2

SQL 2012 BI

Timeline

2004200520062008200920102012

SQL 2000OracleSQL 2012 BISQL 2012 Enterprise

SQL 2012 BISQL 2012 Enterprise

Virtualisation Overhead ReducingProven SQL Server performance on an enterprise-class hypervisor

0

0.2

0.4

0.6

0.8

1

0

200

400

600

800

1000

4 8 16 32 64

Avera

ge T

ran

sacti

on

Resp

on

se T

ime (

Sec)

Tra

nsa

cti

on

s/S

ec

Virtual Processors Per VM

Hyper-V Virtual CPU Scalability

with OLTP Workloads

Enterprise Strategy Group

Tested an existing SQL Server 2012 OLTP workload that was previously vCPU limited

Increased Scale & Performance

With Hyper-V’s support for 64 vCPUs per VM, testing showed a 6x performance increase, with a 5x improvement in transaction response time.

2,870 SQL Server batch requests per second were recorded during the 64 vCPUtest. Microsoft documentation states “over 1,000 batch requests per second indicate a very busy SQL Server”

0

500

1000

1500

2000

2500

3000

3500

4 8 16 32 64Batc

h R

eq

uest

s/S

ec

Virtual Processors Per VM

Hyper-V Enabled SQL

Batch Request Scalability

0

200

400

600

800

1000

1200

1400

1600

Physical Virtual

Tra

nsa

cti

on

s/S

ec

Hyper-V OLTP Workload Analysis

The 2 tests showed just a 6% difference between the brokerage application running on physical vs. virtual

APPAPP APP

VM IO

Random IO

But… HDD-based system are

optimized for sequential IO

VM VM VM

“IO Blender” effect

Virtualizing/consolidating

randomizes IO

Flash Storage removes this

constraint allowing greater

density levels and

guaranteed performance

Virtualisation Use Case

• Performance problems due to slow SAN

• Wanted to use Always-on replication with Private Cloud

Hybrid Cloud Data Platforms

55

Migrate Existing SQL Server Apps

56

Key Benefits

Low TCO for existing apps

New Migration Wizard

Familiar development tools

“We could just pick up our SQL

installs, move them over to Azure

VMs, and pick up where we left off."

Adam Salvo, Trek O

PT

ION

1

OP

TIO

N 2

VH

D

Data

base

P2V

V2V

Fast, easy

scalability

Cut IT hosting costs by

$15Kper month

SQL Server Develop & Test in the Cloud

57

Key Benefits

Reduce project overhead

Speed time to market

Secure, redundant source

code

“Telenor saved 70% on test,

development and demo that could be

turned off when finished to minimize

their capital outlays,”

Marius Pedersen, Telenor Group

70% savings

Ready in hours, not weeks

Noresource

limits

SQL Server Dev Tools On-Premises

Development Work Stations

SQL Server

On-Premises

Deploy

SQL Server in a

Windows Azure

Virtual Machine

Test

TFS in Windows Azure

On-premise network

Backup and DR in the Cloud

58

Key Benefits

Reduce CAPEX & OPEX

Low RTO disaster recovery

Speed global BI reporting

“Recovery times have dropped from

minutes to seconds… We’re seeing

almost no data loss.”

Speaker, Company

Recover in

seconds

Significant

costreductions

Windows Azure

Secondary replica

Run backups

Domain controller

Primaryreplica

Asynchronous commit

Run BI reports

VPN tunnel (Windows Azure Virtual Network)

Secondary replica

Synchronous commit

Create Hybrid Apps

59

Key Benefits

Reduce CAPEX & OPEX

Improve isolation of

internal assets

Greater global reach

“We now have the capacity to add a

lot more players and operators while

not losing any application

responsiveness”

Thomas Pullen, BetOnSoft

Improved availability & scalability

10xthe workload

with real-time

analytics

In-House Data Center

Azure-Hosted

Marketing Apps

Offloaded

BI Workloads

Metrics &

Monitoring Apps

Metrics

Databases

Viral Marketing

Databases

OLTP DB

AlwaysOn Primary

AlwaysOn Synchronous Replicas

Readable Secondaries

Windows Azure

Azure-Hosted

Marketing Apps

SQL Server 2012 AlwaysOn Cluster

Complete and consistent data platform

Explore the latest in SQL ServerVisit www.microsoft.com/sql to learn more about our latest innovations

Evaluate SQL Server 2014Get hands on – visit Microsoft’s TechNet evaluation center and

evaluate SQL Server 2014 today!

Evaluate Windows Server 2012 R2Get hands on – visit Microsoft’s TechNet evaluation center and

evaluate Windows Server 2102 R2 today!Microsoft Azure