Data Culture Series - Keynote - 3rd Dec
-
Upload
jonathan-woodward -
Category
Software
-
view
186 -
download
1
Transcript of Data Culture Series - Keynote - 3rd Dec
Date Location
16 September READING Data Culture series
10 November LONDON FUTURE DECODED
27 November READING Data Culture Series
3 December READING Data Culture Series - first Azure Data Services track
inclusion
27 January LONDON Data Culture series
24 February LEEDS Data Culture series
24 March EDINBURGH Data Culture series
8 April BIRMINGHAM Data Culture series
12 May READING Data Culture series
19 May LONDON Data Culture series
UK Business Lead for Data Insights
6
Jon Woodward : Connect & Follow
6
@JLWoodward
www.linkedin.com/in/jonathanwoodward
#DataCulture
PowerBI
APS
AzureML
DocumentDB
Search
EventHub
Stream Analytics
Hadoop
Time Location
10:30 – 11:30 KeynoteRic HoweAnthony Saxby
11:30 – 12:30 Big Data
Data Science
Business Intelligence
Data Insights
Azure Data Services
Immersion Tracks - Overview
12:30 – 13:15 Lunch & Expo
13:15 – 16:30 Immersion (as above) Immersion Hands on
15:00 - 15:15 Break & Expo
15:15 - 16:30 Immersion (as above) Immersion Hands on
16:30 – 17:00 Panel and Close
17:00 Finish
But what is Data Culture?1. Putting Data at the heart of the
organisational thinking
2. Being Data Driven – Taking decision using Data
3. Putting Data into the hands of as many employees as possible
4. Leverging data from the Edge
5. Empowering individuals to leverage their own data and self-serve against organisational data sets
6. Driving Data Culture from the top inc board level sponsor for Data (Chief Data Officer)
7. Leverging Data and Data Science to change your business models and to better compete against your peers
Data Science is far too complex today
Software Development
Data Exploration
Math & Statistics Knowledge
Machine Learning
Data Management
this must get simpler,
it simply won’t scale!
newest
Azure Machine Learning
Power BI Dashboards
Azure Intelligent Systems Service
Azure Data Factory
data platform
Office Azure SQL Server 2014
Excel
SharePoint
Power BI
Storage
SQL Database
Intelligent Systems Service
HDInsight
Machine Learning
Data Factory
Analytics Platform System
Big data
26BBy 2020, IoT will include 26B units, creating large quantities of data & generating >$300B in revenue for IoT suppliers
Mobility Apps Cloud
>50% More than half of information workers across 17 countries report using 3+ devices for work
25%one quarter of external app implementation spending will be on mobility, cloud, analytics, & social, by 2016
~50%nearly half of total IT spend will be cloud-related by 2020
Devices: “Info Workers Will Erase Boundary Between enterprise And Consumer Technologies.” Forrester Research. August 30, 2012
Apps: Gartner: “Predicts 2013: Business Impact of Technology Drives the Futures Application Services Market.” Nov. 21, 2012
Big data: Paraphrased from "The Impact of the Internet of Things on Data Centers." Gartner Research, Feb 27, 2014
Cloud: “Prepare For 2020: Transform Your IT Infrastructure And Operations Practice.” Forrester Research. Oct. 24, 2012
Performance
CPU Performance Flattening OutDecreasing Cost of Memory$/GB of Memory
1
10
100
1,000
10,000
100,000
1,000,000
19
90
19
91
19
92
19
93
19
94
19
94
19
95
19
96
19
97
19
98
19
99
20
00
20
00
20
01
20
02
20
04
20
05
20
07
20
08
20
09
20
11
US$
/GB
0
1
10
100
1,000
10,000
100,000
1,000,000
10,000,000
1970 1975 1980 1985 1990 1995 2000 2005 2010
44
Drive Real-Time Business with Real-Time Insights
Over 100x query speed and
significant data compression with
In-Memory ColumnStore
Up to 30x faster transaction
processing with In-Memory OLTP
Greater
performance
with In-Memory
Analysis Services
Billions of rows
per second with
PowerPivot
In-Memory for
Excel
45
Faster InsightsIN-MEMORY ANALYTICS
Faster QueriesIN-MEMORY DW
Faster TransactionsIN-MEMORY OLTP
The entire DB doesn’t need to be In-Memory
10xFaster performance
In-Memory FlexibilityKey Benefits
Minimize capex as
data volumes grow
Access In-Memory and
on-disk with a single query
Don’t need to rewrite
entire appwith
scalability and
reduced
operating
costs
Exponential
growth
On-Disk
Application
Warm and
hot data
Cold DataSingle Query
47
In-Memory
OLTP
35x faster
performanceGames
No locks
and latches
“SQL Server 2014 has no
lock and latch problem,
meaning it can increase
CPU usage up to 90 percent.
What was even more
surprising was that it
ensured seamless handling
of all requests without an
error, even when CPU usage
exceeds 90 percent.”
- Lee Sangbong, Deputy Chief,
CJ E&M Database Team
Key Benefits
Quickly explore massive
data volumes
Dramatically compress data
Over 100x faster query
performance
Accelerated Analytics with In-Memory
“It can take up to 3 hours to aggregate
data from billions of table rows….
(Now) it takes 45 minutes to update
the index, and then reports can be run
on-demand with sub-second response.”
- Kevin Cornett, Stein Mart
Faster time to insights
Advanced data
compression
In-Memory
ColumnStore Advanced Analytics
with InMemory
49
10,800xfaster queries
340x faster queries
2,400xfaster queries
PH
YS
ICA
L H
AR
DW
AR
E L
AY
ER
DATACENTRE A
PH
YS
ICA
L H
AR
DW
AR
E L
AY
ER
SQL 2000
SQL 2000
SQL 2005SQL 2005 ClusterSQL 2008r2
SAN (High I/O Capacity)
DATACENTRE B
SQL 2005 Cluster SQL 2000 SQL 2000
SAN (High I/O Capacity)
SQL 2005
SQL 2005
SQL 2008r2 SQL 2008r2
SQL 2012 BI
Timeline
2004200520062008200920102012
SQL 2000OracleSQL 2012 BISQL 2012 Enterprise
SQL 2012 BISQL 2012 Enterprise
Virtualisation Overhead ReducingProven SQL Server performance on an enterprise-class hypervisor
0
0.2
0.4
0.6
0.8
1
0
200
400
600
800
1000
4 8 16 32 64
Avera
ge T
ran
sacti
on
Resp
on
se T
ime (
Sec)
Tra
nsa
cti
on
s/S
ec
Virtual Processors Per VM
Hyper-V Virtual CPU Scalability
with OLTP Workloads
Enterprise Strategy Group
Tested an existing SQL Server 2012 OLTP workload that was previously vCPU limited
Increased Scale & Performance
With Hyper-V’s support for 64 vCPUs per VM, testing showed a 6x performance increase, with a 5x improvement in transaction response time.
2,870 SQL Server batch requests per second were recorded during the 64 vCPUtest. Microsoft documentation states “over 1,000 batch requests per second indicate a very busy SQL Server”
0
500
1000
1500
2000
2500
3000
3500
4 8 16 32 64Batc
h R
eq
uest
s/S
ec
Virtual Processors Per VM
Hyper-V Enabled SQL
Batch Request Scalability
0
200
400
600
800
1000
1200
1400
1600
Physical Virtual
Tra
nsa
cti
on
s/S
ec
Hyper-V OLTP Workload Analysis
The 2 tests showed just a 6% difference between the brokerage application running on physical vs. virtual
APPAPP APP
VM IO
Random IO
But… HDD-based system are
optimized for sequential IO
VM VM VM
“IO Blender” effect
Virtualizing/consolidating
randomizes IO
Flash Storage removes this
constraint allowing greater
density levels and
guaranteed performance
Virtualisation Use Case
• Performance problems due to slow SAN
• Wanted to use Always-on replication with Private Cloud
Migrate Existing SQL Server Apps
56
Key Benefits
Low TCO for existing apps
New Migration Wizard
Familiar development tools
“We could just pick up our SQL
installs, move them over to Azure
VMs, and pick up where we left off."
Adam Salvo, Trek O
PT
ION
1
OP
TIO
N 2
VH
D
Data
base
P2V
V2V
Fast, easy
scalability
Cut IT hosting costs by
$15Kper month
SQL Server Develop & Test in the Cloud
57
Key Benefits
Reduce project overhead
Speed time to market
Secure, redundant source
code
“Telenor saved 70% on test,
development and demo that could be
turned off when finished to minimize
their capital outlays,”
Marius Pedersen, Telenor Group
70% savings
Ready in hours, not weeks
Noresource
limits
SQL Server Dev Tools On-Premises
Development Work Stations
SQL Server
On-Premises
Deploy
SQL Server in a
Windows Azure
Virtual Machine
Test
TFS in Windows Azure
On-premise network
Backup and DR in the Cloud
58
Key Benefits
Reduce CAPEX & OPEX
Low RTO disaster recovery
Speed global BI reporting
“Recovery times have dropped from
minutes to seconds… We’re seeing
almost no data loss.”
Speaker, Company
Recover in
seconds
Significant
costreductions
Windows Azure
Secondary replica
Run backups
Domain controller
Primaryreplica
Asynchronous commit
Run BI reports
VPN tunnel (Windows Azure Virtual Network)
Secondary replica
Synchronous commit
Create Hybrid Apps
59
Key Benefits
Reduce CAPEX & OPEX
Improve isolation of
internal assets
Greater global reach
“We now have the capacity to add a
lot more players and operators while
not losing any application
responsiveness”
Thomas Pullen, BetOnSoft
Improved availability & scalability
10xthe workload
with real-time
analytics
In-House Data Center
Azure-Hosted
Marketing Apps
Offloaded
BI Workloads
Metrics &
Monitoring Apps
Metrics
Databases
Viral Marketing
Databases
OLTP DB
AlwaysOn Primary
AlwaysOn Synchronous Replicas
Readable Secondaries
Windows Azure
Azure-Hosted
Marketing Apps
SQL Server 2012 AlwaysOn Cluster
Explore the latest in SQL ServerVisit www.microsoft.com/sql to learn more about our latest innovations
Evaluate SQL Server 2014Get hands on – visit Microsoft’s TechNet evaluation center and
evaluate SQL Server 2014 today!
Evaluate Windows Server 2012 R2Get hands on – visit Microsoft’s TechNet evaluation center and
evaluate Windows Server 2102 R2 today!Microsoft Azure