Post on 22-Dec-2015
SQL Server 2014 – Features Drilldown
Tara Shankar JanaSenior Premier Field Engineer (Microsoft)
Web Avatar Find my blogs at:
http://blogs.msdn.com/b/sql-bi-sap-cloud-crm_all_in_one_place/
My Website: http://sqlmasters.jimdo.com/
Twitter: @TJMicrosoft
Linkedin: http://
au.linkedin.com/pub/tara-shankar-jana/21/1a3/329
The Evolution of Microsoft Data Platform
SQL Server2000
SQL Server2005
SQL Server2008
SQL Server2008 R2
SQL Server2012
XML ● KPIs
Management Studio ● Mirroring
Compression ● Policy-Based Mgmt ● Programmability
PowerPivot ● SharePoint Integration ● Master Data Services
AlwaysOn ● ColumnStore Index ● Data Quality Services ● Power View ● Cloud Connectivity
Mission Critical & Cloud Performance
Cloud-Ready Self-Service BI
SQL Server2014
In-Memory Across Workloads ● Performance & Scale ● Hybrid Cloud Optimized ● HDInsight ● Cloud BI
Performance & Productivity
Mission Critical
Modern DB platform
SQL Server 2014 and the Data Platform
Mission Critical Performance
Platform for Hybrid Cloud
Mission Critical Performance
In-Memory Built-InAverage 10x faster for new and existing SQL Server apps
Secure & ScalableMost secure with enterprise scale using Windows Server
High AvailabilityThe 9’s you need, with AlwaysOn
Mission Critical SupportLive support designed for mission critical solutions
In-Memory Built-In
New In-Memory OLTP
Enhanced In-Memory ColumnStore for DW
In-Memory BI with PowerPivot
Buffer Pool Extension to SSDs & Enhanced Query Processing
15,000 250,000
OLTP
Select only highly utilized tables to be in-memory
Optimize in-memory to fit existing hardware
In-memory performance across OLTP, DW and BI
All in a single SKU
On average 10x faster, without having rewrite entire app
Leverage full SQL Server capabilities
Microsoft In-Memory Technologies
Analytics OLTPStreaming Data• In-Memory Analytics in
PowerPivot for Excel• In-Memory Analytics in
SQL Server Analysis Services
• In-Memory Columnstore Index in SQL Server 2012, Fast Track Data Warehouse, and Parallel Data Warehouse
• StreamInsight • In-Memory OLTP• In-Memory Columnstore
Index (in SQL Server 2014)
2014
2012
2014
2012
2014
9
Why Hekaton (XTP)?
SQL Server Integration
• Same manageability, administration & development experience
• Integrated queries & transactions
• Integrated HA and backup/restore
Main-Memory Optimized
• Optimized for in-memory data
• Indexes (hash and range) exist only in memory
• No buffer pool, B-trees
• Stream-based storage
T-SQL Compiled to Machine Code
• T-SQL compiled to machine code via C code generator and VC
• Invoking a procedure is just a DLL entry-point
• Aggressive optimizations @ compile-time
Steadily declining memory price,
NVRAM
Many-core processors
Stalling CPU clock rate
TCO
Hardware trends Business
In-Memory OLTP – Architectural Pillars
Hybrid engine and integrated
experience
High performance
data operations
Efficient business-logic
processingCu
sto
me
r B
en
efi
tsA
rch
itectu
ral P
illa
rsD
rivers
High Concurrency
• Multi-version optimistic concurrency control with full ACID support
• Core engine uses lock-free algorithms
• No lock manager, latches or spinlocks
Frictionless scale-up
Memory Optimized Data Filegroup Data Filegroup
SQL Server.exe
Memory Optimized Tables & Indexes
TDS Handler and Session Management
In-Memory OLTP Integration and Application Migration
Natively Compiled SPs and Schema
Buffer Pool for Tables & Indexes
Client App
Transaction Log
Query Interop
T1
T3
T2
T1
T3
T2
Tables
Indexes
T-SQL Query Execution
T1
T3
T2
Parser, Catalog, Optimize
r
Native Compiler In-mem
OLTP Componen
t
KeyExisting
SQL Compone
nt
Generated .dll
Non-durable
table
demo
HEKATON- XTP (How to Create Memory-Optimized Tables)
demo
HEKATON- XTP (Detailed Demos)
demo
HEKATON- XTP (Durable Table)
demo
HEKATON- XTP (Non-Durable tables)
demo
HEKATON- XTP (AMR Tool)
demo
HEKATON- XTP (Memory Optimizer Wizard)
• Fast execution for data warehouse queries• Speedups of 10x and more
• No need for separate base table• Saves space
• Data can be inserted, updated, or deleted• Simpler management
• Eliminate need for other indexes• Saves space and simpler management
• More data types supported• Removes many limitations from non-clustered columnstores in SQL Server 2012
Columnstores: clustered and updatable (The next generation)
Comparing space savings (101-million row table and index space)
0.0
5.0
10.0
15.0
20.019.7 GB
10.9 GB
5.0 GB4.0 GB
6.9 GB
1.8 GB
demo
Clustered Columstore Index
2006 2007 2008 2009 2010 2011 2012 20130
20
40
60
80
0 211 8
0 1 4 0
69
53 53 55
34 2922 18
5
28 25 2921
612
0
16 169 8 6
43
20
43
SQL Server Oracle MySQL DB2
Database Vulnerabilities
Secure
*National Institute of Standards and Technology Comprehensive Vulnerability Database 4/17/2013, Market share from IDC 2013
Separation of Duties Enhancements
• What’s being delivered• Three new permissions (CONNECT ANY DATABASE, IMPERSONATE
ANY LOGIN, and SELECT ALL USER SECURABLES)• Main benefit
• Greater role separation• Ability to create new roles for database administrators who are
not sysadmin (super user)• Ability to create new roles for users or apps with specific
purposes
demo
Security Enhancements- Demo
SQL Server 2014 Resource Governance
Up 640 logical processors
64 vCPUs/VM
1 TB memory/VM
64 nodes/cluster
Network virtualization provides flexibility and isolation
Assign minimum and maximum bandwidth
Storage virtualization
Enterprise-class network storage on standard hardware
Storage tiering for higher performance
Scalable
SQL Server 2014• Resource Governor
adds IO governance
• SysPrep at cluster level
Windows Server 2012 R2• Hyper-V
• Storage Spaces
• NIC Teaming
• Online VHDX Resize
• Network & Storage QoS
CPU20%
Memory10%
IO30%
Pool 1
Pool 2
CPU50%
Memory40%
IO40%
Pool 3
App 1
App 6
App 4
App 5
demo
Resource Governor- Demo
SSD Buffer Pool Extension and scale up
• What’s being delivered• Use of non-volatile drives (SSD) to extend buffer pool• NUMA-Aware large page and BUF array allocation
• Main benefits• BP extension for SSDs
• Improve OLTP query performance with no application changes• No risk of data loss (using clean pages only)• Easy configuration optimized for OLTP workloads on commodity
servers (32 GB RAM)
Buffer Pool Manager
DataFiles
Relational Engine
ProtocolLayer
Storage Engine Buffer Pool
Optimizer
CmdParse
r
QueryExecut
orSNI
Transaction
Manager
AccessMethods
BufferManage
r
Transaction Log
Plan Cache
Data Cache
TDS
Query Plan Result Sets
Resu
ltsData
GetPage D
TDS
ReadI/OWrite
I/O
CommandQuery Tree
Cached Pages
How it works?
SSD
Buffer Pool
DB
Clean Page
Dirty Page
ɸ
EvictClean Page
bpage == NULLIS_ON (BUF_L2BPOOL)IS_OFF (BUF_L2DIRTY)
bpage != NULLIS_ON (BUF_DIRTY)IS_ON (BUF_L2BPOOL)IS_ON (BUF_L2DIRTY)
Lower and Upper Thresholds
Pages Array
……
……
LeastRecentlyUsed
Upper Threshold
Lower Threshold
Hot Pagesin DRAM
Warm Pagesto Extension
Cold PagesEvicted
Online Operations Enhancements
• What’s being delivered• Single partition online index rebuild• Managing Lock Priority for table SWITCH and online index
rebuild• Built-in diagnostics
• Main benefits• Increased concurrency and application availability• New partition-level granularity for online index rebuild
enables lower resource (CPU/memory) usage for customers who need uninterrupted access
• Provide customers with greater control over impacting running transactions if using switch partition or online index rebuild commands
Faster Insights from Any Data
Easy access to data, big & smallSearch, access, and shape internal and external data, and combine with unstructured data
Powerful insights with familiar toolsSpeed up analysis and time to insight with the familiarity of Excel in Office and Office 365 and access via mobile devices
Complete BI platformScale your BI models and enrich and secure your data with a complete platform spanning cloud and on-premises
Microsoft Power BI for Office 365
Collaborate in Office 365
Insights in Excel
Analyze
Visualize
Share
Find
Q&A
Mobile
Discover Search, access, and transform public and internal data sources with Power Query
Share data views and workbooks refreshable from on-premises and cloud based data sources, with Power BI Sites
Easy data modeling and lightning fast in-memory analytics with Power Pivot
Bold new interactive data visualizations with Power View and Power Map
Ask questions and get immediate answers with natural language query
Scalable | Manageable | Trusted
Mobile access through HTML5 and touch optimized apps for Windows 8, RT and iOS tablets
Platform for Hybrid Cloud
Hybrid Cloud SolutionsEnable new hybrid scenarios like cloud backup and cloud DR to reduce costs and improve on-premises DR
Easy On-Ramp to CloudEasily migrate and run SQL Server in the cloud to gain benefits of cloud computing
Complete & ConsistentDeploy a complete and consistent data platform from on-premises to cloud
Hybrid Cloud Solutions
Manual or Automatic
At an instance level with point in time restore
Measures DB usage patterns to set backup frequency
Fast disaster recovery (low RTO)
Easy to deploy & manage
Cloud bursting
Greater global reach
Better isolation of internal assets
On-Premise Network
Azure Storage
Domain Controller
Periodic Snapshot (automatic/manu
al)
SQL Server
Windows Azure Restore to VM
Geo Replication
Easy On-Ramp to Cloud
Easily migrate on-prem SQL Server to a Windows Azure VM
Designed for users unfamiliar with Windows Azure
Ideal for existing apps & dev/test new apps
Full SQL Server functionality
Full VM control
Ideal for new variable-demand apps
Dynamic scale-out of database
No patching of OS or DB
HA built-in with 99.9% SLA
DB
demo
Database migration from On-premises to cloud or Azure VM
demo
Smart and Managed backups- Demo
Off-PremisesOn-Premises Data Center
SQL Server in a Windows Azure VM
SQL Database service
HDInsightTablesBlobs
SQL Server on Windows Server
PDW Appliance
SQL Server in a Windows
Server VM
Power BI features in O365
SQL Server in a Windows
Server VM
HD Insight Server
Complete & Consistent Data Platform
Call to action
Download SQL Server 2014 CTP2www.microsoft.com/sqlserver
Register for Power BI Previewwww.powerbi.com
Get on Windows Azurewww.windowsazure.com
Track Resources
• Download the CTP for SQL Server 2014 and accelerate your queries using In-Memory OLTP - http://technet.microsoft.com/en-us/evalcenter/dn205290.aspx
• Get into the cloud with an Azure account - use SQL database in Windows Azure or take your workload into Azure VM - www.windowsazure.com
• Get big with big data – HDInsight on Azure and grab the latest Power BI featureshttp://www.windowsazure.com/en-us/documentation/services/hdinsight/?fb=en-us
• Power BI - www.powerbi.com
41
Questions?
© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.