Moore’s Law means more transistors and therefore cores, but… CPU clock rate stalled… Meanwhile...
-
Upload
felicia-jones -
Category
Documents
-
view
218 -
download
0
Transcript of Moore’s Law means more transistors and therefore cores, but… CPU clock rate stalled… Meanwhile...
![Page 1: Moore’s Law means more transistors and therefore cores, but… CPU clock rate stalled… Meanwhile RAM cost continues to drop.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649f515503460f94c748bb/html5/thumbnails/1.jpg)
![Page 3: Moore’s Law means more transistors and therefore cores, but… CPU clock rate stalled… Meanwhile RAM cost continues to drop.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649f515503460f94c748bb/html5/thumbnails/3.jpg)
ContextIn-Memory OLTP is one of many SQL Server initiatives to take advantage plentiful memory and processor cores
Specialized database engines for particular workloads:Column store indexes for SQL Server 2012/2014 and PDWIn-Memory Analytics – Power Pivot for Excel 2010App Fabric Cache - mid tier caching solution Stream Insight : Real time data stream analytics In-Memory OLTP for SQL Server 2014
SQL Server is well positioned to take full advantage of changing hardware trends and application requirements
![Page 4: Moore’s Law means more transistors and therefore cores, but… CPU clock rate stalled… Meanwhile RAM cost continues to drop.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649f515503460f94c748bb/html5/thumbnails/4.jpg)
Myths About In-Memory OLTP1. SQL Server In-Memory OLTP is a recent
response to competitors’ offerings2. In-Memory OLTP is like DBCC PINTABLE3. In-Memory Databases are new separate
products4. You can use In-Memory OLTP in an existing SQL
Server app with NO changes whatsoever5. Since tables are in memory, the data is not
Durable or Highly Available – I will lose it after server crash
![Page 5: Moore’s Law means more transistors and therefore cores, but… CPU clock rate stalled… Meanwhile RAM cost continues to drop.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649f515503460f94c748bb/html5/thumbnails/5.jpg)
Myth #1: SQL Server In-Memory OLTP is a recent response to competitors’ offerings
RealityProject “Hekaton” was started around 4 years ago in response to business and hardware trends
![Page 6: Moore’s Law means more transistors and therefore cores, but… CPU clock rate stalled… Meanwhile RAM cost continues to drop.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649f515503460f94c748bb/html5/thumbnails/6.jpg)
Business TrendsMarket need in OLTP spaceever higher throughput lower latency at a lower cost
ExamplesCredit-card transactions: validate, authorize and complete the transactionOnline-betting: Ability to place the bet quickly
![Page 7: Moore’s Law means more transistors and therefore cores, but… CPU clock rate stalled… Meanwhile RAM cost continues to drop.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649f515503460f94c748bb/html5/thumbnails/7.jpg)
1990
1991
1991
1992
1993
1993
1994
1994
1995
1995
1996
1997
1997
1998
1998
1999
2000
2000
2001
2002
2002
2003
2004
2006
2007
2008
2009
2009
2010
2011
1
10
100
1000
10000
100000
1000000
$ per GB of PC Class Memory
US$
/GB
Moore’s Law means more transistors and therefore
cores, but…
CPU clock rate stalled…
Hardware Trends
Meanwhile RAM cost continues
to drop
Chart reference http://www.gotw.ca/publications/concurrency-ddj.htm
![Page 8: Moore’s Law means more transistors and therefore cores, but… CPU clock rate stalled… Meanwhile RAM cost continues to drop.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649f515503460f94c748bb/html5/thumbnails/8.jpg)
What is SQL Server In-Memory OLTP?1. High performance 2. Main memory-optimized 3. OLTP scenarios 4. Integrated into SQL Server 5. Architected for modern hardware trends
![Page 9: Moore’s Law means more transistors and therefore cores, but… CPU clock rate stalled… Meanwhile RAM cost continues to drop.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649f515503460f94c748bb/html5/thumbnails/9.jpg)
Myth #2: In-Memory OLTP is like DBCC PINTABLE
Reality
In-memory OLTP is completely new design to optimize for efficient In-Memory data operations. There are no pages or buffer pool for memory-optimized tables.
![Page 10: Moore’s Law means more transistors and therefore cores, but… CPU clock rate stalled… Meanwhile RAM cost continues to drop.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649f515503460f94c748bb/html5/thumbnails/10.jpg)
SQL Server Integration
• Same manageability, administration & development experience
• Integrated queries & transactions
• Integrated HA and backup/restore
Main-Memory Optimized
• Optimized for in-memory data
• Indexes (hash and range) exist only in memory
• No buffer pool, B-trees
• Stream-based storage
T-SQL Compiled to Machine Code• T-SQL compiled to
machine code via C code generator and VC
• Invoking a procedure is just a DLL entry-point
• Aggressive optimizations @ compile-time
Steadily declining memory price,
NVRAM
Many-core processors
Stalling CPU clock rate
TCO
Hardware trends Business
In-Memory OLTP – Architectural Pillars
Hybrid engine and integrated
experience
High performance
data operations
Efficient business-logic
processingCu
sto
me
r B
en
efi
tsA
rch
itectu
ral P
illa
rsD
rivers
High Concurrency
• Multi-version optimistic concurrency control with full ACID support
• Core engine uses lock-free algorithms
• No lock manager, latches or spinlocks
Frictionless scale-up
![Page 11: Moore’s Law means more transistors and therefore cores, but… CPU clock rate stalled… Meanwhile RAM cost continues to drop.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649f515503460f94c748bb/html5/thumbnails/11.jpg)
Myth #3: In-Memory Databases are new separate products
RealityIn-Memory OLTP is a feature fully integrated into SQL Server 2014
![Page 12: Moore’s Law means more transistors and therefore cores, but… CPU clock rate stalled… Meanwhile RAM cost continues to drop.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649f515503460f94c748bb/html5/thumbnails/12.jpg)
Memory Optimized Data Filegroup Data Filegroup
SQL Server.exe
Memory Optimized Tables & Indexes
TDS Handler and Session Management
In-Memory OLTP Integration and Application Migration
Natively Compiled SPs and Schema
Buffer Pool for Tables & Indexes
Client App
Transaction Log
Query Interop T1 T3T2
T1 T3T2
Tables
Indexes
T-SQL Query Execution
T1 T3T2
Parser, Catalog, Optimize
r
Native Compiler In-mem
OLTP Compone
nt
KeyExisting
SQL Compone
nt
Generated .dll
Non-durable
table
![Page 13: Moore’s Law means more transistors and therefore cores, but… CPU clock rate stalled… Meanwhile RAM cost continues to drop.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649f515503460f94c748bb/html5/thumbnails/13.jpg)
Myth #4: You can use In-Memory OLTP in an existing SQL Server app with NO changes whatsoever
RealityThere are at least some changes, at minimum changing some of the schema
![Page 14: Moore’s Law means more transistors and therefore cores, but… CPU clock rate stalled… Meanwhile RAM cost continues to drop.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649f515503460f94c748bb/html5/thumbnails/14.jpg)
Code Changes for the Demo (I)
![Page 15: Moore’s Law means more transistors and therefore cores, but… CPU clock rate stalled… Meanwhile RAM cost continues to drop.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649f515503460f94c748bb/html5/thumbnails/15.jpg)
Code Changes for the Demo (I)
![Page 16: Moore’s Law means more transistors and therefore cores, but… CPU clock rate stalled… Meanwhile RAM cost continues to drop.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649f515503460f94c748bb/html5/thumbnails/16.jpg)
Code Changes for the Demo (II)
![Page 17: Moore’s Law means more transistors and therefore cores, but… CPU clock rate stalled… Meanwhile RAM cost continues to drop.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649f515503460f94c748bb/html5/thumbnails/17.jpg)
Code Changes for the Demo (II)
![Page 18: Moore’s Law means more transistors and therefore cores, but… CPU clock rate stalled… Meanwhile RAM cost continues to drop.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649f515503460f94c748bb/html5/thumbnails/18.jpg)
Myth #5: Since tables are in memory, the data is not Durable or Highly Available – I will lose it after server crash
RealityIn-Memory OLTP is fully durable, and includes several HA features, including AlwaysOnData is persisted on disk, and will survive server crash
![Page 19: Moore’s Law means more transistors and therefore cores, but… CPU clock rate stalled… Meanwhile RAM cost continues to drop.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649f515503460f94c748bb/html5/thumbnails/19.jpg)
Memory-optimized Table
FilegroupData Filegroup
SQL Server.exe
Engine for Memory_optimized Tables & Indexes
TDS Handler and Session Management
Performance Gains
Natively Compiled SPs and Schema
Buffer Pool for Tables & Indexes
Client App
Transaction Log
Query Interop
T-SQL Query Execution
Parser, Catalog, Optimize
r
Native Compil
er
10-30x more efficient
Reduced bandwidth. Latency remains
Persistence uses sequential IO
No improvements in communication
stack, parameter passing, result set
generation In-mem
OLTP Compone
nt
KeyExisting
SQL Compone
nt
Generated .dll
Removes lock and latch contention
![Page 20: Moore’s Law means more transistors and therefore cores, but… CPU clock rate stalled… Meanwhile RAM cost continues to drop.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649f515503460f94c748bb/html5/thumbnails/20.jpg)
Performance gains in the demo (I)
Performance Bottleneck:
Latch contention
Migrate table
Bottleneck resolved:7X perf gain
![Page 21: Moore’s Law means more transistors and therefore cores, but… CPU clock rate stalled… Meanwhile RAM cost continues to drop.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649f515503460f94c748bb/html5/thumbnails/21.jpg)
Performance gains in the demo (II)
Performance Bottleneck:
CPU
Migrate stored procedures
More efficient use of CPU: another 4X perf
gain
![Page 22: Moore’s Law means more transistors and therefore cores, but… CPU clock rate stalled… Meanwhile RAM cost continues to drop.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649f515503460f94c748bb/html5/thumbnails/22.jpg)
Suitable Application CharacteristicsApplication is suited for in-memory processingAll performance critical data already fits in memoryTransaction locking or physical latching causing stalls and blocking
Application is “OLTP-Like”Relatively short-lived transactionsHigh degree of concurrent transactions from many connectionsExamples: Stock trading, travel reservations, order processing
Application migration simplified ifStored procedures usedPerformance problems isolated to subset of tables and SPs
![Page 23: Moore’s Law means more transistors and therefore cores, but… CPU clock rate stalled… Meanwhile RAM cost continues to drop.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649f515503460f94c748bb/html5/thumbnails/23.jpg)
Demo
Performance of Natively Compiled Stored Procedures
![Page 24: Moore’s Law means more transistors and therefore cores, but… CPU clock rate stalled… Meanwhile RAM cost continues to drop.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649f515503460f94c748bb/html5/thumbnails/24.jpg)
Related contentBreakout Sessions
DBI-B307 Microsoft SQL Server 2014 In-Memory OLTP: DB Developer Deep Dive – Wed 15:15DBI-B308 Microsoft SQL Server 2014 In-Memory OLTP: Management Deep Dive – Thu 15:15
Hands-On Lab: SQL Server Project “Hekaton”Find Me Later At…
MSE – Server Cloud Tools….This evening and FridayAsk The Experts…..Thursday evening
![Page 25: Moore’s Law means more transistors and therefore cores, but… CPU clock rate stalled… Meanwhile RAM cost continues to drop.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649f515503460f94c748bb/html5/thumbnails/25.jpg)
msdn
Resources for Developers
http://microsoft.com/msdn
Learning
Microsoft Certification & Training Resources
www.microsoft.com/learning
TechNet
Resources
Sessions on Demand
http://channel9.msdn.com/Events/TechEd
Resources for IT Professionals
http://microsoft.com/technet
![Page 26: Moore’s Law means more transistors and therefore cores, but… CPU clock rate stalled… Meanwhile RAM cost continues to drop.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649f515503460f94c748bb/html5/thumbnails/26.jpg)
Evaluate this session
Scan this QR code to evaluate this session.
![Page 27: Moore’s Law means more transistors and therefore cores, but… CPU clock rate stalled… Meanwhile RAM cost continues to drop.](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649f515503460f94c748bb/html5/thumbnails/27.jpg)
© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.