@ andy_pavlo
-
Upload
gloria-sweet -
Category
Documents
-
view
37 -
download
4
description
Transcript of @ andy_pavlo
![Page 2: @ andy_pavlo](https://reader035.fdocuments.in/reader035/viewer/2022062407/56812f85550346895d9504bb/html5/thumbnails/2.jpg)
2013
JanuaryRetreat
ThesisDefense
DecemberRetreat
JobInterviews
Moved toCMU
![Page 3: @ andy_pavlo](https://reader035.fdocuments.in/reader035/viewer/2022062407/56812f85550346895d9504bb/html5/thumbnails/3.jpg)
2013
JanuaryRetreat
ThesisDefense
DecemberRetreat
JobInterviews
Moved toCMU?
![Page 4: @ andy_pavlo](https://reader035.fdocuments.in/reader035/viewer/2022062407/56812f85550346895d9504bb/html5/thumbnails/4.jpg)
![Page 5: @ andy_pavlo](https://reader035.fdocuments.in/reader035/viewer/2022062407/56812f85550346895d9504bb/html5/thumbnails/5.jpg)
![Page 6: @ andy_pavlo](https://reader035.fdocuments.in/reader035/viewer/2022062407/56812f85550346895d9504bb/html5/thumbnails/6.jpg)
![Page 7: @ andy_pavlo](https://reader035.fdocuments.in/reader035/viewer/2022062407/56812f85550346895d9504bb/html5/thumbnails/7.jpg)
![Page 8: @ andy_pavlo](https://reader035.fdocuments.in/reader035/viewer/2022062407/56812f85550346895d9504bb/html5/thumbnails/8.jpg)
8
Prison Life
Washing Dishes
Not FightingRepentant
Cafeteria Thievery
ShankingsMaking Pruno
GOOD
EVIL
![Page 9: @ andy_pavlo](https://reader035.fdocuments.in/reader035/viewer/2022062407/56812f85550346895d9504bb/html5/thumbnails/9.jpg)
9
NVM OLTP
Lightweight CCLogical Logging
Snapshots
Heavyweight CC
ARIES LoggingMaking Pruno
DRAM
SSD/HDD
![Page 10: @ andy_pavlo](https://reader035.fdocuments.in/reader035/viewer/2022062407/56812f85550346895d9504bb/html5/thumbnails/10.jpg)
10
Project Overview• Understand the performance
characteristics of NVM to develop an optimal DBMS architecture for it.
![Page 11: @ andy_pavlo](https://reader035.fdocuments.in/reader035/viewer/2022062407/56812f85550346895d9504bb/html5/thumbnails/11.jpg)
11
Current Research Status• Compare DBMS architectures:–H-Store with Logging → NVM–Anti-Caching → NVM (block)–Anti-Caching → NVM (tuple)–H-Store with MMAP → NVM
![Page 12: @ andy_pavlo](https://reader035.fdocuments.in/reader035/viewer/2022062407/56812f85550346895d9504bb/html5/thumbnails/12.jpg)
12
H-Store – NVM Edition• Converted storage manager to
use NVM through MMAP:–Table tuple storage.–VARCHAR/BLOB data pool.–Table indexes.
![Page 13: @ andy_pavlo](https://reader035.fdocuments.in/reader035/viewer/2022062407/56812f85550346895d9504bb/html5/thumbnails/13.jpg)
13
H-Store – NVM Edition• Minor changes to exec engine:–Group commit (msync)
• Current implementation is not transactional fail-safe.
![Page 14: @ andy_pavlo](https://reader035.fdocuments.in/reader035/viewer/2022062407/56812f85550346895d9504bb/html5/thumbnails/14.jpg)
14
Experimental Evaluation• Compare two architectures:–H-Store with MMAP → NVM–MySQL → NVM
• Yahoo! Cloud Serving Benchmark:–10 million records (~10GB)–8x database / memory MySQL
![Page 15: @ andy_pavlo](https://reader035.fdocuments.in/reader035/viewer/2022062407/56812f85550346895d9504bb/html5/thumbnails/15.jpg)
15
HIGH SKEW LOW SKEW0
100,000
200,000
300,000
400,000
500,000
YCSB //
TXN/SEC
MySQL→NVMH-Store→NVM
Read-Only Workload2x Latency Relative to DRAM
![Page 16: @ andy_pavlo](https://reader035.fdocuments.in/reader035/viewer/2022062407/56812f85550346895d9504bb/html5/thumbnails/16.jpg)
16
HIGH SKEW LOW SKEW0
100,000
200,000
300,000
400,000
500,000
YCSB //
TXN/SEC
Read-Only Workload16x Latency Relative to DRAM
↓11% ↓29%
MySQL→NVMH-Store→NVM
![Page 17: @ andy_pavlo](https://reader035.fdocuments.in/reader035/viewer/2022062407/56812f85550346895d9504bb/html5/thumbnails/17.jpg)
17
HIGH SKEW LOW SKEW0
25,000
50,000
75,000
100,000
YCSB //
TXN/SEC
50% Reads / 50% Writes Workload2x Latency Relative to DRAM
MySQL→NVMH-Store→NVM
![Page 18: @ andy_pavlo](https://reader035.fdocuments.in/reader035/viewer/2022062407/56812f85550346895d9504bb/html5/thumbnails/18.jpg)
18
HIGH SKEW LOW SKEW0
25,000
50,000
75,000
100,000
YCSB //
TXN/SEC
50% Reads / 50% Writes Workload16x Latency Relative to DRAM
↓13% ↓8%
MySQL→NVMH-Store→NVM
![Page 19: @ andy_pavlo](https://reader035.fdocuments.in/reader035/viewer/2022062407/56812f85550346895d9504bb/html5/thumbnails/19.jpg)
19
Discussion• Overhead is only from reads
and msync syscalls.• We’re not doing anything
special with the NVM.–Contents of NVM are ignored for crash recovery.
![Page 20: @ andy_pavlo](https://reader035.fdocuments.in/reader035/viewer/2022062407/56812f85550346895d9504bb/html5/thumbnails/20.jpg)
20
What’s Next?• Port snapshot code to use
NVM.• Improve MMAP storage
manager.• Full comparison +
experiments.• Start building the next
system…
![Page 21: @ andy_pavlo](https://reader035.fdocuments.in/reader035/viewer/2022062407/56812f85550346895d9504bb/html5/thumbnails/21.jpg)
N-STORE
![Page 22: @ andy_pavlo](https://reader035.fdocuments.in/reader035/viewer/2022062407/56812f85550346895d9504bb/html5/thumbnails/22.jpg)
22
N-Store – Possibility #1• Keep DRAM.• Hybrid OLTP/OLAP
architecture:–Row Store → DRAM–Column Store → NVM
• Multi-faceted indexes.
![Page 23: @ andy_pavlo](https://reader035.fdocuments.in/reader035/viewer/2022062407/56812f85550346895d9504bb/html5/thumbnails/23.jpg)
23
N-Store – Possibility #2• Ditch DRAM.• Instant recovery:–No snapshots.–No logging.
• NVM-friendly concurrency control scheme.
![Page 24: @ andy_pavlo](https://reader035.fdocuments.in/reader035/viewer/2022062407/56812f85550346895d9504bb/html5/thumbnails/24.jpg)
24
What do we need?• Be able to tune the msync
latency of the NVM SDV.• Custom malloc
implementation that runs entirely of PMFS.
![Page 25: @ andy_pavlo](https://reader035.fdocuments.in/reader035/viewer/2022062407/56812f85550346895d9504bb/html5/thumbnails/25.jpg)
AndyPavlo
Col. StanZdonik
MikeStonebraker
JustinDeBrabant
JoyArulraj
SubramanyaDulloor
RajeshSankaran
JeffParkhurst
![Page 26: @ andy_pavlo](https://reader035.fdocuments.in/reader035/viewer/2022062407/56812f85550346895d9504bb/html5/thumbnails/26.jpg)
@ANDY_PAVLOEND