Post on 26-Jul-2015
INTEL® SOLID STATE DRIVE (SSD) & FOREST DB
Frank Ober, Solution Architect, IntelQi Zhu, Product Manager, Couchbase
©2015 Couchbase Inc. 3
Storage Progression > Closer to the CPU…
3
M.2
I/OController
Yesterday Today Tomorrow
M.2
I/OController
M.2
Hott
est
Data
Needs
Low
er
Late
ncy
All information provided here is subject to change without notice. Contact your Intel representative to obtain the latest Intel product specifications and roadmaps. Other names and brands may be claimed as the property of others.
The Data Center SSD Market
4
Source: IDC, 2013, 2014, Q3 2014
Intel® Data Center SSDs: #1 chosen Data Center SATA Solid-State Drive
Intel20%
Fusion IO17%
HGST11%
NetApp7%
STEC6%
SanDisk5%
Samsung5%
Other 28%
2012 DC Total Revenue
5X revenue growth 2013-2018
8+ years of Leadership
Source: IDC, June, 2014
Intel29.5%
SanDisk11.7%
WD10.6%
Fusion IO9.2%
Samsung8.9%
Other30.0%
Q2 '14 DC Revenue
The Data Center Solid-State Drive Market
5
Source: Intel Market Model and multiple industry analysts
SATA and PCIe account for approximately 70% of SSD interfaces
SATA is the dominant interface through 2016
Intel delivers SATA and PCIe* solutions to meet customer needs
NVM Express* – Architected for NVM NVM Express* is a standardized high performance software interface
for PCI Express* (PCIe*) SSDs Standardizes register set, feature set, and command set where there were only
proprietary PCIe solutions before Architected from the ground up for NAND and next generation NVM Designed to scale from Enterprise to Client systems
• Developed by an open industry consortium with a 13 company Promoter Group
*Other names and brands may be claimed as the property of others.
NVM Express* Technical Overview Supports deep queues (64K commands per queue, up to 64K queues) Supports MSI-X and interrupt steering Streamlined & simple command set (13 required commands) Optional features to address target segment Data Center: End-to-end data protection, reservations, etc. Client: Autonomous power state transitions, etc.
Designed to scale for next generation NVM, agnostic to NVM type used
NVM Express* (NVMe)*Other names and brands may be claimed as the property of others.
The Latency of NVM Express* (NVMe)• The efficiency of NVM Express* (NVMe) directly results
in leadership latency• When doubling from 6Gb to 12Gb, SAS only reduces
latency by ~ 60 µS• NVMe is more than 200 µs lower latency than 12 Gb
SAS
NVMe delivers the lowest latency of any standard storage interface.Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems, components, software, operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products. For detailed configuration information, refer to following slide, Slide #17, “Setup for Efficiency and Latency Analysis.”
Intel® SSD Data Center P3700 Series Capacity
Workload Performance
Random 4k Read 450k IOPS
Random 4k write 175k IOPS
Random 4k 70/30 R/W
265k IOPS
Sequential Read 2800 MB/s
Sequential Write 2000 MB/s
800GB
400GB
1.6TB 2TB
Form Factor
2.5inx15mm x4 HHHL Add in card
Performance Power TechnologyPower loss protection
End-to-end data protectionUBER 10-17, 2M hours MTBF
Active Write25W
Active Read11W
Idle4W
High Endurance Technology 20nm NAND – 10 to 17 DWPD
3.0, x4
Consistent performanceUltra low latency
Tests document performance of components on a particular test, in specific systems. Differences in hardware, software, or configuration will affect actual performance. Consult other sources of information to evaluate performance as you consider your purchase. For more complete information about performance and benchmark results, visit www.intel.com/benchmarks. Configurations: Intel Core i7-3770K CPU @ 3.50GHz, 8GB of system memory, Windows* Server 2012, IOMeter. Random performance is collected with 4 workers each with 32 QD.
©2015 Couchbase Inc. 11
ForestDB
A new KV storage engine developed by Couchbase caching and storage team
1.0 beta was release in Oct 2014, GA later this year
Scale from small devices to large servers Couchbase Server Secondary Index Couchbase Lite Couchbase Server KV Engine
©2015 Couchbase Inc. 12
ForestDB in Couchbase 4.0
Couchbase Server 4.0 introduces MDS(multi-dimensional scalability) ForestDB is the storage engine for Indexing Service We are working on integrating ForestDB into Couchbase Server Data
Service and Couchbase Mobile
©2015 Couchbase Inc. 13
ForestDB
Next Generation Storage Engine: ForestDB (Chiyoung Seo)
Under the Hood ForestDB: Performance on SSDs and File Systems (Sang-Won Lee and Sundar Sridharan)
SSD Optimization Adapt the SSD Flash Translation Layer (FTL) Use async I/O library (e.g., libaio)
©2015 Couchbase Inc. 15
Disclaimer
Couchbase Server 4.0 and ForestDB are still in development and the final version of the products may not be identical in details discussed on this session.
©2015 Couchbase Inc. 16
Lab Configuration
CentOS 6.5 Intel® Xeon® processor E5-2697 v3 @ 2.60GHz Number of Cores: 56 RAM: 65G Storage:
HDD: 7200 RPM HDD 1.0TB SATA SSD: IntelDC S3710 1.2TB NVMe SSD: Intel DC P3700 1.6TB
ForestDB: https://github.com/couchbase/forestdb
ForestDB benchmark: https://github.com/couchbaselabs/ForestDB-Benchmark
©2015 Couchbase Inc. 17
Testing Scenarios
Key/Value store Index Simulation Throughput Testing (Parallel Benchmark)
©2015 Couchbase Inc. 18
Key/Value Store
Key size: 48 bytes Document size: 1KB Number of documents: 100M ForestDB cache: 30G 4 reader thread, 1 writer thread(sync write) R:W = 4:1 Single File/Single benchmark program
©2015 Couchbase Inc. 19
K/V Testing : Throughput (op/s)
0
5000
10000
15000
20000
25000
30000
189 47
16678
4170
HDD SATA NVMe
Read Throughput Write Throughput
25302
6325
R:W = 4:1Single File/Instance
©2015 Couchbase Inc. 20
K/V Testing: Read Latency (ms)
0
0.5
1
1.5
2
2.5
3
3.5
1.745
3.264
1.136
2.994
SATA NVMe
95% 99%
R:W = 4:1Single File/InstanceSATA throughput: 16678NVMe throughput: 25302
©2015 Couchbase Inc. 21
K/V Testing: Durable Write Latency (ms)
0
50
100
150
200
250
300264.165
282.442
188.333 200.758
SATA NVMe
95% 99%
R:W = 4:1Single File/InstanceSATA throughput: 4170NVMe throughput: 6325
©2015 Couchbase Inc. 22
Key/Value Testing Summary
Comparing to SATA, NVMe provides 50% increase on R/W throughput 40% improvement on R/W latency (95%)
©2015 Couchbase Inc. 23
Indexing Service Testing
Key size: 1KB Document size: null Number of documents: 100M ForestDB cache: 30G 4 reader thread, 1 writer thread(sync write) R/W= 4:1 Single file/Single benchmark program
©2015 Couchbase Inc. 24
Index Testing: Throughput (op/s)
0
5000
10000
15000
20000
25000
186 46
13987
3497
HDD SATA NVMe
Read Throughput Write Throughput
20841
5209
R:W = 4:1Single File/Instance
©2015 Couchbase Inc. 25
Index Testing: Read Latency (ms)
0
0.5
1
1.5
2
2.5
3
3.5
4
4.5
1.853
3.811
1.254
3.145
SATA NVMe
95% 99%
R:W = 4:1Single File/InstanceSATA throughput: 13987NVMe throughput: 20841
©2015 Couchbase Inc. 26
Index Testing: Durable Write Latency (ms)
0
50
100
150
200
250
300
350
275.812301.768
215.758 228.819
SATA NVMe
95% 99%
R:W = 4:1Single File/InstanceSATA throughput: 3497NVMe throughput: 5209
©2015 Couchbase Inc. 27
Index Simulation Testing Summary
Comparing to SATA, NVMe provides 50% increase on R/W throughput 30% improvement on R/W latency (95%)
©2015 Couchbase Inc. 28
Throughput Testing : Parallel Benchmark
Key size: 48 bytes Document size: 1K Number of documents: 100M ForestDB Cache: 10G 4 benchmark program running in parallel
4 reader/1 writer for each benchmark program Each thread is running at its max capacity Each benchmark reads/writes to its own file
©2015 Couchbase Inc. 29
Throughput Testing: Throughput (op/s)
0
10000
20000
30000
40000
50000
60000
70000
30755
7282
47345
63946
SATA NVMe
Read Throughput Write Throughput
4 reader, 1 writerMax capacity for each thread 4 files, 4 instances
©2015 Couchbase Inc. 30
Throughput Testing Summary
Comparing to SATA drive, NVMe provides 50% increase on read throughput 900% increase on write throughput
©2015 Couchbase Inc. 31
Summary
K/V Store Indexing Parallel Throughput
SATA NVMe SATA NVMe SATA NVMeRead Throughput
16678 25302 13987 20341 30755 47345
Write Throughput
4170 6325 3497 5209 7282 63946
95% Read Latency
1.745 1.136 1.853 1.254 4.0(?) 7.5(?)
95% Write Latency
264 188 276 216 1934 270SATA: S3710 1.2TBNVMe: P3700 1.6TB