NVM Solutions Group

Frank Ober Al Tobey

NVM Solutions Group Performance Architect - DataStax

Legal DisclaimerInformation in this document is provided in connection with intel products. No license, express or implied, by estoppel or otherwise, to any intellectual property rights is granted by this document. Except as provided in intel's terms and conditions of sale for such products, intel assumes no liability whatsoever and intel disclaims any express or implied warranty, relating to sale and/or use of intel products including liability or warranties relating to fitness for a particular purpose, merchantability, or infringement of any patent, copyright or other intellectual property right.

A "mission critical application" is any application in which failure of the intel product could result, directly or indirectly, in personal injury or death. Should you purchase or use intel's products for any such mission critical application, you shall indemnify and hold intel and its subsidiaries, subcontractors and affiliates, and the directors, officers, and employees of each, harmless against all claims costs, damages, and expenses and reasonable attorneys' fees arising out of, directly or indirectly, any claim of product liability, personal injury, or death arising in any way outof such mission critical application, whether or not intel or its subcontractor was negligent in the design, manufacture, or warning of the intel product or any of its parts.

Intel may make changes to specifications and product descriptions at any time, without notice. Designers must not rely on the absence or characteristics of any features or instructions marked "reserved" or "undefined". Intel reserves these for future definition and shall have no responsibility whatsoever for conflicts or incompatibilities arising from future changes to them. The information here is subject to change without notice. Do not finalize a design with this information.

The products described in this document may contain design defects or errors known as errata which may cause the product to deviate from published specifications. Current characterized errata are available on request.

NVM Solutions Group

Re-Architecting the Memory-Storage Hierarchy with 3D XPoint™ Technology and 3D NAND

DDR

NAND SSD

Hard Disk Drives

3D XPoint(NVMe SSD)

3D XPoint(DIMM)

3D NAND SSD with TLC

3D NAND SSD

CPU

NVM Solutions Group

3D Xpoint™ TECHNOLOGYA new class of non-volatile memory Media

1Technology claims are based on comparisons of latency, density and write cycling metrics amongst memory technologies recorded on published specifications of in-market memory products against internal Intel specifications

1000Xfaster

THAN NAND1

1000Xendurance

OF NAND1

10XdenserTHAN DRAM1

Nand-like densities and dram-like speeds

NVM Solutions Group

The Explosion of DataRequires Technology To Perform Random Data Access, Low Queue Depth and Cache Line Size Optimally

Many Industries Are Seeking the “Ideal Memory”Financial Services Fraud Detection Online Advertising Scientific Research Gaming

NVM Solutions Group

Intel® ssds with intel® optane™ technologyWill Come in Many Form Factors

M.2 U.2 2.5in Add-in Card

NVMe optimizes low latency with high performance storage

NVM Solutions Group

NAND vs 3D XPoint™ Technology: SSD IOPS vs QD

Queue Depth

IOP

S

NAND NVMe SSD

0 16 32 64 96 128 …256

Intel® Optane™ SSD based on 3D XPoint™ Technology

Normaloperating

range

4k Random Read IOPS

Comparisons between memory technologies based on in-market product specifications and internal Intel specifications.

3D XPoint™ Technology Provides High IOPs and Full Bandwidth at Low Queue Depth

NVM Solutions Group

New Faster SSDs Emerge…Where will they be used?

Extend DRAMIn memory databasesKey value stores and MemCache use modelsGoal is to lower TCO and execute larger datasets

Faster SSD as memory and storageReal time analytics – and ever faster NoSQLFraud detection, ad bidding, real time decision making, tradingCloud hosting – amazing QoS for better application SLAsUltra High Definition all professional video production

CachingCloud hosting, all flash array, SAN, tiered DBWrite buffer for RAID array

NVM Solutions Group

NVM Solutions Group

Intel® SSD DC P3700 Series

Performance

Intel® SSD DC P3600 Series Intel® SSD DC P3500 Series

800GB

400GB

1.6TB 2TB 800GB

400GB

1.6TB 2TB1.2TB 400GB

2TB1.2TB

Endurance

10DWPD

3DWPD

0.3DWPD

High Endurance Technology

Mixed use Read Intensive

Random 4k Read 450k IOPS

Random 4k Write 175k IOPS

Random 4k 70/30 R/W 265k IOPS

Sequential Read 2800 MB/s

Sequential Write 2000 MB/s

450k IOPS

56k IOPS

160k IOPS

2600 MB/s

1700 MB/s

450k IOPS

35k IOPS

85k IOPS

2500 MB/s

1700 MB/s

NVM Solutions Group

Workload

Random 4k Read Up to 85k IOPS

Random 4k Write Up to 45k IOPS

Random 4k 70/30 R/W Up to 63k IOPS

Sequential Read Up to 550 MB/s

Sequential Write Up to 520 MB/s

Avg Active R/W Power 2.6-3.1/4-6.9 W

Idle Power 600 mW

800GB

1.2TB

2.5inx7mm

400GB

200GB

Intel® SSD DC S3710 Series

Delivering up to 25% more write performance than the Intel SSD DC S3700 Series

Performance Features

Power loss protection End-to-end data protectionAES 256b encryption

High Endurance Technology 20nm NAND – 10 DWPD

Consistently amazing performance

Tests document performance of components on a particular test, in specific systems. Differences in hardware, software, or configuration will affect actual performance. Configurations: Intel Core i7-3770K CPU @ 3.50GHz, 8GB of system memory, Windows1

Server 2012, IOMeter. Random performance is collected with 4 workers each with 32 QD. Average RMS Active write power measured at max bandwidth. *Other names and brands may be claimed as the property of others.

NVM Solutions Group

NVM Solutions Group

Configuration of test machines

Intel Board S2600GZ – White Box - dual socket (current – 1 generation)

Intel CPU E5 2697 – v2 (12 true cores, 24 hardware threads) @ 2.8Ghz

Intel Ethernet Controller 82599ES 10Gb

Intel SSD DC P3700 800GB (NVMe)

Intel SSD DC S3710 800GB (SATA)

Non-Intel SAS HDD 7.2k RPM (SATA)

Using an older release and kernel to test NVMe, we sandbagged ourselves!

Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems, components, software, operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products. For more complete information visit http://www.intel.com/performance.

NVM Solutions Group 14

First try fio – holy cow!

NVMe on bm007 300k IOPS , almost no waits. SATA on bm022, HDD on bm024

NVM Solutions Group 15

dstat - fio rw 25/75 workload

1% CPU overhead, and PCIe bus is saturated

NVM Solutions Group 16

Cassandra stress on large objects across 3 nodes

NVMe reduces system overhead allowing Cassandra to get more done

NVM Solutions Group 17

Latency rw 25/75

50 us

130 us

NVM Solutions Group 18

Latency variation deep dive

NVMe SATA

The tighter and lower latency means a more stable system overall.

NVM Solutions Group 19

Drive throughput matters. (50/50 rw)

NVMe can outclass SATA drives many times over, No HBA’s, no bus arbitration

NVM Solutions Group 20

NVMe driver on Linux (blog)feature/kernel 3.3 3.6 3.9 3.10 3.12 3.14 3.15 3.16 3.19 4.0 4.1

high performance, NVMe 1.0

spec

√ √ √ √ √ √ √ √ √ √ √

Greater than 512byte LBA √ √ √ √ √ √ √ v √ √

Discard/TRIM √ √ √ √ √ √ √ √ √

Disk stats – iostat

BIO splitting

√ √ √ √ √ √ √ √

Power Management:

Suspend/Resume

√ √ √ √ √ √ √

Dynamic partitions

Surprise removal

Command Abort

√ √ √ √ √ √

Surprise removal

per-CPU and optimizations

√ √ √ √ √

trace events √ √ √ √

Block-mq, and hot-plug

finalization

√ √ √

Multipath NVMe √ √

DIF/DIX & Metadata, hot-cpu √

)

http://intel.ly/1F6zrdh

Thanks for attending…