Real World Data Center Workloads & Advanced Storage ... · 2019 Storage Developer Conference. ©...
Transcript of Real World Data Center Workloads & Advanced Storage ... · 2019 Storage Developer Conference. ©...
![Page 1: Real World Data Center Workloads & Advanced Storage ... · 2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved. 1 Real World Data Center Workloads & Advanced](https://reader030.fdocuments.in/reader030/viewer/2022011819/5e9abc62937d8c7c047cb40f/html5/thumbnails/1.jpg)
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.1
Real World Data Center Workloads
& Advanced Storage Architectures
Eden KimCalypso Systems, Inc.
![Page 2: Real World Data Center Workloads & Advanced Storage ... · 2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved. 1 Real World Data Center Workloads & Advanced](https://reader030.fdocuments.in/reader030/viewer/2022011819/5e9abc62937d8c7c047cb40f/html5/thumbnails/2.jpg)
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.2
Datacenter Real World Workloads
& Advanced Storage Architectures
![Page 3: Real World Data Center Workloads & Advanced Storage ... · 2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved. 1 Real World Data Center Workloads & Advanced](https://reader030.fdocuments.in/reader030/viewer/2022011819/5e9abc62937d8c7c047cb40f/html5/thumbnails/3.jpg)
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.3
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.
Fabric
Virtual
Enterprise VM VM VM VM
Remote PM
Infiniband
EthernetNVMe-oF
Fibre ChanneliSCSI
VirtualStorage
Remote PM
Infiniband
EthernetNVMe-oF
Fibre ChanneliSCSI
FileSystem
Enterprise StorageOpen Stack
DAS
PMNAS
ObjectSAN
Enterprise Storage
FileSystem
Block IO
SSD CLUSTERDCPMMNVDIMM HDDLUN
The “Holy Grail”
• Real World Workloads have long been called the “Holy Grail” of Computing & Storage
• Advanced Software and Storage Design, Performance and Validation Depends on your Real World Workload
• Real World Workloads are very different from Synthetic Lab workloads and change depending on where the workload is captured
![Page 4: Real World Data Center Workloads & Advanced Storage ... · 2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved. 1 Real World Data Center Workloads & Advanced](https://reader030.fdocuments.in/reader030/viewer/2022011819/5e9abc62937d8c7c047cb40f/html5/thumbnails/4.jpg)
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.4
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.
Real World Workloads are Important forEnabling Emerging Technologies
Artificial Intelligence
Genetics/Genomics
3D Animations
Cloud StorageBig Data
Web Portals
Machine Learning
5G Edge Servers
![Page 5: Real World Data Center Workloads & Advanced Storage ... · 2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved. 1 Real World Data Center Workloads & Advanced](https://reader030.fdocuments.in/reader030/viewer/2022011819/5e9abc62937d8c7c047cb40f/html5/thumbnails/5.jpg)
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.5
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.
What Are Real World Workloads?
Constantly Changing IO Streams and QDs
QueueDepths
IOsIOPS
IOStreams
2 amBack-up
Low User Activity
Morning BootStorm Activity
Daily Retail Activity
Closing Activity
Late Evening Activity
IOs are Affected at Each Layer of Abstraction Dynamically Changing IO Streams & QDs
IO Streams Change as they Traverse the IO Stack:
Real World Workloads are Dynamic & Unique:
![Page 6: Real World Data Center Workloads & Advanced Storage ... · 2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved. 1 Real World Data Center Workloads & Advanced](https://reader030.fdocuments.in/reader030/viewer/2022011819/5e9abc62937d8c7c047cb40f/html5/thumbnails/6.jpg)
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.6
Comparing
Real World Workloads
![Page 7: Real World Data Center Workloads & Advanced Storage ... · 2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved. 1 Real World Data Center Workloads & Advanced](https://reader030.fdocuments.in/reader030/viewer/2022011819/5e9abc62937d8c7c047cb40f/html5/thumbnails/7.jpg)
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.7
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.
Ave QD = 114Median QD = 115Max QD = 368
9 IO Streams = 86%67:33 RW MixSEQ 128b R = 70% IOs
2. GPS Nav Portal: Drive C
Ave QD = 15Median QD = 8Max QD = 368
9 IO Streams = 78%96% WriteSEQ 0.5K W Spikes
3. GPS Nav Portal: Drive 01. Retail Web Portal: Drive0/Drive1
Ave QD = 22Median QD = 19Max QD = 306
9 IO Streams = 71%66:34 RW MixRetail Store Events
Comparing Real World Workloads
![Page 8: Real World Data Center Workloads & Advanced Storage ... · 2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved. 1 Real World Data Center Workloads & Advanced](https://reader030.fdocuments.in/reader030/viewer/2022011819/5e9abc62937d8c7c047cb40f/html5/thumbnails/8.jpg)
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.8
Analysis of
Real World Workloads
![Page 9: Real World Data Center Workloads & Advanced Storage ... · 2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved. 1 Real World Data Center Workloads & Advanced](https://reader030.fdocuments.in/reader030/viewer/2022011819/5e9abc62937d8c7c047cb40f/html5/thumbnails/9.jpg)
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.9
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.
www.TestMyWorkload.com
• Official SNIA SSSI Real World Workload Capture Tools and Reference Workloads
• Free IO Capture Tools for Windows, Linux, Mac
• Reference SSS TWG and User Workload Captures
• White Papers, Tutorials, FAQ
Free Capture & Analysis Tools at TestMyWorkload.com
![Page 10: Real World Data Center Workloads & Advanced Storage ... · 2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved. 1 Real World Data Center Workloads & Advanced](https://reader030.fdocuments.in/reader030/viewer/2022011819/5e9abc62937d8c7c047cb40f/html5/thumbnails/10.jpg)
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.10
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.
Retail Web Portal Drive0Drive1 9 Streams 71% 66:34 RW 5,086 Streams Mixed Applications Retail Store Operation Events
2 am Back-up
SEQ 64K RW
Cumulative Workload5,086 IO Streams: 4,551,062 IOs
9 IO Streams: 71% 3,223,582 IOs
Early amLow Utilization
RND 4K W
Boot StormHigh OIO
SEQ 0.5K W
Daily ActivityMixed IOs
RND/SEQ 8K RW
Closing HrsRND/SEQ 8K RW
SEQ 0.5K W
Evening ActivityMixed IOs
RND/SEQ 8K RW
Process IDs 36 PIDssqlservr.exe 79.5% 3,617,412 IOssystem 13.2% 599,012 IOs
Retail Web Portal24 Hour Drive0Drive1
IO Stream Map, Workload Description, PIDs
![Page 11: Real World Data Center Workloads & Advanced Storage ... · 2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved. 1 Real World Data Center Workloads & Advanced](https://reader030.fdocuments.in/reader030/viewer/2022011819/5e9abc62937d8c7c047cb40f/html5/thumbnails/11.jpg)
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.11
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.
IO Stream Map, LBA Range Hits, Metrics
2. MB/s: Amount Transferred; Ave/Max QD 3. IO Stream & LBA Range: IO Sequentiality1. IOs: IO Stream Threshold & ART/MRT
Workload Data Analytics:View by IOs or MBs; IO Streams & Threshold;
Response Times; QDs; IO Bursts & Sequentiality
![Page 12: Real World Data Center Workloads & Advanced Storage ... · 2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved. 1 Real World Data Center Workloads & Advanced](https://reader030.fdocuments.in/reader030/viewer/2022011819/5e9abc62937d8c7c047cb40f/html5/thumbnails/12.jpg)
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.12
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.
Workload Descriptions, PIDs, IO Streams, Metrics
5. Process IDs 6. IO Streams & Metrics4. Workload Descriptions
Workload Data Analytics:Cumulative, Event, Time Point, Range Workloads;
Process IDs (PIDs); IO Stream Combinations & Metrics
![Page 13: Real World Data Center Workloads & Advanced Storage ... · 2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved. 1 Real World Data Center Workloads & Advanced](https://reader030.fdocuments.in/reader030/viewer/2022011819/5e9abc62937d8c7c047cb40f/html5/thumbnails/13.jpg)
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.13
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.
7. TRIMs 8. IO Burst & Sequentiality 9. Compression & Duplication
TRIMs, IO Burst, IO Sequentiality, Compression, Dedupe
Workload Data Analytics:TRIMs, TRIM MB/s, TRIM ART/MRT;
IO Bursts & Sequentiality; Compression & Duplication
![Page 14: Real World Data Center Workloads & Advanced Storage ... · 2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved. 1 Real World Data Center Workloads & Advanced](https://reader030.fdocuments.in/reader030/viewer/2022011819/5e9abc62937d8c7c047cb40f/html5/thumbnails/14.jpg)
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.14
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.
Real Time Plot Playback - WAF, QoS, TPBW
Workload Data Analytics:Write Amplification Factor (WAF);
5 9s QoS Response Times; Total PB Written (TPBW)
![Page 15: Real World Data Center Workloads & Advanced Storage ... · 2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved. 1 Real World Data Center Workloads & Advanced](https://reader030.fdocuments.in/reader030/viewer/2022011819/5e9abc62937d8c7c047cb40f/html5/thumbnails/15.jpg)
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.15
NVMe U.2 SSD
Optimization Using Real World Workloads
![Page 16: Real World Data Center Workloads & Advanced Storage ... · 2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved. 1 Real World Data Center Workloads & Advanced](https://reader030.fdocuments.in/reader030/viewer/2022011819/5e9abc62937d8c7c047cb40f/html5/thumbnails/16.jpg)
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.16
Real World Replay: U.2-H > U.2-M > U.2-S
U.2-H
U.2-M
U.2-S
ART
QoS
MRT
NVMe U.2 SSD: Replay Test of Retail Web Portal Workload
![Page 17: Real World Data Center Workloads & Advanced Storage ... · 2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved. 1 Real World Data Center Workloads & Advanced](https://reader030.fdocuments.in/reader030/viewer/2022011819/5e9abc62937d8c7c047cb40f/html5/thumbnails/17.jpg)
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.17
Retail Web Portal9 IO Stream Workload
RND 64K R 26.1%SEQ 0.5K W 24.0%
Retail Web Portal – 73:27 RWA0
RND 8K R 14.2%SEQ 8K R 11.9%RND 4K W 5.7%SEQ 64K W 5.3%SEQ 4K R 4.8%RND 4K R 4.1%RND 8K W 3.9%
Individual Streams: RND 4K R/W vs SEQ 0.5K W
1
2
3
1
2
3
1
2
3
Synthetic Benchmark:RND 4K R/W: U.2-S > U.2-H
Real World Replay:SEQ 0.5K W: U.2-H > U.2-S
![Page 18: Real World Data Center Workloads & Advanced Storage ... · 2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved. 1 Real World Data Center Workloads & Advanced](https://reader030.fdocuments.in/reader030/viewer/2022011819/5e9abc62937d8c7c047cb40f/html5/thumbnails/18.jpg)
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.18
Persistent Memory
Optimization Using Real World Workloads
![Page 19: Real World Data Center Workloads & Advanced Storage ... · 2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved. 1 Real World Data Center Workloads & Advanced](https://reader030.fdocuments.in/reader030/viewer/2022011819/5e9abc62937d8c7c047cb40f/html5/thumbnails/19.jpg)
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.19
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.
PM Optimization – PM Aware App: DRAM v DCPMM
Optimization
Read - Write Workload
Total Media WritesWAF - Endurance DRAM DCPMM DCPMM SSD
PM Driver
Applications
Read/WriteBlock IO
PCI Bus
Write Dominant
PM Aware Apps
In-Memory
Traditional Apps
Read Dominant
Byte (Cache Line)
IO
BlockIO
Byte(Cache Line)
IO
MMU
Load/StoreByte
Addressable
![Page 20: Real World Data Center Workloads & Advanced Storage ... · 2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved. 1 Real World Data Center Workloads & Advanced](https://reader030.fdocuments.in/reader030/viewer/2022011819/5e9abc62937d8c7c047cb40f/html5/thumbnails/20.jpg)
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.20
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.
PM R/W Optimization – R Dominant to PM, W Dominant to DRAM
100% Reads
100% Writes
0% R0% W
![Page 21: Real World Data Center Workloads & Advanced Storage ... · 2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved. 1 Real World Data Center Workloads & Advanced](https://reader030.fdocuments.in/reader030/viewer/2022011819/5e9abc62937d8c7c047cb40f/html5/thumbnails/21.jpg)
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.21
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.
PM WAF Optimization – WAF by IO Streams; Endurance TPBW/Year
![Page 22: Real World Data Center Workloads & Advanced Storage ... · 2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved. 1 Real World Data Center Workloads & Advanced](https://reader030.fdocuments.in/reader030/viewer/2022011819/5e9abc62937d8c7c047cb40f/html5/thumbnails/22.jpg)
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.22
Questions?Thank You!
Eden Kim, CEO Calypso Systems, Inc.
Chair - SNIA Solid State Storage Technical Working [email protected]
www.TestMyWorkload.com
![Page 23: Real World Data Center Workloads & Advanced Storage ... · 2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved. 1 Real World Data Center Workloads & Advanced](https://reader030.fdocuments.in/reader030/viewer/2022011819/5e9abc62937d8c7c047cb40f/html5/thumbnails/23.jpg)
2019 Storage Developer Conference. © Calypso Systems, Inc. All Rights Reserved.23
Please take a moment to rate this session.
Your feedback matters to us.