SSD Performance - Homepage Cees de · PDF fileResearch topic Maximizing Solid State Disk...
Transcript of SSD Performance - Homepage Cees de · PDF fileResearch topic Maximizing Solid State Disk...
![Page 1: SSD Performance - Homepage Cees de · PDF fileResearch topic Maximizing Solid State Disk throughput. Official research question: How can SARA implement Solid State Disks in their setups](https://reader034.fdocuments.in/reader034/viewer/2022051721/5a8525447f8b9a9f1b8c45f0/html5/thumbnails/1.jpg)
SSD Performance
RP1 Sebastian Carlier & Daan Muller
27
![Page 2: SSD Performance - Homepage Cees de · PDF fileResearch topic Maximizing Solid State Disk throughput. Official research question: How can SARA implement Solid State Disks in their setups](https://reader034.fdocuments.in/reader034/viewer/2022051721/5a8525447f8b9a9f1b8c45f0/html5/thumbnails/2.jpg)
Research topic
Maximizing Solid State Disk throughput.
Official research question: How can SARA implement Solid State Disks in their setups to improve sequential read performance over conventional spinning disks and what parameters should be used to accomplish this?
26
![Page 3: SSD Performance - Homepage Cees de · PDF fileResearch topic Maximizing Solid State Disk throughput. Official research question: How can SARA implement Solid State Disks in their setups](https://reader034.fdocuments.in/reader034/viewer/2022051721/5a8525447f8b9a9f1b8c45f0/html5/thumbnails/3.jpg)
Testing parameters
RAID stripe sizesFile system block sizesRAID levelsSoftware vs. hardware RAIDAreca vs Dell RAID controller Number of disks (scalability)File systems
25
![Page 4: SSD Performance - Homepage Cees de · PDF fileResearch topic Maximizing Solid State Disk throughput. Official research question: How can SARA implement Solid State Disks in their setups](https://reader034.fdocuments.in/reader034/viewer/2022051721/5a8525447f8b9a9f1b8c45f0/html5/thumbnails/4.jpg)
Server setupBase:Intel Xeon CPU X5550 (Quad core + HT) 6 GB DDR3
8 disk SAS backplane SAS Controllers: Dell PERC 6/i
Areca ARC1680xi-12
DisksSpinning:Dell 7.2k rpm 160 GB (x5) Solid state:Intel X25-M G2 160GB (x5)
24
![Page 5: SSD Performance - Homepage Cees de · PDF fileResearch topic Maximizing Solid State Disk throughput. Official research question: How can SARA implement Solid State Disks in their setups](https://reader034.fdocuments.in/reader034/viewer/2022051721/5a8525447f8b9a9f1b8c45f0/html5/thumbnails/5.jpg)
Intel X25-M G2 160 GB
10 x 16 GB Intel NAND chipsmulti level cell512 KB block / min. overwrite size4 KB page size / min. write sizeManufacturer claims up to:
250 MB/s read speed0.065 ms read latency
23
![Page 6: SSD Performance - Homepage Cees de · PDF fileResearch topic Maximizing Solid State Disk throughput. Official research question: How can SARA implement Solid State Disks in their setups](https://reader034.fdocuments.in/reader034/viewer/2022051721/5a8525447f8b9a9f1b8c45f0/html5/thumbnails/6.jpg)
PredictionsRead performance scaling linearly.Achieving higher read speeds with hardware RAID.RAID-0 / 1 arrays would be fastest in Linux.RAID-5 arrays would be a close second.Larger RAID stripe size would increase speed.Changing filesystem blocksize would have a significant effect.File systems having a noticeable effect.Predictions made during preliminary tests:
Perc i6 RAID controller would be a bottleneck.Areca ARC 1680xi-12 would answer our prayers (that is reach ~1100MB/s read performance).
22
![Page 7: SSD Performance - Homepage Cees de · PDF fileResearch topic Maximizing Solid State Disk throughput. Official research question: How can SARA implement Solid State Disks in their setups](https://reader034.fdocuments.in/reader034/viewer/2022051721/5a8525447f8b9a9f1b8c45f0/html5/thumbnails/7.jpg)
RAID levels
RAID-0RAID-1RAID-10RAID-5RAID-6
21
![Page 8: SSD Performance - Homepage Cees de · PDF fileResearch topic Maximizing Solid State Disk throughput. Official research question: How can SARA implement Solid State Disks in their setups](https://reader034.fdocuments.in/reader034/viewer/2022051721/5a8525447f8b9a9f1b8c45f0/html5/thumbnails/8.jpg)
RAID-0
20
![Page 9: SSD Performance - Homepage Cees de · PDF fileResearch topic Maximizing Solid State Disk throughput. Official research question: How can SARA implement Solid State Disks in their setups](https://reader034.fdocuments.in/reader034/viewer/2022051721/5a8525447f8b9a9f1b8c45f0/html5/thumbnails/9.jpg)
RAID-1
19
![Page 10: SSD Performance - Homepage Cees de · PDF fileResearch topic Maximizing Solid State Disk throughput. Official research question: How can SARA implement Solid State Disks in their setups](https://reader034.fdocuments.in/reader034/viewer/2022051721/5a8525447f8b9a9f1b8c45f0/html5/thumbnails/10.jpg)
RAID-0+1
18
![Page 11: SSD Performance - Homepage Cees de · PDF fileResearch topic Maximizing Solid State Disk throughput. Official research question: How can SARA implement Solid State Disks in their setups](https://reader034.fdocuments.in/reader034/viewer/2022051721/5a8525447f8b9a9f1b8c45f0/html5/thumbnails/11.jpg)
RAID-5
17
![Page 12: SSD Performance - Homepage Cees de · PDF fileResearch topic Maximizing Solid State Disk throughput. Official research question: How can SARA implement Solid State Disks in their setups](https://reader034.fdocuments.in/reader034/viewer/2022051721/5a8525447f8b9a9f1b8c45f0/html5/thumbnails/12.jpg)
RAID-6
16
![Page 13: SSD Performance - Homepage Cees de · PDF fileResearch topic Maximizing Solid State Disk throughput. Official research question: How can SARA implement Solid State Disks in their setups](https://reader034.fdocuments.in/reader034/viewer/2022051721/5a8525447f8b9a9f1b8c45f0/html5/thumbnails/13.jpg)
File systems ext4
current Linux standardnilfs2
filesystem focused on recoverybtrfs - 'butter FS'
early version not fit for production use good scalabilitypossible future standard on Linux
zfscombining file system with disk arraygood scalability
logfs/jffs2 designed for raw flash memory
15
![Page 14: SSD Performance - Homepage Cees de · PDF fileResearch topic Maximizing Solid State Disk throughput. Official research question: How can SARA implement Solid State Disks in their setups](https://reader034.fdocuments.in/reader034/viewer/2022051721/5a8525447f8b9a9f1b8c45f0/html5/thumbnails/14.jpg)
ZFS: RAIDZ
ZFS version of RAID-5variable stripe size
corresponds to file system block sizeonly possible because of ZFS integrationprevents partial-stripe write errors
14
![Page 15: SSD Performance - Homepage Cees de · PDF fileResearch topic Maximizing Solid State Disk throughput. Official research question: How can SARA implement Solid State Disks in their setups](https://reader034.fdocuments.in/reader034/viewer/2022051721/5a8525447f8b9a9f1b8c45f0/html5/thumbnails/15.jpg)
Benchmark setup
IOZone.
Phoronix-test-suite used to automate testing.
Sequential reads on an 8GB file.
Every setup tested 3 times.
Results rounded to MB/s
13
![Page 16: SSD Performance - Homepage Cees de · PDF fileResearch topic Maximizing Solid State Disk throughput. Official research question: How can SARA implement Solid State Disks in their setups](https://reader034.fdocuments.in/reader034/viewer/2022051721/5a8525447f8b9a9f1b8c45f0/html5/thumbnails/16.jpg)
Testing file system blocksize
single SSDfile system ext4file system block size:
1KB - 208 MB/s4KB - 213 MB/s (default setting)
Conclusion: file system block size is not a significant factor at these high read speeds.
12
![Page 17: SSD Performance - Homepage Cees de · PDF fileResearch topic Maximizing Solid State Disk throughput. Official research question: How can SARA implement Solid State Disks in their setups](https://reader034.fdocuments.in/reader034/viewer/2022051721/5a8525447f8b9a9f1b8c45f0/html5/thumbnails/17.jpg)
Controller does not handle a non-default stripe size efficiently. The 16KB stripe size generates too many operations.
5 SSD Hardware RAID-0.
11
![Page 18: SSD Performance - Homepage Cees de · PDF fileResearch topic Maximizing Solid State Disk throughput. Official research question: How can SARA implement Solid State Disks in their setups](https://reader034.fdocuments.in/reader034/viewer/2022051721/5a8525447f8b9a9f1b8c45f0/html5/thumbnails/18.jpg)
SSDs no longer scale after 4 disksHDDs continue to scale after 5 disks 10
![Page 19: SSD Performance - Homepage Cees de · PDF fileResearch topic Maximizing Solid State Disk throughput. Official research question: How can SARA implement Solid State Disks in their setups](https://reader034.fdocuments.in/reader034/viewer/2022051721/5a8525447f8b9a9f1b8c45f0/html5/thumbnails/19.jpg)
File system has a noticeable influence.
9
![Page 20: SSD Performance - Homepage Cees de · PDF fileResearch topic Maximizing Solid State Disk throughput. Official research question: How can SARA implement Solid State Disks in their setups](https://reader034.fdocuments.in/reader034/viewer/2022051721/5a8525447f8b9a9f1b8c45f0/html5/thumbnails/20.jpg)
Dell controller handles SSDs better than Areca controller.Software RAID beats hardware RAID.
8
![Page 21: SSD Performance - Homepage Cees de · PDF fileResearch topic Maximizing Solid State Disk throughput. Official research question: How can SARA implement Solid State Disks in their setups](https://reader034.fdocuments.in/reader034/viewer/2022051721/5a8525447f8b9a9f1b8c45f0/html5/thumbnails/21.jpg)
Areca ARC 1680xi compatibility problems
Intel IOP 348 CPU. Intel refuses to release source code.Areca cannot fix this problem themselvesMany PCI-E SAS RAID cards use this CPU.Next Areca1880 series use a Marvell CPU
Not available yet.Conclusion:
Money well spent :) Wait for the ARC 1880 series or find a card with a different CPU.
7
![Page 22: SSD Performance - Homepage Cees de · PDF fileResearch topic Maximizing Solid State Disk throughput. Official research question: How can SARA implement Solid State Disks in their setups](https://reader034.fdocuments.in/reader034/viewer/2022051721/5a8525447f8b9a9f1b8c45f0/html5/thumbnails/22.jpg)
RAIDz is faster while handling more disks than software RAID-0.
6
![Page 23: SSD Performance - Homepage Cees de · PDF fileResearch topic Maximizing Solid State Disk throughput. Official research question: How can SARA implement Solid State Disks in their setups](https://reader034.fdocuments.in/reader034/viewer/2022051721/5a8525447f8b9a9f1b8c45f0/html5/thumbnails/23.jpg)
Proving the theory
Where is the bottleneck for Linux ?Btrfs ? PCI-E 2.0 8x ?RAID Controller ?
Connected 2 disks to Areca, 3 disks to PERC
Software RAID-0 over 5 disks, btrfs815 MB/s
5
![Page 24: SSD Performance - Homepage Cees de · PDF fileResearch topic Maximizing Solid State Disk throughput. Official research question: How can SARA implement Solid State Disks in their setups](https://reader034.fdocuments.in/reader034/viewer/2022051721/5a8525447f8b9a9f1b8c45f0/html5/thumbnails/24.jpg)
Predictions revisitedRead performance scaling linearly.Achieving higher read speeds with hardware RAID.RAID-0 / 1 arrays would be fastest on Linux. RAID-5 arrays would be a close second.Larger RAID stripe size would increase speed.Changing filesystem blocksize would have a significant effect.Filesystems having a noticeable effect.Predictions made during preliminary tests:
Perc i6 RAID controller would be a bottleneck.Areca ARC 1680xi-12 would answer our prayers (that is reach ~1100MB/s read performance).
4
![Page 25: SSD Performance - Homepage Cees de · PDF fileResearch topic Maximizing Solid State Disk throughput. Official research question: How can SARA implement Solid State Disks in their setups](https://reader034.fdocuments.in/reader034/viewer/2022051721/5a8525447f8b9a9f1b8c45f0/html5/thumbnails/25.jpg)
Conclusions
Btrfs seems a valid solution for the future for Linux OS. "Ext4 is simply a stop-gap, Btrfs is the way forward." - Theodore Ts'o, ext4 developer
RAID controller development is lagging behind.
ZFS is the fastest solution available today.
SSDs leave spinning disks behind. even when it comes to sequential reads.comparing them to consumer grade hardware.
(FC / SAS ) 3
![Page 26: SSD Performance - Homepage Cees de · PDF fileResearch topic Maximizing Solid State Disk throughput. Official research question: How can SARA implement Solid State Disks in their setups](https://reader034.fdocuments.in/reader034/viewer/2022051721/5a8525447f8b9a9f1b8c45f0/html5/thumbnails/26.jpg)
Further research
The PCI-E v2.0 x8 bus has a 2GB/s throughput limit.Test a setup with a different RAID controller and 8 SSDs.Test a setup with multiple RAID controllers and 16 - 32 SSDs.
PCI-E x16 RAID Controllers should hit the market in the near future.
Test if 16 SSDs reach the theoretical 4 GB/s throughput.
Test if a single system can stream enough data for an entire video wall.
2
![Page 27: SSD Performance - Homepage Cees de · PDF fileResearch topic Maximizing Solid State Disk throughput. Official research question: How can SARA implement Solid State Disks in their setups](https://reader034.fdocuments.in/reader034/viewer/2022051721/5a8525447f8b9a9f1b8c45f0/html5/thumbnails/27.jpg)
Thanks !
For their expert opinions: Freek Dijkstra Ronald van der PolMark van de Sanden
For lending us a RAID controller:www.WebConneXXion.com
1
![Page 28: SSD Performance - Homepage Cees de · PDF fileResearch topic Maximizing Solid State Disk throughput. Official research question: How can SARA implement Solid State Disks in their setups](https://reader034.fdocuments.in/reader034/viewer/2022051721/5a8525447f8b9a9f1b8c45f0/html5/thumbnails/28.jpg)
Questions?
0