Cloud Block Storage Benchmark Report
Transcript of Cloud Block Storage Benchmark Report
01CLOUD BLOCK STORAGE BENCHMARK REPORT
Cloud Block Storage Benchmark ReportAMAZON WEB SERVICES (AWS), DIGITALOCEAN, GOOGLE CLOUD PLATFORM (GCP), LINODE, MICROSOFT AZURE, VULTR
02CLOUD BLOCK STORAGE BENCHMARK REPORT
Table Of Contents
Introduction 03
Key Findings 04
Testing Methodology 05
4-CPU Dedicated VM Block Storage Performance Summary 06
PlanSpecifications&Pricing 06 Block Storage IOPS Analysis 08 ReadOverallPerformance 09 WriteOverallPerformance 10 ReadPrice-Performance 12 WritePrice-Performance 13 Database Performance 14 OLTPQueriesPerSecond 14 OLTPPrice-Performance 16
1-CPU Shared VM Block Storage Performance Summary 17 PlanSpecifications&Pricing 18 Block Storage IOPS Analysis 20 ReadOverallPerformance 21 WriteOverallPerformance 24 ReadPrice-Performance 28 WritePrice-Performance 30 Database Performance 32 OLTPQueriesPerSecond 32 OLTPPrice-Performance 34
Conclusion 35
AboutLinode 35 AboutCloudSpectator 35
Appendix 36
4-CPUDedicatedVMPerformance 37 1-CPUSharedVMPerformance 40
03CLOUD BLOCK STORAGE BENCHMARK REPORT
High-performanceandreliablecloud-basedstorageisnolongersecondarytotheperformancepowerneededtosupportvirtualmachines.Blockstorageisacrucialtooltoexpandstoragecapacitybeyondwhatisprovidedbyavirtualmachine(VM)andensureshighavailabilityforthedatathatkeepsapplicationsandbusinessesrunning.Blockstorageoperatesinvolumes,whereeachvolumeistheequivalentofaseparateharddrivethatcanbeattachedorremovedfromaVM.Thisprocessallowsdatabases,assets,andotherstoredfilestoremainindependentfromaserver,sothedataissafefromtheriskofserverdowntime,andyoucanattachyourdatatobackupsoranotherserver.Inaddition,keepingdataseparatefromyourapplication’sotheressentialunderlyinginfrastructurecanhelpimproveperformance.
Asdevelopersandorganizationsleveragemoredatainapplications,reliable,attachable,andhighly-performantstorageisessentialtoprovidingapositivecustomerexperiencewhilealsoadheringtoanapplication’snecessaryservicelevelagreement(SLA).
Ifhigh-performanceandreliableblockstorageiscriticalforyourapplication,notallcloudproviderswillmeetyourneeds.Inthisbenchmarkreport,CloudSpectatorevaluatesbothCPUperformancewithblockstoragevolumesattachedanddatabaseperformancetodeterminethefastestoverallperformanceandvalueperdollaramonglarge,well-knowncloudprovidersandpopularalternativecloudproviders.
Introduction
04CLOUD BLOCK STORAGE BENCHMARK REPORT
Key Findings
CloudSpectatorperformedbenchmarksonbothwell-known,largecloudprovidersthatdominatethecloudmarketandalternativecloudprovidersthatofferparityintermsofcorecloudproductsandglobalavailabilitywithcompetitivepricing.ThisreportisacomprehensiveblockstorageperformanceassessmentwithageneralCPUperformanceoverviewincludedasanappendix.Overall,thisreportfocusesoneachcloudprovider’sperformancescoresandrespectivevaluewhenstackedupagainsttheircompetitors.Forthisanalysis,CloudSpectatortestedtwoblockstoragevolumesizesforeachVMtogetadetailedlookatstorageperformance,andcomparedtwopopularLinodeSharedandDedicatedplanstocomparableofferingsfromotherproviders.
Thisanalysisincludesthefollowingproviders:Linode,AmazonWebServices(AWS),MicrosoftAzure(Azure),GoogleCloudPlatform(GCP),Vultr,andDigitalOcean.AlltestingwasperformedinaNorthAmericandatacenterforeachprovider.
Highlightsfromthisanalysisinclude:
· Linode’slatestNVMe-basedBlockStorageofferingdisplaysexcellentreadandwriteperformancecomparedtoallotherproviderstested.In performance per dollar,
Linode outperformed the next closest provider by 30% or more.
· Linode continues to offer high performance VM CPUs and storage at a lower
cost than most providers in this analysis.
· Linode’ssmall1-CPU VM offers the best CPU, storage, and database
performance in its class.
· Linode’s4-CPU dedicated VM and NVMe Block Storage significantly
outperforms dedicated or CPU optimized plans from other providers in
database performance tests,aswellasbeingatopperformerandleader inprice-performance.
Theremainderofthisreportpresentstheselectionandtestingmethodologyalongwithresultsofthebenchmarkingeffort.
05CLOUD BLOCK STORAGE BENCHMARK REPORT
Testing Methodology
AllVMswentthroughtheexactsamesetupprocess,whichinvolvedupdatingallpackagesandthenrebooting,followedbyentirediskpartitioning(ifneeded).EachVMwasleftaloneforonehouraftermountingeachstoragedevicetoallowtheoperatingsystemtoinitializethefilesystem(viaext4lazyinit).EachVMwastested“asis”withnokerneloroperatingsystemoptimizationsapplied.
Test Design Considerations InfrastructureperformancetestingwasconductedonspecificVMandstoragetypesforeachprovider.VMconfigurationscanyielddifferentresultsbasedonunderlyinginfrastructure,timeofday,numberoftenantsrunningotherworkloadsonthesamehardware,virtualizationtechnologyandsettings(e.g.sharedresources),andotherfactors.Furthermore,issuessuchasusercontentionorphysicalhardwaremalfunctionscanalsocausesuboptimalperformance.TheVMsandstoragevolumesselectedforthisengagementweregenerallyavailablewithspecifiedofferingsfromthevariousprovidersunlessotherwisenotedinthechartedresults.
Infrastructure Testing: CPU ComputeresultswereobtainedusingtheGeekBench5benchmarks.GeekBench5wasperformedwithstandard/defaulttestingoptions.
Infrastructure Testing: Block Storage StorageresultswereobtainedusingFIO(FlexibleI/Otester)using4KBblocksizeandatotaljob/threadcountthatmatcheseachVM’svCPUcount.Multiple300-seconditerationswereconductedtocompensateforthehighvariabilityoftenseenwhenstressingstoragevolumes.ResultsweregatheredandrepresentedinIOPs(input/outputoperationspersecond).TheresultsdisplayedinthisreportarederivedfromtheaverageIOPvaluerecordedduringeachtest.
Infrastructure Testing: Database DatabaseresultswereobtainedusingtheSysbenchOLTPread/writedatabasetest.Asingledatabasewithmorethan1millionrowswasgeneratedoneachVM.ThelatestversionofMySQLwasinstalledoneachserverandthemainconfigurationfilewasreplacedonallVMstoensuretheexactsameconfigurationsettingswereused.
06CLOUD BLOCK STORAGE BENCHMARK REPORT
Thefirstgroupconsistsof4-CPUVMsthathavededicatedorCPUoptimizedcores.The4-CPUgroupusesa500GBvolumeaswellasa1TBvolume.DedicatedCPUsarethebestchoiceforapplicationsthathavecriticalperformancerequirements,hightraffic,orotherwiseneedtoavoidpotentialnegativeimpactfrom“noisyneighbors”inasharedenvironment.Atthetimeofthisreport,someprovidersdidnothavecomparablededicatedCPUplans,andareomittedfromtheseresults.
VM Location CPUCount RAM Storage Storage
SizeVM
HourlyStorageHourly
TotalHourly
TotalMonthly
AWS C5.XLARGE 1TB
USEAST 4 8 BlockStorage 1TB $0.170 $0.137 $0.31 $224.10
AWS C5.XLARGE500GB
USEAST 4 8 BlockStorage 500GB $0.170 $0.068 $0.24 $174.10
AzureF4Sv2 1TB USEAST 4 8 BlockStorage 1TB $0.169 $0.168 $0.34 $246.25
AzureF4Sv2500GB USEAST 4 8 BlockStorage 500GB $0.169 $0.091 $0.26 $189.93
DigitalOceanCPUOptimized4-81TB
USEAST 4 8 BlockStorage 1TB $0.110 $0.137 $0.25 $180.00
DigitalOceanCPUOptimized4-8500GB
USEAST 4 8 BlockStorage 500GB $0.110 $0.068 $0.18 $130.00
GCPCustom4-81TB USEAST 4 8 BlockStorage
Balanced 1TB $0.190 $0.151 $0.34 $248.35
GCPCustom4-8500GB USEAST 4 8 BlockStorage
Balanced 500GB $0.190 $0.075 $0.26 $193.35
LinodeDedicated4-81TBNVMe
USEAST 4 8 BlockStorage 1TB $0.082 $0.137 $0.22 $160.00
LinodeDedicated4-8500GBNVMe
USEAST 4 8 BlockStorage 500GB $0.082 $0.068 $0.15 $110.00
4-CPU Dedicated VMs > Plan Specifications & Pricing
4-CPU Dedicated VM & Block Storage Plans
07CLOUD BLOCK STORAGE BENCHMARK REPORT
2000
4-CPU Dedicated VMs - Total Monthly Cost
50 250
GCPCustom4-8500GB
100
LinodeDedicated4-81TBNVMe
DigitalOceanCPUOptimized4-8500GB
DigitalOceanCPUOptimized4-81TB
AzureF4Sv2500GB
AWSC5.XLARGE1TB
GCPCustom4-81TB
AzureF4Sv21TB
AWSC5.XLARGE500GB
LinodeDedicated4-8500GBNVMe$110.00
150
$130.00
$160.00
$174.10
$180.00
$189.93
$193.35
$224.10
$248.35
$246.25
4-CPU Dedicated VMs > Plan Specifications & Pricing
$
08CLOUD BLOCK STORAGE BENCHMARK REPORT
4-CPU Dedicated > Block Storage IOPS Analysis > Read
0
Dedicated VMs (4 CPUs) & 500GB Block Storage - 4K Storage AVG READ IOPS
2,500
5,000
DigitalOceanCPUOptimized4-8500GB
AzureF4Sv2500GB
GCPCustom4-8500GB
LinodeDedicated4-8500GBNVMe
AWSC5.XLARGE500GB4,501
5,209
10,190
10,641
10,911
10,000 12,5007,500FIO4KBRandomReadIOPS (HigherisBetter)
Block Storage IOPS AnalysisForboththe500GBand1TBvolumesizes,Linode’sNVMeBlockStorageofferedaveryclosesecondfastestreadperformanceforbothvolumesizesafterGCP.DigitalOceanfinishedinthirdplace.There’sasignificantdifferenceinperformancebetweentheleadersandtheotherproviders.
10,0000
Dedicated VMs (4 CPUs) & 1TB Block Storage - 4K Storage AVG READ IOPS
2,500
12,5005,000
DigitalOceanCPUOptimized4-81TB
AzureF4Sv21TB
GCPCustom4-81TB
LinodeDedicated4-81TBNVMe
AWSC5.XLARGE1TB6,246
7,500
7,571
10,196
10,649
10,903
FIO4KBRandomReadIOPS(HigherisBetter)
09CLOUD BLOCK STORAGE BENCHMARK REPORT
0
Dedicated VMs (4 CPUs) & 500GB Block Storage - 4K Storage READ - StdDev
1,500500
LinodeDedicated4-8500GBNVMe
DigitalOceanCPUOptimized4-8500GB
AWSC5.XLARGE500GB
AzureF4Sv2500GB
GCPCustom4-8500GB8.60
1,000
59.98
1262.05
FIO 4KB Random Read IOPS Standard Deviation (Lower Means More Consistency)
36.22
34.79
4-CPU Dedicated > Block Storage IOPS Analysis > Read
GCPtendstooffermoreconsistentstorageperformancethantheotherproviders.However,theperformancevariationformostprovidersinthe500GBvolumegroupisratherlowexceptforAWS.
0
Dedicated VMs (4 CPUs) & 1TB Block Storage - 4K Storage READ - StdDev
6020
DigitalOceanCPUOptimized4-81TB
AWSC5.XLARGE1TB
AzureF4Sv21TB
LinodeDedicated4-81TBNVMe
GCPCustom4-81TB8.48
40
36.59
50.80
FIO 4KB Random Read IOPS Standard Deviation (Lower Means More Consistency)
16.75
36.34
Forthe1TBvolumesize,theresultsaremuchcloser.GCPstillshowedthemostconsistencyalongsidethe500GBvolumesize.DigitalOceanandLinodeendedupinthemiddleofthepackwithalmosttheexactsamescore.
10CLOUD BLOCK STORAGE BENCHMARK REPORT
0
Dedicated VMs (4 CPUs) & 500GB Block Storage - 4K Storage AVG Write IOPS
2,500
10,0005,000
DigitalOceanCPUOptimized4-8500GB
AzureF4Sv2500GB
LinodeDedicated4-8500GBNVMe
GCPCustom4-8500GB
AWSC5.XLARGE500GB2,992
7,500
3,318
8,648
9,172
9,332
FIO 4KB Random Write IOPS (Higher is Better)
4-CPU Dedicated > Block Storage IOPS Analysis > Write
Linodeleadsinrandomwriteperformance,beatingallotherprovidersinthe4-CPUVMgroupforbothvolumesizes,beatinglastplaceAWSbymorethantriple.GCPisaclosesecond,followedbyDigitalOcean.
10,0000
Dedicated VMs (4 CPUs) & 1TB Block Storage - 4K Storage AVG Write IOPS
2,500
12,5005,000
DigitalOceanCPUOptimized4-81TB
AzureF4Sv21TB
LinodeDedicated4-81TBNVMe
GCPCustom4-81TB
AWSC5.XLARGE1TB2,991
7,500
5,015
8,642
9,192
9,299
FIO4KBRandomWriteIOPS(HigherisBetter)
11CLOUD BLOCK STORAGE BENCHMARK REPORT
0
Dedicated VMs (4 CPUs) & 500GB Block Storage - 4K Storage Write IOPS - StdDev
200
800400
AzureF4Sv2500GB
GCPCustom4-8500GB
LinodeDedicated4-8500GBNVMe
DigitalOceanCPUOptimized4-8500GB
AWSC5.XLARGE500GB105.82
600
134.38
176.76
360.80
609.26
FIO 4KB Random Write IOPS Standard Deviation (Lower Means More Consistency)
4-CPU Dedicated > Block Storage IOPS Analysis > Write
AWS,GCP,andAzuretakethetopspotsforrandomwriteperformanceconsistency,whileLinodedisplayedmoreinconsistentperformance.
0
Dedicated VMs (4 CPUs) & 1TB Block Storage - 4K Storage Write - StdDev
600200
AzureF4Sv21TB
GCPCustom4-81TB
LinodeDedicated4-81TBNVMe
DigitalOceanCPUOptimized4-81TB
AWSC5.XLARGE1TB100.36
400
136.73
146.89
407.88
598.09
FIO 4KB Random Write IOPS Standard Deviation (Lower Means More Consistency)
12CLOUD BLOCK STORAGE BENCHMARK REPORT
0
Dedicated VMs (4 CPUs) & 500GB Block Storage - 4K Storage READ IOPS per Dollar
25 10050
GCPCustom4-8500GB
DigitalOceanCPUOptimized4-8500GB
AWSC5.XLARGE500GB
AzureF4Sv2500GB
LinodeDedicated4-8500GBNVMe96.74
75
78.39
56.43
27.43
25.85
AVG Read IOPS per Dollar Spent (Higher Means Better Value)
4-CPU Dedicated > Block Storage IOPS Analysis > Read
LinodehasasignificantleadintermsofrandomreadIOPSperdollarspent,beatingDigitalOceanbymorethan18IOPsperdollarinthe500GBvolumegroup.GCPlandsinthemiddleofthepack,andAzureandAWSshowverysimilarvalueperdollar.
0
Dedicated VMs (4 CPUs) & 1TB Block Storage - 4K Storage READ IOPS per Dollar
8020
GCPCustom4-81TB
DigitalOceanCPUOptimized4-81TB
AWSC5.XLARGE1TB
AzureF4Sv21TB
LinodeDedicated4-81TBNVMe66.56
40
56.64
43.90
30.75
27.87
AVG Read IOPS per Dollar Spent (Higher Means Better Value)60
$
$
13CLOUD BLOCK STORAGE BENCHMARK REPORT
0
Dedicated VMs (4 CPUs) & 500GB Block Storage - 4K Storage Write IOPS per Dollar
25 10050
GCPCustom4-8500GB
DigitalOceanCPUOptimized4-8500GB
AWSC5.XLARGE500GB
AzureF4Sv2500GB
LinodeDedicated4-8500GBNVMe84.84
75
66.52
47.44
17.47
17.19
Average Write IOPS Per Dollar Spent (Higher Means Better Value)
4-CPU Dedicated > Block Storage IOPS Analysis > Write
Resultsforrandomwriteperformanceperdollarspentaresimilar.LinodeistheleaderandbeatsDigitalOceanby18IOPSperdollar.
0
Dedicated VMs (4 CPUs) & 1TB Block Storage - 4K Storage Write IOPS per Dollar
6020
GCPCustom4-81TB
DigitalOceanCPUOptimized4-81TB
AWSC5.XLARGE1TB
AzureF4Sv21TB
LinodeDedicated4-81TBNVMe58.12
40
48.01
37.01
20.36
13.35
Average Write IOPS Per Dollar Spent (Higher Means Better Value)
$
$
14CLOUD BLOCK STORAGE BENCHMARK REPORT
0
Dedicated VMs (4 CPUs) - OLTP Average Queries Per Second
10,000
40,00020,000
DigitalOceanCPUOptimized4-81TB
GCPCustom4-8
LinodeDedicated4-8AMDEpyc7542
AWSC5.XLARGE
AzureF4Sv223,556
30,000
24,417
25,534
27,484
30,862
SysBench OLTP R/W 32 Thread Queries Per Second (Higher is Better)
4-CPU Dedicated > Database Performance > OLTP Queries Per Second
Database PerformanceLinodeoffersthebestproductiondatabaseperformanceintheDedicatedgroupwithasignificantleadoverAWS.
15CLOUD BLOCK STORAGE BENCHMARK REPORT
0
4-CPU VMs - OLTP Queries Per Second StdDev
500
2,0001,000
AWSC5.XLARGE
LinodeDedicated4-8AMDEpyc7542
AzureF4Sv2
DigitalOceanCPUOptimized4-81TB
GCPCustom4-8234
1,500
321
450
1,499
1,667
SysBench OLTP R/W 32 Thread Queries Per Second Standard Deviation (Lower Means More Consistency)
4-CPU Dedicated > Database Performance > OLTP Queries Per Second
GCP,Linode,andAWStakethetopspotsformostconsistentdatabaseperformance.DigitalOceanandAzureshowedsimilarresultsandarebehindtheleadersinthiscategory.
16CLOUD BLOCK STORAGE BENCHMARK REPORT
0
4-CPU VMs - OLTP Queries Per Second Per Dollar
50 200100
AWSC5.XLARGE
GCPCustom4-8
LinodeDedicated4-8AMDEpyc7542
DigitalOceanCPUOptimized4-81TB
AzureF4Sv295.66
150
98.32
122.64
141.86
192.89
SysBench OLTP R/W 32 Thread Queries Per Second Per Dollar (Higher is Better)
4-CPU Dedicated > Database Performance > OLTP Queries Price-Performance
ThesecondVMsizeinthisanalysisconsistsof1-CPUVMsrunninginasharedCPUenvironment.The1-CPUgroupusestwosmallerblockstoragevolumesizes,100GBand500GB.SharedVMsareidealforsmallerworkloadsincludingwebsitesorapplicationswithlowtraffic,testenvironments,andprovisioningmultiplemachinesforserviceslikesecuritypenetrationtesting.
$
17CLOUD BLOCK STORAGE BENCHMARK REPORT
1-CPU Shared VMs > Plan Specifications & Pricing
ThesecondVMsizeinthisanalysisconsistsof1-CPUVMsrunninginasharedCPUenvironment.The1-CPUgroupusestwosmallerblockstoragevolumesizes,100GBand500GB.SharedVMsareidealforsmallerworkloadsincludingwebsitesorapplicationswithlowtraffic,testenvironments,andprovisioningmultiplemachinesforserviceslikesecuritypenetrationtesting.
18CLOUD BLOCK STORAGE BENCHMARK REPORT
VM Location CPUCount RAM Storage Storage
SizeVM
HourlyStorageHourly
TotalHourly
TotalMonthly
AWST2.SMALL100GB USEAST 1 2 BlockStorage 100GB $0.023 $0.014 $0.04 $26.79
AWS T2.SMALL 500GB
USEAST 1 2 BlockStorage 500GB $0.023 $0.068 $0.09 $66.79
AzureB1MS100GB USEAST 1 2 BlockStorage 100GB $0.021 $0.025 $0.05 $33.10
AzureB1MS500GB USEAST 1 2 BlockStorage 500GB $0.021 $0.091 $0.11 $81.74
DigitalOceanPremiumAMD1-2100GB
USEAST 1 2 BlockStorage 100GB $0.016 $0.014 $0.03 $22.00
DigitalOceanPremiumAMD1-2500GB
USEAST 1 2 BlockStorage 500GB $0.016 $0.068 $0.08 $62.00
DigitalOceanPremiumIntel1-2100GB
USEAST 1 2 BlockStorage 100GB $0.016 $0.014 $0.03 $22.00
DigitalOceanPremiumIntel1-2500GB
USEAST 1 2 BlockStorage 500GB $0.016 $0.068 $0.08 $62.00
DigitalOceanRegularIntel1-2100GB
USEAST 1 2 BlockStorage 100GB $0.014 $0.014 $0.03 $20.00
DigitalOceanRegularIntel1-2500GB
USEAST 1 2 BlockStorage 500GB $0.014 $0.068 $0.08 $60.00
GCPCustom1-2100GB USEAST 1 2 BlockStorage
Balanced 100GB $0.047 $0.015 $0.06 $45.59
GCPCustom1-2500GB USEAST 1 2 BlockStorage
Balanced 500GB $0.047 $0.075 $0.12 $89.59
LinodeShared1-2100GBNVMe USEAST 1 2 BlockStorage 100GB $0.014 $0.014 $0.03 $20.00
LinodeShared1-2500GBNVMe
USEAST 1 2 BlockStorage 500GB $0.014 $0.068 $0.08 $60.00
VultrShared1-2100GB USEAST 1 2 BlockStorage 100GB $0.014 $0.014 $0.03 $20.00
VultrShared1-2500GB USEAST 1 2 BlockStorage 500GB $0.014 $0.068 $0.08 $60.00
VultrShared1-2100GBNVMe USEAST 1 2 NVMeBlock
Storage(Beta) 100GB $0.014 $0.014 $0.03 $20.00
VultrShared1-2500GBNVMe USEAST 1 2 NVMeBlock
Storage(Beta) 500GB $0.014 $0.068 $0.08 $60.00
1-CPU VM & Block Storage Plans
1-CPU Shared VMs > Plan Specifications & Pricing
19CLOUD BLOCK STORAGE BENCHMARK REPORT
0
AWST2.SMALL500GB
1-CPU Shared VMs - Total Monthly Cost
25
DigitalOceanPremiumAMD1-2500GB
AzureB1MS500GB
100
DigitalOceanPremiumIntel1-2500GB
GCPCustom1-2500GB
VultrShared1-2500GB
AzureB1MS100GB
50
VultrShared1-2100GB
LinodeShared1-2100GBNVMe
DigitalOceanPremiumIntel1-2100GB
AWST2.SMALL100GB
GCPCustom1-2100GB
LinodeShared1-2500GBNVMe
DigitalOceanRegularIntel1-2500GB
DigitalOceanPremiumAMD1-2100GB
DigitalOceanRegularIntel1-2100GB$20.00
75
$20.00
$20.00
$22.00
$22.00
$26.79
$33.10
$45.59
$60.00
$60.00
$60.00
$62.00
$62.00
$66.79
$81.74
$89.59
$
1-CPU Shared VMs > Plan Specifications & Pricing
20CLOUD BLOCK STORAGE BENCHMARK REPORT
10,0000
Shared VMs (1 CPU) & 100GB Block Storage - 4K Storage AVG READ IOPS
2,500
12,5005,000
DigitalOceanPremiumAMD1-2100GB
DigitalOceanPremiumIntel1-2100GB
AzureB1MS100GB
GCPCustom1-2100GB
LinodeShared1-2100GBNVMe10,646
7,500
8,130
8,110
8,053
7,594
FIO 4KB Random Read IOPS (Higher is Better)
VultrShared1-2100GB
VultrShared1-2100GBNVMe
DigitalOceanRegularIntel1-2100GB
AWST2.SMALL100GB
6,956
5,080
1,497
941
1-CPU Shared > Block Storage IOPS Analysis > Read
Block Storage IOPS AnalysisLinode’s latest NVMe Block Storage beats all other offerings by a significant amount in readperformance.Inthiscase,Linodeoffers30%betterrandomreadperformancethanDigitalOceanandover10xbetterreadperformancethanAWSEBSwhenusingthe100GBvolumesize.
21CLOUD BLOCK STORAGE BENCHMARK REPORT
10,0000
Shared VMs (1 CPU) & 500GB Block Storage - 4K Storage AVG READ IOPS
2,500
12,5005,000
DigitalOceanPremiumAMD1-2500GB
DigitalOceanRegularIntel1-2500GB
AWST2.SMALL500GB
GCPCustom1-2500GB
LinodeShared1-2500GBNVMe10,651
7,500
8,155
8,148
8,063
7,567
FIO 4KB Random Read IOPS (Higher is Better)
VultrShared1-2500GB
VultrShared1-2500GBNVMe
DigitalOceanPremiumIntel1-2500GB
AzureB1MS500GB
6,990
5,046
4,334
2,012
1-CPU Shared > Block Storage IOPS Analysis > Read
22CLOUD BLOCK STORAGE BENCHMARK REPORT
400
Shared VMs (1 CPU) & 100GB Block Storage - 4K Storage READ - Std Dev
10
5020
DigitalOceanRegularIntel1-2100GB
LinodeShared1-2100GBNVMe
VultrShared1-2100GBNVMe
DigitalOceanPremiumAMD1-2100GB
GCPCustom1-2100GB15.42
30
24.25
30.03
39.05
39.54
FIO 4KB Random Read IOPS Standard Deviation (Lower Means More Consistency)
DigitalOceanPremiumIntel1-2100GB
AzureB1MS100GB
AWST2.SMALL100GB
Lookingatrandomreadperformanceconsistency,GCPandLinodeofferthemostconsistentrandomreadperformanceforbothvolumesizegroups.Vultr’sbetaNVMeblockstorageshowedtheworstperformanceinthe100GBvolumesizegroup,butperformedsignificantlybetterinthe500GBvolumegroup.
41.29
45.04
49.79
1-CPU Shared > Block Storage IOPS Analysis > Read
23CLOUD BLOCK STORAGE BENCHMARK REPORT
1000
Shared VMs (1 CPU) & 500GB Block Storage - 4K Storage READ - Std Dev
25
12550
DigitalOceanRegularIntel1-2500GB
GCPCustom1-2500GB
VultrShared1-2500GB
DigitalOceanPremiumAMD1-2500GB
LinodeShared1-2500GBNVMe18.87
75
20.85
22.12
22.46
26.67
FIO 4KB Random Read IOPS Standard Deviation (Lower Means More Consistency)
AzureB1MS500GB
DigitalOceanPremiumIntel1-2500GB
VultrShared1-2500GBNVMe
41.72
43.28
114.28
1-CPU Shared > Block Storage IOPS Analysis > Read
24CLOUD BLOCK STORAGE BENCHMARK REPORT
0
Shared VMs (1 CPU) & 100GB Block Storage - 4K Storage AVG Write IOPS
2,500
10,0005,000
DigitalOceanPremiumAMD1-2100GB
DigitalOceanRegularIntel1-2100GB
AWST2.SMALL100GB
GCPCustom1-2100GB
LinodeShared1-2100GBNVMe9,305
7,500
5,667
5,660
5,634
4,665
FIO 4KB Random Write IOPS (Higher is Better)
AzureB1MS100GB
VultrShared1-2100GBNVMe
DigitalOceanPremiumIntel1-2100GB
VultrShared1-2100GB
3,525
2,228
2,048
440
Linodealsooffersthebestrandomwriteperformanceoutofallthe1-CPUconfigurationstested,offering64%fasterrandomwriteperformancethanDigitalOceanandover4xbetterperformancethanAWS’s100GBvolume.Inthisroundoftests,DigitalOcean’spremiumsharedDropletsperformalongsideitsregularIntel-basedoffering.
1-CPU Shared > Block Storage IOPS Analysis > Write
25CLOUD BLOCK STORAGE BENCHMARK REPORT
0
Shared VMs (1 CPU) & 500GB Block Storage - 4K Storage AVG Write IOPS
2,500
10,0005,000
DigitalOceanRegularIntel1-2500GB
DigitalOceanPremiumIntel1-2500GB
AzureB1MS500GB
GCPCustom1-2500GB
LinodeShared1-2500GBNVMe9,316
7,500
5,638
5,632
5,628
4,719
FIO 4KB Random Write IOPS (Higher is Better)
AWST2.SMALL500GB
VultrShared1-2500GBNVMe
DigitalOceanPremiumAMD1-2500GB
VultrShared1-2500GB
3,503
2,998
2,097
445
1-CPU Shared > Block Storage IOPS Analysis > Write
26CLOUD BLOCK STORAGE BENCHMARK REPORT
0
Shared VMs (1 CPU) & 100GB Block Storage - 4K Storage Write - Std Dev
500
1,5001,000
DigitalOceanRegularIntel1-2100GB
VultrShared1-2100GBNVMe
AWST2.SMALL100GB
DigitalOceanPremiumIntel1-2100GB
VultrShared1-2100GB
110.11
259.13
275.58
FIO 4KB Random Write IOPS Standard Deviation (Lower Means More Consistency)
LinodeShared1-2100GBNVMe
DigitalOceanPremiumAMD1-2100GB
GCPCustom1-2100GB
AzureB1MS100GB
277.14
1,344.89
1,364.25
VultrandGCPdidextremelywellwhenmeasuringconsistencyforwriteperformance.Linodefallstowardstheback,buthasdoubletheconsistencyofAWSandAzure.
1-CPU Shared > Block Storage IOPS Analysis > Write
93.33
108.46
584.10
27CLOUD BLOCK STORAGE BENCHMARK REPORT
0
Shared VMs (1 CPU) & 500GB Block Storage - 4K Storage Write - Std Dev
500
1,5001,000
VultrShared1-2500GBNVMe
GCPCustom1-2500GB
LinodeShared1-2500GBNVMe
DigitalOceanRegularIntel1-2500GB
VultrShared1-2500GB73.01
111.54
112.19
131.84
277.28
FIO 4KB Random Write IOPS Standard Deviation (Lower Means More Consistency)
DigitalOceanPremiumIntel1-2500GB
DigitalOceanPremiumAMD1-2500GB
AWST2.SMALL500GB
AzureB1MS500GB
283.08
287.70
474.18
1,340.93
1-CPU Shared > Block Storage IOPS Analysis > Write
28CLOUD BLOCK STORAGE BENCHMARK REPORT
0
Shared VMs (1 CPU) & 100GB Block Storage - 4K Storage READ IOPS Per Dollar
200 600400
DigitalOceanPremiumIntel1-2100GB
DigitalOceanRegularIntel1-2100GB
AzureB1MS100GB
VultrShared1-2100GB
LinodeShared1-2100GBNVMe532.30
405.52
379.70
369.56
366.05
AVG Read IOPS Per Dollar Spent (Higher Means Better Value)
GCPCustom1-2100GB
DigitalOceanPremiumAMD1-2100GB
VultrShared1-2100GBNVMe
AWST2.SMALL100GB
253.99
152.27
45.23
35.14
LookingattheReadIOPsperdollarspent, Linode offers the best random read value comparedtoallotherprovidersforboththe500GBand100GBvolumecategories,beating the
next closest options by more than 30%.AWS,GCP,andAzuretrailbehindwhenitcomestostoragevalue.
1-CPU Shared > Block Storage IOPS Analysis > Price-Performance > Read
$
29CLOUD BLOCK STORAGE BENCHMARK REPORT
0
Shared VMs (1 CPU) & 500GB Block Storage - 4K Storage Write READ IOPS Per Dollar
50 200150
DigitalOceanPremiumAMD1-2500GB
DigitalOceanRegularIntel1-2500GB
AWST2.SMALL500GB
VultrShared1-2500GB
LinodeShared1-2500GBNVMe177.52
135.91
131.42
130.04
126.12
AVG Read IOPS Per Dollar Spent (Higher Means Better Value)
GCPCustom1-2500GB
VultrShared1-2500GBNVMe
DigitalOceanPremiumIntel1-2500GB
AzureB1MS500GB
84.10
78.02
64.89
24.61
100
1-CPU Shared > Block Storage IOPS Analysis > Price-Performance > Read
$
30CLOUD BLOCK STORAGE BENCHMARK REPORT
0
Shared VMs (1 CPU) & 100GB Block Storage - 4K Storage Write IOPS Per Dollar
200 500
DigitalOceanPremiumAMD1-2100GB
DigitalOceanRegularIntel1-2100GB
AzureB1MS100GB
GCPCustom1-2100GB
LinodeShared1-2100GBNVMe465.27
283.36
257.27
256.09
233.24
AVG Write IOPS Per Dollar Spent (Higher Means Better Value)
AWST2.SMALL100GB
VultrShared1-2100GBNVMe
DigitalOceanPremiumIntel1-2100GB
VultrShared1-2100GB
77.32
76.44
67.32
21.98
100 400300
Linodeoffersthebestrandomwritevaluecomparedtoallotherproviderswithits100GBNVMeBlockStoragevolumeforWriteIOPsperdollarspent,andsignificantlybeatsthenextclosestoptionbymorethan64%.Thethreelarge,well-knowncloudproviderstrailbehindwhenitcomestostoragevalue.
1-CPU Shared > Block Storage IOPS Analysis > Price-Performance > Write
$
31CLOUD BLOCK STORAGE BENCHMARK REPORT
0
Shared VMs (1 CPU) & 500GB Block Storage - 4K Storage Write IOPS Per Dollar
50 200150
DigitalOceanPremiumAMD1-2500GB
DigitalOceanRegularIntel1-2500GB
AzureB1MS500GB
AWST2.SMALL500GB
LinodeShared1-2500GBNVMe155.26
93.79
90.93
90.84
78.66
AVG Write IOPS Per Dollar Spent (Higher Means Better Value)
GCPCustom1-2500GB
VultrShared1-2500GBNVMe
DigitalOceanPremiumIntel1-2500GB
VultrShared1-2500GB
44.89
39.10
25.65
100
7.42
1-CPU Shared > Block Storage IOPS Analysis > Price-Performance > Write
$
32CLOUD BLOCK STORAGE BENCHMARK REPORT
10,0000
Shared VMs (1 CPU) - OLTP Average Queries Per Second
2,500
12,5007,500
GCPCustom1-2
DigitalOceanRegularIntel1-2
VultrShared1-2NVMe
AWST2.SMALL
VultrShared1-22,234
5,250
5,445
5,561
5,686
SysBench OLTP R/W 32 Thread Queries Per Second (Higher is Better)
DigitalOceanPremiumAMD1-2
AzureB1MS
DigitalOceanPremiumIntel1-2
LinodeShared1-2AMDEpyc7542
6,668
7,789
8,869
5,000
11,544
Database Performance
Linode continues to lead when it comes to database performance with the highest queries
per second compared to all other 1-CPU VMs.LinodeoffersthebestCPUandstorageperformanceinthisclassofVMs,beatingthenextclosestprovider,Vultr,bymorethan30%.
1-CPU Shared > Database Performance > OLTP Queries Per Second
33CLOUD BLOCK STORAGE BENCHMARK REPORT
1,0000
Shared VMs (1 CPU) - OLTP Queries Per Second Std Dev
250
1,250750
LinodeShared1-2AMDEpyc7542
AWST2.SMALL
VultrShared1-2
DigitalOceanPremiumAMD1-2
GCPCustom1-253
69
87
131
155
SysBench OLTP R/W 32 Thread Queries Per Second Standard Deviation (Lower Means More Consistency)
VultrShared1-2NVMe
DigitalOceanRegularIntel1-2
AzureB1MS
229
511
1,183
500
Lookingatdatabaseperformanceconsistency,thethreelarge,well-knownprovidersofferthemostconsistentdatabaseperformancecomparedtotheothervendors..
1-CPU Shared > Database Performance > OLTP Queries Per Second
34CLOUD BLOCK STORAGE BENCHMARK REPORT
0
Shared VMs (1 CPU) - OLTP Queries Per Second Per Dollar
50 200150
DigitalOceanRegularIntel1-2
GCPCustom1-2
VultrShared1-2NVMe
AWST2.SMALL
VultrShared1-237.24
62.08
69.56
87.51
87.83
SysBench OLTP R/W 32 Thread Queries Per Second Per Dollar (Higher is Better)
DigitalOceanPremiumAMD1-2
DigitalOceanPremiumIntel1-2
AzureB1MS
LinodeShared1-2AMDEpyc7542
99.84
125.62
147.82
100
192.40
Lookingatdatabaseperformanceperdollarspent,Linode’ssharedplanoffersthemostqueriesperdollarspentduetoitsextremelylowcost.
1-CPU Shared > Database Performance > OLTP Queries Price-Performance
$
35CLOUD BLOCK STORAGE BENCHMARK REPORT
Conclusion
NVMe-basedblockstorageprovidedthebestprice-performanceratioacrossawiderangeofinfrastructureproviderswhencomparedtotraditionalSSD-basedblockstorage.Someofthesmaller,alternativeprovidersdeliverednearlydoubletheperformanceperdollarcomparedtothelarger,well-knownclouds,withLinodeandDigitalOceandelivering200%betterdatabaseperformanceperdollarspentthanAWS,Azure,andGCP.AmazonandMicrosoftblockstorageofferingsconsistentlyunderperformedallothersinthisbenchmarkcohort. About Linode Linodeacceleratesinnovationbymakingcloudcomputingsimple,accessible,andaffordabletoall.Linodeispartofaselectgroupofhyperscalecloudinfrastructureprovidersgivingindividualdevelopers,smallbusinessownersandenterpriseinnovationteamsanalternativetothecostly,complex,andcompetitivechoicestheycurrentlyhaveinthemarket.Foundedin2003,Linodehelpedpioneerthecloudcomputingindustryandistodaythelargestindependentcloudproviderintheworld.Morethanamilliondevelopersandbusinessesacross196countriesservedbyaglobalnetworkof11datacenterstrustLinodewiththeircloudcomputingbusiness. About Cloud Spectator CloudSpectatorisacloudbenchmarkingandconsultingfirmfocusedontheperformanceofIaaSandapplicationsintheCloud.
CloudSpectatorprovidesafullspectrumofcloudconsultingservices,includingstrategyandplanning,architectureandtechnologyselection,deployment,andimplementation,aswellasCloudmigrationservices.CloudSpectatoralsohelpscloudprovidersunderstandtheirmarketpositionandhelpsbusinessesmakeintelligentdecisionsrelatedtocloudstrategy,cloudreadiness,costreduction,andvendoranalysis.
36CLOUD BLOCK STORAGE BENCHMARK REPORT
Inadditiontothisreport’scomprehensiveblockstorageperformanceassessment,thefollowingappendicesprovidemoregeneralCPUperformancebasedon1-CPUand4-CPUVMsizes.TheblockstorageperformanceanalysisintheprimarybenchmarkreportisbrokendownintotwogroupsbasedontheVMs’CPUcounts.AllVMshavethesameamountofRAMineachgroupalongwithmatchingblockstoragevolumesizes.TheLinodeplansusedinthistesthavethelatestgenerationofAMD7542processors.TestingtwodifferentVMtypes(sharedvs.dedicated)andsizesallowsustodetermineifblockstorageperformancescaleswithCPUcountsand/orexclusiveaccesstoCPUresourcesbytestingthe500GBvolumeinbothgroups.Additionally,thisselectionallowsustoseewhichprovidersscaleblockstorageperformancebasedonthesizeprovisioned.Eachprovider’smostreadilyavailableblockstorageofferingwasincludedinallofthesetests,withtheexceptionofVultr.Toensurebenchmarkswereasfairaspossible,CloudSpectatortestedbothfirstgenerationblockstorageandNVMeblockstoragefromVultr,whichwasinbetaatthetimeofthisreport.
Appendix
37CLOUD BLOCK STORAGE BENCHMARK REPORT
0
4-CPU Dedicated VMs - CPU Performance
2,500500
AWSC5.XLARGE
DigitalOceanCPUOptimized4-8
LinodeDedicated4-8AMDEpyc7542
AzureF4Sv2
GCPCustom4-82,178
1,000
2,298
GeekBench5 Multi Core Score (Higher is Better)
2,222
2,226
1,500 2,000
2,445
Appendix
4-CPU Dedicated VM CPU PerformanceForthededicatedCPUperformance,theresultsareprettyclose,butLinodetakesthetopspot.
38CLOUD BLOCK STORAGE BENCHMARK REPORT
0
4-CPU Dedicated VMs - CPU Performance Std Dev
205
GCPCustom4-8
AWSC5.XLARGE
AzureF4Sv2
LinodeDedicated4-8AMDEpyc7542
DigitalOceanCPUOptimized4-82.84
10
11.68
GeekBench5 Multi Core Score Standard Deviation (Lower Means More Consistency)
6.18
9.76
15
16.06
MeasuringCPUperformanceconsistencyshowsthatDigitalOceanhadthemostconsistentresults.Linodecamefourthinthiscase,butisstillmuchclosertothetopthreethanAzure.
Appendix
39CLOUD BLOCK STORAGE BENCHMARK REPORT
0
4-CPU Dedicated VMs - CPU Performance Per Dollar
255
AWSC5.XLARGE
AzureF4Sv2
LinodeDedicated4-8AMDEpyc7542
DigitalOceanCPUOptimized4-8
GCPCustom4-811.27
10
17.09
Average GeekBench5 Score Divided By Monthly Price (Higher Means Better Value)
12.10
12.79
15 20
22.22
WhenlookingattheCPUperformanceperdollarspentinthe4-CPUVMgroup,Linode
continues to lead the pack by a substantial marginwithDigitalOceancominginsecondplace.Thethreehyperscaleprovidersshowverysimilarresultswithclosetodoublethecost intermsofCPUperformanceperdollarcomparedtoLinode.(PerformancePerDollaruses thepriceofthesmallestblockstoragedrive.)
Appendix
$
40CLOUD BLOCK STORAGE BENCHMARK REPORT
0
1-CPU Shared VMs - CPU Performance
250
1,000750
GCPCustom1-2
AWST2.SMALL
LinodeShared1-2AMDEpyc7542
DigitalOceanPremiumAMD1-2
DigitalOceanRegularIntel1-2589
694
702
708
744
SysBench OLTP R/W 32 Thread Queries Per Second Standard Deviation (Lower Means More Consistency)
VultrShared1-2
DigitalOceanPremiumIntel1-2
AzureB1MS
784
870
929
500
1-CPU Shared VM PerformanceTheresultsinthesectionbelowarefocusedonthe1-CPUVMswith100GBand500GBblockstoragevolumes.Linode’s1-CPU2GBRAMVMtakesthetopspotwhenitcomestoGeekBench5multi-coreCPUperformance,beating the next closest competitor (Vultr) by 7%.Linode’sshared2GBVMisusingoneofthelatestAMDEPYCCPUs,whichoffersincredibleperformancecomparedtobotholderAMDmodelsandIntelCPUsusedbyDigitalOcean’spremiumsharedplans.
Appendix
41CLOUD BLOCK STORAGE BENCHMARK REPORT
0
1-CPU VMs - CPU Performance
10
4030
LinodeShared1-2AMDEpyc7542
AWST2.SMALL
DigitalOceanRegularIntel1-2
AzureB1MS
GCPCustom1-24.47
5.76
8.00
10.99
11.41
GeekBench5 Scores Standard Deviation (Lower Means More Consistency)
DigitalOceanPremiumIntel1-2
DigitalOceanPremiumAMD1-2
VultrShared1-2
11.45
21.04
34.66
20
Lookingatperformanceconsistency,GCPtakesthetopspot,followedbyAWSandVultr.Linodefallsinthemiddleofthepack,butinterestingly,DigitalOceanfallsfarbehindwithboththeirRegularandPremiumIntelprocessors.TheirPremiumAMDplanissignificantlymorecompetitiveintermsofperformanceconsistencycomparedtootherproviders.
Appendix
42CLOUD BLOCK STORAGE BENCHMARK REPORT
400
1-CPU Shared VMs - CPU Performance Per Dollar
10 5030
DigitalOceanRegularIntel1-2
AzureB1MS
LinodeShared1-2AMDEpyc7542
DigitalOceanPremiumAMD1-2
GCPCustom1-215.51
21.15
25.87
29.84
34.01
Average GeekBench5 Score Divided By Monthly Price (Higher Means Better Value)
VultrShared1-2
DigitalOceanPremiumIntel1-2
AWST2.SMALL
35.56
43.35
46.58
20
Again,LinodetakesthetopspotforCPUperformanceperdollarspentforthe1-CPUgroup,providingtripletheCPUperformancevalueofGCP.
Appendix
$