SPEC SFS 2014 Performance ReportStill trying to figure out the best way to report SPEC sfs2014...
4
TWITTER.COM/RAYLUCCHESI | RAYONSTORAGE.COM | GREYBEARDSONSTORAGE.COM +1-720-221-7270 | SILVERTONCONSULTING.COM © 2014-2017 SILVERTON CONSULTING, INC. ALL RIGHTS RESERVED SPEC SFS®2014 Performance Report Silverton Consulting, Inc. StorInt™ Dispatch This Storage Intelligence (StorInt™) dispatch only covers SPECsfs2014 benchmark 1 results. There have been two new SPECsfs2014 submissions since our last report, both IBM Spectrum Scale with Cisco UCS and IBM FlashSystem 900 storage, one for the SWBUILD and the other for the VDA workload. SPEC SFS2014_swbuild (SWBUILD) results The SWBUILD workload simulates software release builds, essentially one build is a Unix “make” process against tens of thousands of source files and is a metadata intensive workload. Figure 1 shows the SWBUILD build ORT (overall response time) and minimum response time. Figure 1 SPEC SFS2014_swbuild ORT and minimum RT results Figure 1 shows the minimum and overall response time for the current four submissions. The latest IBM Spectrum Scale submission is all the way to the right. This is the first time we can ever recall seeing a minimum response time on any (block, file, email, HPC, etc.) storage system benchmark submission which showed a 0.0msec response time. Yes, it’s obviously a rounded metric but this says the average response time for that workload (@10% of maximum) was under 50 μsec. Which is impressive, especially since the first three recorded RT all were listed as 0.0msec response time and the workloads ranged from ~12K to 36K SWBUILD ops/sec. 1 All SPEC SFS2014 information is available at https://www.spec.org/sfs2014/ as of 23Mar2017
Transcript of SPEC SFS 2014 Performance ReportStill trying to figure out the best way to report SPEC sfs2014...
TWITTER.COM/RAYLUCCHESI|RAYONSTORAGE.COM|GREYBEARDSONSTORAGE.COM+1-720-221-7270|SILVERTONCONSULTING.COM
©2014-2017SILVERTONCONSULTING,INC.ALLRIGHTSRESERVED
SPEC SFS®2014 Performance Report SilvertonConsulting,Inc.StorInt™Dispatch ThisStorageIntelligence(StorInt™)dispatchonlycoversSPECsfs2014benchmark1results.TherehavebeentwonewSPECsfs2014submissionssinceourlastreport,bothIBMSpectrumScalewithCiscoUCSandIBMFlashSystem900storage,onefortheSWBUILDandtheotherfortheVDAworkload.
SPECSFS2014_swbuild(SWBUILD)resultsTheSWBUILDworkloadsimulatessoftwarereleasebuilds,essentiallyonebuildisaUnix“make”processagainsttensofthousandsofsourcefilesandisametadataintensiveworkload.Figure1showstheSWBUILDbuildORT(overallresponsetime)andminimumresponsetime.
Figure1SPECSFS2014_swbuildORTandminimumRTresults
Figure1showstheminimumandoverallresponsetimeforthecurrentfoursubmissions.ThelatestIBMSpectrumScalesubmissionisallthewaytotheright.Thisisthefirsttimewecaneverrecallseeingaminimumresponsetimeonany(block,file,email,HPC,etc.)storagesystembenchmarksubmissionwhichshoweda0.0msecresponsetime.Yes,it’sobviouslyaroundedmetricbutthissaystheaverageresponsetimeforthatworkload(@10%ofmaximum)wasunder50µsec.Whichisimpressive,especiallysincethefirstthreerecordedRTallwerelistedas0.0msecresponsetimeandtheworkloadsrangedfrom~12Kto36KSWBUILDops/sec.
1AllSPECSFS2014informationisavailableathttps://www.spec.org/sfs2014/asof23Mar2017
24March2017 SCISPEC®SFS2014PERFORMANCEREPORT PAGE2OF4
TWITTER.COM/RAYLUCCHESI|RAYONSTORAGE.COM|GREYBEARDSONSTORAGE.COM+1-720-221-7270|SILVERTONCONSULTING.COM
©2014-2016SILVERTONCONSULTING,INC.ALLRIGHTSRESERVED
ThenewIBMsolution’sORTat1.32msec,cameinat#2.ConsideringtheIBMSpectrumScalesolutionwasdoingabout90KSWBUILDops/secatthetime,seemsveryimpressive.TheSPECSFSreferencesolution,at#1,witha0.96msecORT,wasonlydoingabout9KSWBUILDops/sec,~1/10thasmuchastheIBMSpectrumScalesolution.InFigure2weshowtheSWBUILDops/sec.
Figure2SPECSFS2014_swbuildminimumandtotalops/secresults.
InFigure2,thenewIBMSpectrumScalesolution(again,attherightinFig2)achievedamaximumof~114.7KSWBUILDops/sec,whichcameinsecondbehindtheOracleZFSZS3-2AFAwhichachieved~116.0KSWBUILDops/sec.FortheSWBUILDworkloadsourcefilemetadataisexaminedtoseeifitneedstobecompiled,andthentheselectedsourcecodefilesarecompiled.Althoughwedon’tshowit,theIBMnewsolutionachievedamaximumof240builds.At114.7KSWBUILDops/sec,thismeansthere’s~478SWBUILDopsperSWBUILD.WearestillworkingonchartsfortheSPECsfs2014metrics.WemightprefertoseethesolutionRT’ssomewhereonthischart.Next,weturntotheSPECsfs2014VDAORTandMinimumRTinFigure3.Recallthat,whereasSWBUILDisessentiallymixedread-writeandmetadataintensive,SPECsfs2014VDAisvideodataacquisitionandisessentially,asequentialwriteintensiveworkload.
24March2017 SCISPEC®SFS2014PERFORMANCEREPORT PAGE3OF4
TWITTER.COM/RAYLUCCHESI|RAYONSTORAGE.COM|GREYBEARDSONSTORAGE.COM+1-720-221-7270|SILVERTONCONSULTING.COM
©2014-2016SILVERTONCONSULTING,INC.ALLRIGHTSRESERVED
Figure3SPECsfs2014_VDAORTandminimumRTresults
TheORTforthenewIBMSpectrumScalesolutionisournew#1at2.92msecandithadaminimumRTof0.8msec.TheORTiscalculatedasthemedianresponsetimeacrossall10workloaditerationsandwouldhavebeenatabout~6.7GB/secofVDAstreams.InFigure4weshowtheVDAstreamMB/sec.
Figure4SPECsfs2014_VDAstreamMB/secresults
InFigure4,thenewIBMSpectrumScalesolutionachievedamaximumof7.9GB/secofstreamthroughput.ForanAFA,executingawriteintensiveworkloadandperformingat~7.9GB/sec,tellsustheyaredoingsomethingdifferentthanthestandardflashstoragesystem.Thefact
24March2017 SCISPEC®SFS2014PERFORMANCEREPORT PAGE4OF4
TWITTER.COM/RAYLUCCHESI|RAYONSTORAGE.COM|GREYBEARDSONSTORAGE.COM+1-720-221-7270|SILVERTONCONSULTING.COM
©2014-2016SILVERTONCONSULTING,INC.ALLRIGHTSRESERVED
thattheIBMSpectrumScaleDeepFlash150andElasticStoragesolutionsalmostmatchedthislevelofperformance,saysthemagicisprobablyattheSpectrumScalelevel.
SignificanceIt’sgoodtoseesomenewSPECsfs2014submissions.It’dbegreatiftherewereevenmoreforthesetwoworkloadsdiscussedaboveandafewforVDIandDATABASEworkloads(whereweonlyhave1each,theSPECSFSreferencesolution).StilltryingtofigureoutthebestwaytoreportSPECsfs2014results.Atsomepoint,wewillsettledowntoamoretoptenlikeformat,whichweuseforotherperformancereports.Butinthemeantime,wemayexperimentwithafewvariantsoftheabovecharts.Anyideasonwhatothermetricsofinteresttoreport,pleasedoletusknowAnysuggestionsonhowtoimproveanyofourperformanceanalysesarealwayswelcomed.Additionally,ifyouareinterestedinmorefileperformancedetails(Top20SPECsfs2008results)andourNFSv3andCIFS/SMB(SPECsfs)ChampionsCharts™,pleaseconsiderpurchasingourrecentlyupdated(March2016)NASBuyingGuide,availableonSCI’swebsite(seeQRcodebelowleft).Thisreportwassentouttosubscribersaspartourfree,monthlyStorageIntelligencee-newsletter.Ifyouareinterestedinreceivingfuturestorageperformanceanalysesalongwithrecentproductannouncementsummaries,pleaseusetheQRcode(belowright)tosignupforyourowncopy.
Silverton Consulting, Inc., is a U.S.-based Storage, Strategy & Systems consulting firm offering products and services to the data storage community
NASBuyingGuideQRcodeNewslettersignupQRcode
