SPEC SFS 2014 Performance ReportStill trying to figure out the best way to report SPEC sfs2014...

Post on 14-Sep-2020

2 views 0 download

Transcript of SPEC SFS 2014 Performance ReportStill trying to figure out the best way to report SPEC sfs2014...

TWITTER.COM/RAYLUCCHESI|RAYONSTORAGE.COM|GREYBEARDSONSTORAGE.COM+1-720-221-7270|SILVERTONCONSULTING.COM

©2014-2017SILVERTONCONSULTING,INC.ALLRIGHTSRESERVED

SPEC SFS®2014 Performance Report SilvertonConsulting,Inc.StorInt™Dispatch ThisStorageIntelligence(StorInt™)dispatchonlycoversSPECsfs2014benchmark1results.TherehavebeentwonewSPECsfs2014submissionssinceourlastreport,bothIBMSpectrumScalewithCiscoUCSandIBMFlashSystem900storage,onefortheSWBUILDandtheotherfortheVDAworkload.

SPECSFS2014_swbuild(SWBUILD)resultsTheSWBUILDworkloadsimulatessoftwarereleasebuilds,essentiallyonebuildisaUnix“make”processagainsttensofthousandsofsourcefilesandisametadataintensiveworkload.Figure1showstheSWBUILDbuildORT(overallresponsetime)andminimumresponsetime.

Figure1SPECSFS2014_swbuildORTandminimumRTresults

Figure1showstheminimumandoverallresponsetimeforthecurrentfoursubmissions.ThelatestIBMSpectrumScalesubmissionisallthewaytotheright.Thisisthefirsttimewecaneverrecallseeingaminimumresponsetimeonany(block,file,email,HPC,etc.)storagesystembenchmarksubmissionwhichshoweda0.0msecresponsetime.Yes,it’sobviouslyaroundedmetricbutthissaystheaverageresponsetimeforthatworkload(@10%ofmaximum)wasunder50µsec.Whichisimpressive,especiallysincethefirstthreerecordedRTallwerelistedas0.0msecresponsetimeandtheworkloadsrangedfrom~12Kto36KSWBUILDops/sec.

1AllSPECSFS2014informationisavailableathttps://www.spec.org/sfs2014/asof23Mar2017

24March2017 SCISPEC®SFS2014PERFORMANCEREPORT PAGE2OF4

TWITTER.COM/RAYLUCCHESI|RAYONSTORAGE.COM|GREYBEARDSONSTORAGE.COM+1-720-221-7270|SILVERTONCONSULTING.COM

©2014-2016SILVERTONCONSULTING,INC.ALLRIGHTSRESERVED

ThenewIBMsolution’sORTat1.32msec,cameinat#2.ConsideringtheIBMSpectrumScalesolutionwasdoingabout90KSWBUILDops/secatthetime,seemsveryimpressive.TheSPECSFSreferencesolution,at#1,witha0.96msecORT,wasonlydoingabout9KSWBUILDops/sec,~1/10thasmuchastheIBMSpectrumScalesolution.InFigure2weshowtheSWBUILDops/sec.

Figure2SPECSFS2014_swbuildminimumandtotalops/secresults.

InFigure2,thenewIBMSpectrumScalesolution(again,attherightinFig2)achievedamaximumof~114.7KSWBUILDops/sec,whichcameinsecondbehindtheOracleZFSZS3-2AFAwhichachieved~116.0KSWBUILDops/sec.FortheSWBUILDworkloadsourcefilemetadataisexaminedtoseeifitneedstobecompiled,andthentheselectedsourcecodefilesarecompiled.Althoughwedon’tshowit,theIBMnewsolutionachievedamaximumof240builds.At114.7KSWBUILDops/sec,thismeansthere’s~478SWBUILDopsperSWBUILD.WearestillworkingonchartsfortheSPECsfs2014metrics.WemightprefertoseethesolutionRT’ssomewhereonthischart.Next,weturntotheSPECsfs2014VDAORTandMinimumRTinFigure3.Recallthat,whereasSWBUILDisessentiallymixedread-writeandmetadataintensive,SPECsfs2014VDAisvideodataacquisitionandisessentially,asequentialwriteintensiveworkload.

24March2017 SCISPEC®SFS2014PERFORMANCEREPORT PAGE3OF4

TWITTER.COM/RAYLUCCHESI|RAYONSTORAGE.COM|GREYBEARDSONSTORAGE.COM+1-720-221-7270|SILVERTONCONSULTING.COM

©2014-2016SILVERTONCONSULTING,INC.ALLRIGHTSRESERVED

Figure3SPECsfs2014_VDAORTandminimumRTresults

TheORTforthenewIBMSpectrumScalesolutionisournew#1at2.92msecandithadaminimumRTof0.8msec.TheORTiscalculatedasthemedianresponsetimeacrossall10workloaditerationsandwouldhavebeenatabout~6.7GB/secofVDAstreams.InFigure4weshowtheVDAstreamMB/sec.

Figure4SPECsfs2014_VDAstreamMB/secresults

InFigure4,thenewIBMSpectrumScalesolutionachievedamaximumof7.9GB/secofstreamthroughput.ForanAFA,executingawriteintensiveworkloadandperformingat~7.9GB/sec,tellsustheyaredoingsomethingdifferentthanthestandardflashstoragesystem.Thefact

24March2017 SCISPEC®SFS2014PERFORMANCEREPORT PAGE4OF4

TWITTER.COM/RAYLUCCHESI|RAYONSTORAGE.COM|GREYBEARDSONSTORAGE.COM+1-720-221-7270|SILVERTONCONSULTING.COM

©2014-2016SILVERTONCONSULTING,INC.ALLRIGHTSRESERVED

thattheIBMSpectrumScaleDeepFlash150andElasticStoragesolutionsalmostmatchedthislevelofperformance,saysthemagicisprobablyattheSpectrumScalelevel.

SignificanceIt’sgoodtoseesomenewSPECsfs2014submissions.It’dbegreatiftherewereevenmoreforthesetwoworkloadsdiscussedaboveandafewforVDIandDATABASEworkloads(whereweonlyhave1each,theSPECSFSreferencesolution).StilltryingtofigureoutthebestwaytoreportSPECsfs2014results.Atsomepoint,wewillsettledowntoamoretoptenlikeformat,whichweuseforotherperformancereports.Butinthemeantime,wemayexperimentwithafewvariantsoftheabovecharts.Anyideasonwhatothermetricsofinteresttoreport,pleasedoletusknowAnysuggestionsonhowtoimproveanyofourperformanceanalysesarealwayswelcomed.Additionally,ifyouareinterestedinmorefileperformancedetails(Top20SPECsfs2008results)andourNFSv3andCIFS/SMB(SPECsfs)ChampionsCharts™,pleaseconsiderpurchasingourrecentlyupdated(March2016)NASBuyingGuide,availableonSCI’swebsite(seeQRcodebelowleft).Thisreportwassentouttosubscribersaspartourfree,monthlyStorageIntelligencee-newsletter.Ifyouareinterestedinreceivingfuturestorageperformanceanalysesalongwithrecentproductannouncementsummaries,pleaseusetheQRcode(belowright)tosignupforyourowncopy.

Silverton Consulting, Inc., is a U.S.-based Storage, Strategy & Systems consulting firm offering products and services to the data storage community

NASBuyingGuideQRcodeNewslettersignupQRcode