Array of Things & Wagglestreamingsystems.org/Presentations/Pete Beckman.pdf• STREAMing Data and...
Transcript of Array of Things & Wagglestreamingsystems.org/Presentations/Pete Beckman.pdf• STREAMing Data and...
![Page 1: Array of Things & Wagglestreamingsystems.org/Presentations/Pete Beckman.pdf• STREAMing Data and Analy1cs. – O(10K) Computa1onally Powerful sensors à limi1ng network à Live HPC/Analysis](https://reader035.fdocuments.in/reader035/viewer/2022062610/611068fe3fabd2791a1de999/html5/thumbnails/1.jpg)
PeteBeckman:1
ArrayofThings&WaggleSensorsandCompu8ng
PeteBeckmanSeniorScien1st,ArgonneNa1onalLaboratoryCo-Director,Northwestern/ArgonneIns1tuteforScienceandEngineering(NAISE)SeniorFellow,UniversityofChicagoComputa1onIns1tute
![Page 2: Array of Things & Wagglestreamingsystems.org/Presentations/Pete Beckman.pdf• STREAMing Data and Analy1cs. – O(10K) Computa1onally Powerful sensors à limi1ng network à Live HPC/Analysis](https://reader035.fdocuments.in/reader035/viewer/2022062610/611068fe3fabd2791a1de999/html5/thumbnails/2.jpg)
PeteBeckman:2
The Centrality of Cities
“Ci1esandClimateChange:AnUrgentAgenda,”WorldBank,2010
![Page 3: Array of Things & Wagglestreamingsystems.org/Presentations/Pete Beckman.pdf• STREAMing Data and Analy1cs. – O(10K) Computa1onally Powerful sensors à limi1ng network à Live HPC/Analysis](https://reader035.fdocuments.in/reader035/viewer/2022062610/611068fe3fabd2791a1de999/html5/thumbnails/3.jpg)
PeteBeckman:3
Sensors,Instrumenta1on,MeasurementMost topics of urban inquiry require data with greater in temporal and spatial resolution.
• EnergyHowcanhyper-localweatherinforma1onimproveenergyefficiency?Reliability?
• ClimateandHeatIslandsWhatistheimpactoftheUrbanboundarylayeronregionalclimate?
• AirQuality,Transporta8on,andHealthWhatarethedynamicsofurbanairpollutantsandhowcantrafficflowbemodifiedtoimproveairquality?
• SocialSciencesHowmightdiversedatasourcesincludingambientsensorsprovidedatarelevanttopredic1veanaly1csw.r.t.disease,publicsafety/sen1ment?
MapofEPAmonitoringsitesfromEPA.
![Page 4: Array of Things & Wagglestreamingsystems.org/Presentations/Pete Beckman.pdf• STREAMing Data and Analy1cs. – O(10K) Computa1onally Powerful sensors à limi1ng network à Live HPC/Analysis](https://reader035.fdocuments.in/reader035/viewer/2022062610/611068fe3fabd2791a1de999/html5/thumbnails/4.jpg)
PeteBeckman:4
$3.57
![Page 5: Array of Things & Wagglestreamingsystems.org/Presentations/Pete Beckman.pdf• STREAMing Data and Analy1cs. – O(10K) Computa1onally Powerful sensors à limi1ng network à Live HPC/Analysis](https://reader035.fdocuments.in/reader035/viewer/2022062610/611068fe3fabd2791a1de999/html5/thumbnails/5.jpg)
PeteBeckman:5
Disrup8on:Intelligent,AJen8veSensors• Sensors:
– Explosionofnano&imagingtech• CPUs:
– Powerful,low-power,embeddedwithnetwork• In-situ/EdgeCompu8ng:
– Datainflight,can’tstoreitall– Sensors+CPUs=newprogrammingmodelforin-situcomputa-on
• OpenSource:Reusable,extensiblesobwarecommuni1es
CNMcarbonnanotubemethanesensor
Opportunity:Predic1veModels:SmartSensors+Supercomputers=predic1onsandanalysis
![Page 6: Array of Things & Wagglestreamingsystems.org/Presentations/Pete Beckman.pdf• STREAMing Data and Analy1cs. – O(10K) Computa1onally Powerful sensors à limi1ng network à Live HPC/Analysis](https://reader035.fdocuments.in/reader035/viewer/2022062610/611068fe3fabd2791a1de999/html5/thumbnails/6.jpg)
PeteBeckman:6
IntroducingWaggle(www.wa8.gl)
• PowerfulCPU,accuratesensors• In-SituAnalysisforadap1vefeaturedetec1on,aden1ve
control• “DeepSpaceProbe”designforresilience
– (safemode,mul1plekernels,heartbeats)• Scalableto100Ksofnodes;canbelinkedto
supercomputerpredic1ons• Scalable/hackableOpenSourceplahormadaptablefor
newscience&sensors– hostac1veeduca1oncommunity
![Page 7: Array of Things & Wagglestreamingsystems.org/Presentations/Pete Beckman.pdf• STREAMing Data and Analy1cs. – O(10K) Computa1onally Powerful sensors à limi1ng network à Live HPC/Analysis](https://reader035.fdocuments.in/reader035/viewer/2022062610/611068fe3fabd2791a1de999/html5/thumbnails/7.jpg)
PeteBeckman:7
![Page 8: Array of Things & Wagglestreamingsystems.org/Presentations/Pete Beckman.pdf• STREAMing Data and Analy1cs. – O(10K) Computa1onally Powerful sensors à limi1ng network à Live HPC/Analysis](https://reader035.fdocuments.in/reader035/viewer/2022062610/611068fe3fabd2791a1de999/html5/thumbnails/8.jpg)
![Page 9: Array of Things & Wagglestreamingsystems.org/Presentations/Pete Beckman.pdf• STREAMing Data and Analy1cs. – O(10K) Computa1onally Powerful sensors à limi1ng network à Live HPC/Analysis](https://reader035.fdocuments.in/reader035/viewer/2022062610/611068fe3fabd2791a1de999/html5/thumbnails/9.jpg)
PeteBeckman:9
Climate,EnvironmentalandLifeSciences(RobertJacob,ANL)Potosnak(DePaul);Niyogi(Purdue);Gilbert,Graham,Kotamarthi,(UC/ANL);Fernando(NotreDame)UrbanInfrastructureSystems(DanieWork,UIUC)Markoupolou(IaaC);Negri,Snyder(UC/ANL);Budlar,Peschel,Garcia(UIUC),Gonzales(MIT),Pancoast(SAIC),Guzowski,Rosner(UC/ANL),Claudel(UT);Liu(UMich),Chen(UW)Educa8on,Health,SocialandBehavioralSciences(KathleenCagney,UChicago)Diez(UCL/IaaC);Contractor(Northwestern);Epley,Gilliam,Lindau,Meltzer,Hampton-Marcel,Zarraonaindia(UC);Bellingham(Strathclyde)ComputerScienceandCyber-PhysicalSystems(MichaelPapka,UC/NIU/ANL)Derrible,Lin,Eriksson(UIC);AlokChoudhary(NU);Beckman,Sankaran,Chien(UC/ANL)
AScience-DrivenInstrument:TheArrayofThings
![Page 10: Array of Things & Wagglestreamingsystems.org/Presentations/Pete Beckman.pdf• STREAMing Data and Analy1cs. – O(10K) Computa1onally Powerful sensors à limi1ng network à Live HPC/Analysis](https://reader035.fdocuments.in/reader035/viewer/2022062610/611068fe3fabd2791a1de999/html5/thumbnails/10.jpg)
PeteBeckman:10
![Page 11: Array of Things & Wagglestreamingsystems.org/Presentations/Pete Beckman.pdf• STREAMing Data and Analy1cs. – O(10K) Computa1onally Powerful sensors à limi1ng network à Live HPC/Analysis](https://reader035.fdocuments.in/reader035/viewer/2022062610/611068fe3fabd2791a1de999/html5/thumbnails/11.jpg)
PeteBeckman:11
![Page 12: Array of Things & Wagglestreamingsystems.org/Presentations/Pete Beckman.pdf• STREAMing Data and Analy1cs. – O(10K) Computa1onally Powerful sensors à limi1ng network à Live HPC/Analysis](https://reader035.fdocuments.in/reader035/viewer/2022062610/611068fe3fabd2791a1de999/html5/thumbnails/12.jpg)
![Page 13: Array of Things & Wagglestreamingsystems.org/Presentations/Pete Beckman.pdf• STREAMing Data and Analy1cs. – O(10K) Computa1onally Powerful sensors à limi1ng network à Live HPC/Analysis](https://reader035.fdocuments.in/reader035/viewer/2022062610/611068fe3fabd2791a1de999/html5/thumbnails/13.jpg)
PeteBeckman:13
In-Situ/EdgeCompu1ngAnalysisandFeatureRecogni1on
![Page 14: Array of Things & Wagglestreamingsystems.org/Presentations/Pete Beckman.pdf• STREAMing Data and Analy1cs. – O(10K) Computa1onally Powerful sensors à limi1ng network à Live HPC/Analysis](https://reader035.fdocuments.in/reader035/viewer/2022062610/611068fe3fabd2791a1de999/html5/thumbnails/14.jpg)
Gensburg-MarkhamPrairie370acres,owned/managedbyNatureConservancyandNortheasternILUniv.RegisteredasNa1onalNaturalLandmark
Lead:AaronPackman@NUCris1naNegri
![Page 15: Array of Things & Wagglestreamingsystems.org/Presentations/Pete Beckman.pdf• STREAMing Data and Analy1cs. – O(10K) Computa1onally Powerful sensors à limi1ng network à Live HPC/Analysis](https://reader035.fdocuments.in/reader035/viewer/2022062610/611068fe3fabd2791a1de999/html5/thumbnails/15.jpg)
ChicagoBotanicGardenGreenRoofInstrumenta1on
Lead:Cris1naNegri
![Page 16: Array of Things & Wagglestreamingsystems.org/Presentations/Pete Beckman.pdf• STREAMing Data and Analy1cs. – O(10K) Computa1onally Powerful sensors à limi1ng network à Live HPC/Analysis](https://reader035.fdocuments.in/reader035/viewer/2022062610/611068fe3fabd2791a1de999/html5/thumbnails/16.jpg)
PeteBeckman:16
SensorsEdgeCompu1ng
Ini1alQA&Calibra1on
LiveStreamAnalysis
On-DemandHPC
O(10K)
![Page 17: Array of Things & Wagglestreamingsystems.org/Presentations/Pete Beckman.pdf• STREAMing Data and Analy1cs. – O(10K) Computa1onally Powerful sensors à limi1ng network à Live HPC/Analysis](https://reader035.fdocuments.in/reader035/viewer/2022062610/611068fe3fabd2791a1de999/html5/thumbnails/17.jpg)
PeteBeckman:17
STREAM:ResearchQues1ons• STREAMingDataandAnaly1cs.
– O(10K)Computa1onallyPowerfulsensorsàlimi1ngnetworkàLiveHPC/Analysis• Howdoweprogramin-situanalysis?
– Construc1ngmul1layerpipelinesformul1plefeatures– Buildingmachinelearningcorpus– Droppinginimprovedclassifica1onalgorithms?
• Howdoweleveragemachinelearningresearchtobuildclassifica1onlibraries?• Howdodesignlarge-scalecollec1vemanagement,trust,distributedcommandand
control?• Howwillhigh-performancestreaminganaly1csandsimula1onbeconnectedto
livedata?• CanweuseneuromorphicenginesorFPGAstoreducepowerwhilestreaming?
![Page 18: Array of Things & Wagglestreamingsystems.org/Presentations/Pete Beckman.pdf• STREAMing Data and Analy1cs. – O(10K) Computa1onally Powerful sensors à limi1ng network à Live HPC/Analysis](https://reader035.fdocuments.in/reader035/viewer/2022062610/611068fe3fabd2791a1de999/html5/thumbnails/18.jpg)
PeteBeckman:18
WaggleTeam&Collaborators
2014
2013
2015