Node Manager and Services Progress Update and Future Roadmap · Node Manager and Services Working...
Transcript of Node Manager and Services Progress Update and Future Roadmap · Node Manager and Services Working...
![Page 1: Node Manager and Services Progress Update and Future Roadmap · Node Manager and Services Working Team: Progress Update and Future Roadmap Sasha Ames, Co-Lead (LLNL) Tobias Weigel,](https://reader030.fdocuments.in/reader030/viewer/2022040922/5e9bd5df4173cb1b83218734/html5/thumbnails/1.jpg)
NodeManagerandServicesWorkingTeam:ProgressUpdateandFuture
RoadmapSashaAmes,Co-Lead(LLNL)
TobiasWeigel,Co-Lead,KatharinaBerger(DKRZ),MikeBerkley(UVic/CCCma),AlessandraNuzzo,Maria
Mirto,PaulaNassisi,(CMCC),LucaC.(JPL)
ThisworkwasperformedundertheauspicesoftheU.S.DepartmentofEnergybyLawrenceLivermoreNationalLaboratoryunderContractDE-AC52-07NA27344
LLNL-PRES-742742
![Page 2: Node Manager and Services Progress Update and Future Roadmap · Node Manager and Services Working Team: Progress Update and Future Roadmap Sasha Ames, Co-Lead (LLNL) Tobias Weigel,](https://reader030.fdocuments.in/reader030/viewer/2022040922/5e9bd5df4173cb1b83218734/html5/thumbnails/2.jpg)
OverviewofNodeManagerandUserNotification
• NodeManager:§ Componenttohandleinternodecommunicationofconfigurationinfo§ Usesatwo-tierdesign:1sttierP2P;2nd tierclients§ Maintainthenode-componentregistry:registration.xml
DataNode(TrackingService)
FeedbackService
(2)DatasetUpdates
(1)UserSubscribesorDownloads
UpdateInfo(3)
(4)Notification(email)
• UserNotification:goaltoprovideupdatestodatachangesinthefederation
1
23
5 4
SuperNodes
Member Nodes
7
Standby Nodes
6
![Page 3: Node Manager and Services Progress Update and Future Roadmap · Node Manager and Services Working Team: Progress Update and Future Roadmap Sasha Ames, Co-Lead (LLNL) Tobias Weigel,](https://reader030.fdocuments.in/reader030/viewer/2022040922/5e9bd5df4173cb1b83218734/html5/thumbnails/3.jpg)
NodeManagerAccomplishments2017
• NodeManager1.0integratedintoesg-node(installer)§ Deployedtoproductioninv2.5.9§ Severalupgradedsitesregistered§ Recaptureofupgradedsitesinprogress
• CredentialsshareAPI- requiressignedpubliccertforverificationofsignedrequest§ testedbetweenLLNLandGFDL
• Teamreformulationandkickoffdiscussions
![Page 4: Node Manager and Services Progress Update and Future Roadmap · Node Manager and Services Working Team: Progress Update and Future Roadmap Sasha Ames, Co-Lead (LLNL) Tobias Weigel,](https://reader030.fdocuments.in/reader030/viewer/2022040922/5e9bd5df4173cb1b83218734/html5/thumbnails/4.jpg)
NodeManagerReleaseReportesg.lasg.ac.cn CoreyHaim v2.5.17-master-releaseaims3.llnl.gov CoreyHaim v2.5.17-master-release
esgf-node.jpl.nasa.gov Helheim v2.5.13-master-release
esgf-node.llnl.gov CoreyHaim v2.5.17-master-releaseesgf1.dkrz.de Helheim v2.5.13-master-release
esgf-data.jpl.nasa.gov Vanaheim v2.5.14-master-releaseesgf-node.cmcc.it Service Error(500)
esgf-data2.ceda.ac.uk TIMEOUTesg-dn1.ru.ac.th TIMEOUT
esgfcog.cccma.ec.gc.ca Alfheim v2.5.16-master-releaseesgf.nccs.nasa.gov Samhain v2.5.17-master-releaseesgf-data.dkrz.de Helheim v2.5.13-master-releaseesgf.anl.gov Midgard v2.5.9-master-releaseesgf2.dkrz.de Helheim v2.5.13-master-release
Allothernodes2.5notinstalled…
![Page 5: Node Manager and Services Progress Update and Future Roadmap · Node Manager and Services Working Team: Progress Update and Future Roadmap Sasha Ames, Co-Lead (LLNL) Tobias Weigel,](https://reader030.fdocuments.in/reader030/viewer/2022040922/5e9bd5df4173cb1b83218734/html5/thumbnails/5.jpg)
UserNotificationDevelopment2017
• Feedbackserviceprototype§ collectsandcollatesindividualuserdigests§ Basedonmessagesfromtrackingserver
• Trackingserviceissubscriptionbased§ PeriodicprojectquerysnapshotstoSOLR§ Takesdeltavsprevioussnapshot
oDatasetscategoriesforupdates:new,retracted,updated(version)
![Page 6: Node Manager and Services Progress Update and Future Roadmap · Node Manager and Services Working Team: Progress Update and Future Roadmap Sasha Ames, Co-Lead (LLNL) Tobias Weigel,](https://reader030.fdocuments.in/reader030/viewer/2022040922/5e9bd5df4173cb1b83218734/html5/thumbnails/6.jpg)
Roadmapfor2018
• NodeManager§ Streamlineconfig deployment§ Authenticatedcommunications– usedsigningprotocollikethecredentialsshareAPI§ Future:replacewiththirdpartycommunicationprotocollibrary
• Usernotification§ Completesubscriptionservice§ Testingphases§ Deploytoproduction
• Beyond:considerdownloadtracking§ willuseridentitybecapturedsomehowforunrestrictedCMIP6data?§ Clientside:alternativestoemailnotifications,
o browserplug-into“Notificationcenters”o smartphonenotifications(SMSorother)?
![Page 7: Node Manager and Services Progress Update and Future Roadmap · Node Manager and Services Working Team: Progress Update and Future Roadmap Sasha Ames, Co-Lead (LLNL) Tobias Weigel,](https://reader030.fdocuments.in/reader030/viewer/2022040922/5e9bd5df4173cb1b83218734/html5/thumbnails/7.jpg)
Foodforthought…
• Bigquestion– doweneedanodemanager– whatisitsusefulpurpose?Doesanyonereallyusetheregistry?Itsis”kindofnicetohave”butthatmaynotjustifytheeffort
• Nodemapcouldbeuseful,butotherservicesexistformonitoring.TheseareoverarchingarchitecturalquestionsforESGF
• OTOH– best,mostaccuratepictureofstateoffederationviaregistryandnodemap
• Howelsecouldweusethenodemanager?Otherconfigurationtobedistributed?
• Notifications– helpfulordistracting?Ifthelatterthenworththeeffort?