DanSellars Manager,SoftwareDevelopment CANARIE€¦ · support research, education, and scientific...
Transcript of DanSellars Manager,SoftwareDevelopment CANARIE€¦ · support research, education, and scientific...
![Page 1: DanSellars Manager,SoftwareDevelopment CANARIE€¦ · support research, education, and scientific collaboration. >60+ HUBzero-based sites serving different communities •Interactive](https://reader033.fdocuments.in/reader033/viewer/2022042412/5f2c8157a21f4a0f294bc91a/html5/thumbnails/1.jpg)
Reusable Platform InvestigationDan Sellars | Manager, Software Development | CANARIE
27
![Page 2: DanSellars Manager,SoftwareDevelopment CANARIE€¦ · support research, education, and scientific collaboration. >60+ HUBzero-based sites serving different communities •Interactive](https://reader033.fdocuments.in/reader033/viewer/2022042412/5f2c8157a21f4a0f294bc91a/html5/thumbnails/2.jpg)
CANARIEisinvestigatingtheadoptionofareusableplatform:
>Whyarewegoinginthisdirection?
>Whocanbestbenefitfromthisplatform?
>Howareweapproachingtheinvestigation?
>Whichoptionsareweconsidering?
Introduction
28
ReusablePlatform
![Page 3: DanSellars Manager,SoftwareDevelopment CANARIE€¦ · support research, education, and scientific collaboration. >60+ HUBzero-based sites serving different communities •Interactive](https://reader033.fdocuments.in/reader033/viewer/2022042412/5f2c8157a21f4a0f294bc91a/html5/thumbnails/3.jpg)
OurmandateistosupportCanadianresearchersby:
> Fundingsoftwaredevelopment
> Providingsoftwaretoacceleratetimetodiscovery
> EnablingeffectiveuseofCanadianDigitalInfrastructure
> Promotingre-useofexistingsoftware— sowecanfundmore!
> SupportingthecommunityofCanadianresearchsoftwaredevelopers
ResearchSoftwareatCANARIE
29
![Page 4: DanSellars Manager,SoftwareDevelopment CANARIE€¦ · support research, education, and scientific collaboration. >60+ HUBzero-based sites serving different communities •Interactive](https://reader033.fdocuments.in/reader033/viewer/2022042412/5f2c8157a21f4a0f294bc91a/html5/thumbnails/4.jpg)
> IdentifyareusableplatformwhereCANARIEcandevelopexpertise
>Promoteitforre-useinthecommunity
>Determineifapermanentdevelopmentteamcouldassistresearchsoftwaredevelopers
>Usetheresultingplatformasaninteroperabilitytestbed
>Wewanttocomplement— notcompete
WhatisCANARIE’sgoal?
30
![Page 5: DanSellars Manager,SoftwareDevelopment CANARIE€¦ · support research, education, and scientific collaboration. >60+ HUBzero-based sites serving different communities •Interactive](https://reader033.fdocuments.in/reader033/viewer/2022042412/5f2c8157a21f4a0f294bc91a/html5/thumbnails/5.jpg)
>Wouldsuchanapproachbeacceptedbythecommunity?• Whatabout“NotInventedHere”?
>CanCANARIEaddenoughvalue?
>Canwesupportenoughteamstobeofvalue?
>Woulditbeadaptableenough?
PossiblePitfalls
31
![Page 6: DanSellars Manager,SoftwareDevelopment CANARIE€¦ · support research, education, and scientific collaboration. >60+ HUBzero-based sites serving different communities •Interactive](https://reader033.fdocuments.in/reader033/viewer/2022042412/5f2c8157a21f4a0f294bc91a/html5/thumbnails/6.jpg)
>Thosewhodonotyethaveaplatform
>Thosewhowanttofocusonresearch-facingsoftware• Avoidingframeworkdevelopment• Donotwanttorecreatewhathasbeendonebefore
>Non-software-expertsinneedofawayintodigitalinfrastructure• Theso-called,“long-tail”ofbigdataresearchers
Whocanbestbenefitfromthisplatform?
32
![Page 7: DanSellars Manager,SoftwareDevelopment CANARIE€¦ · support research, education, and scientific collaboration. >60+ HUBzero-based sites serving different communities •Interactive](https://reader033.fdocuments.in/reader033/viewer/2022042412/5f2c8157a21f4a0f294bc91a/html5/thumbnails/7.jpg)
Whatisanidealreusableplatform?
33
>First,whatisaplatform?• “asoftwaresystemthatsupportsmostorallofthefunctionalityaresearcherusesintheirworkflow”
>Areusableplatformwouldmeetthefollowingneeds:• Community-friendly• Computeintegrations• Datamanagementcapability• Extendable
DataManagement
Compute
Community
CANARIE
ResearchSpecific
Extensions
![Page 8: DanSellars Manager,SoftwareDevelopment CANARIE€¦ · support research, education, and scientific collaboration. >60+ HUBzero-based sites serving different communities •Interactive](https://reader033.fdocuments.in/reader033/viewer/2022042412/5f2c8157a21f4a0f294bc91a/html5/thumbnails/8.jpg)
>Wedonotexpectonesolutiontofitall• Multipleoptionscouldbeviable• Acombinationmayalsoprovideamorecompletesolution
>Researchsoftwareisanotonesizefitsall• Butwethinkagoodbasewouldbeofwidebenefit
>Reusableplatformsarenotforeverybody• Therewillalwaysbeaneedforcustomdevelopmenttobringnewtechnologiestothecommunity
Morethoughtsonreusableplatforms
34
![Page 9: DanSellars Manager,SoftwareDevelopment CANARIE€¦ · support research, education, and scientific collaboration. >60+ HUBzero-based sites serving different communities •Interactive](https://reader033.fdocuments.in/reader033/viewer/2022042412/5f2c8157a21f4a0f294bc91a/html5/thumbnails/9.jpg)
Aphasedapproachtotheinvestigation:
> Phase1:Highlevelreviewof~6options• Assessbyinspectionagainstdefinedcriteria• Selectashortlistforthenextphase
> Phase2:Closeevaluationof2-3platforms• Narrowdowntoonecandidateforthenextphase• Refinephase3goals
> Phase3:Deploymentofaprototype• Deployandprovidesampleextensionstothisplatform
Solicitfeedbackfromthecommunity
WhatapproachisCANARIEtaking?
35
![Page 10: DanSellars Manager,SoftwareDevelopment CANARIE€¦ · support research, education, and scientific collaboration. >60+ HUBzero-based sites serving different communities •Interactive](https://reader033.fdocuments.in/reader033/viewer/2022042412/5f2c8157a21f4a0f294bc91a/html5/thumbnails/10.jpg)
• Ease ofdeployment• Flexibility• Supportformultipleprojects• Easeofuse• Cost• Stability
Whatarethedefinedcriteria?
36
• Reliabilityandsupport• Researchdatamanagementsupport• Securityandprivacy• Sharingandcommunication• Suitability• Existingfeatureset
![Page 11: DanSellars Manager,SoftwareDevelopment CANARIE€¦ · support research, education, and scientific collaboration. >60+ HUBzero-based sites serving different communities •Interactive](https://reader033.fdocuments.in/reader033/viewer/2022042412/5f2c8157a21f4a0f294bc91a/html5/thumbnails/11.jpg)
JustconcludedPhase1• Startedbroadinvestigationfirst
Projectsthatweinvestigated• HubZero https://hubzero.org/• Open ScienceFrameworkhttps://osf.io• JupyterNotebook/Jupyter Hubhttp://jupyter.org/• CBRAIN http://mcin-cnim.ca/neuroimagingtechnologies/cbrain/• Alces Flighthttp://alces-flight.com/• Airavatahttp://airavata.apache.org• GenApphttp://genapp.rocks/
Wherearewenow?
37
![Page 12: DanSellars Manager,SoftwareDevelopment CANARIE€¦ · support research, education, and scientific collaboration. >60+ HUBzero-based sites serving different communities •Interactive](https://reader033.fdocuments.in/reader033/viewer/2022042412/5f2c8157a21f4a0f294bc91a/html5/thumbnails/12.jpg)
HUBzero:asoftwareplatformusedtocreatedynamicwebsitesthatsupportresearch,education,andscientificcollaboration.> 60+HUBzero-basedsitesservingdifferentcommunities• Interactivesimulationtoolsdeliveredthroughwebbrowser• Usergroupsforprivatecollaboration• Mechanismforuploadingandsharingresources• Ratingandcitations• Wikisandblogs• Usersupportarea• Statisticsaboutusersandusagepatterns
HUBzero
38
![Page 13: DanSellars Manager,SoftwareDevelopment CANARIE€¦ · support research, education, and scientific collaboration. >60+ HUBzero-based sites serving different communities •Interactive](https://reader033.fdocuments.in/reader033/viewer/2022042412/5f2c8157a21f4a0f294bc91a/html5/thumbnails/13.jpg)
OpenScienceFramework:providesfreeandopensourceprojectmanagementsupportforresearchersacrosstheentireresearchlifecycle.
• Structuredprojects• Controlledaccess• Enhancedworkflow• Trackprojectchanges• Viewprojectanalytics
>HostedintheUS
OpenScienceFramework
39
![Page 14: DanSellars Manager,SoftwareDevelopment CANARIE€¦ · support research, education, and scientific collaboration. >60+ HUBzero-based sites serving different communities •Interactive](https://reader033.fdocuments.in/reader033/viewer/2022042412/5f2c8157a21f4a0f294bc91a/html5/thumbnails/14.jpg)
JupyterNotebook:awebapplicationthatenablesuserstocreateandsharedocumentsthatincludelivecode,visualizations,equations,andtext.
> Jupyter Notebookcombinesthreecomponents:• Thewebapplication• Kernels• Notebookdocuments
>WeknowComputeCanadaareinvestigating• Sowillnotproceedwiththisasaprimaryoption
Jupyter Notebook
40
![Page 15: DanSellars Manager,SoftwareDevelopment CANARIE€¦ · support research, education, and scientific collaboration. >60+ HUBzero-based sites serving different communities •Interactive](https://reader033.fdocuments.in/reader033/viewer/2022042412/5f2c8157a21f4a0f294bc91a/html5/thumbnails/15.jpg)
CBRAIN:aweb-enabledplatformtoaccessandprocessdistributeddatawithhigh-performancecomputingcenters(HPCs).
> ConsistsoftwoRuby-on-RailsApplications:
• BrainPortal:aweb-basedgraphicaluserinterface• Userscanupload,tag,andsearchtheirfiles• Launchcompute-intensiveprocessingjobsonremoteHPC
• Bourreau: thebackendoftheCBRAINarchitecture– Managesthebackendtasks
CBRAIN
41
![Page 16: DanSellars Manager,SoftwareDevelopment CANARIE€¦ · support research, education, and scientific collaboration. >60+ HUBzero-based sites serving different communities •Interactive](https://reader033.fdocuments.in/reader033/viewer/2022042412/5f2c8157a21f4a0f294bc91a/html5/thumbnails/16.jpg)
AlcesFlight:afully-featured,scalableHighPerformanceComputing(HPC)environmentforresearchandscientificcomputing.
>Mainfeatures:• CanbeconfiguredwithAlces Gridware
• provides750+applicationsandlibraries• ChoiceofHPCjobscheduler• SSHandgraphical-desktopconnectivityforusers• Datamanagementforfile-basedstorageandobjectstorage
Alces Flight
42
![Page 17: DanSellars Manager,SoftwareDevelopment CANARIE€¦ · support research, education, and scientific collaboration. >60+ HUBzero-based sites serving different communities •Interactive](https://reader033.fdocuments.in/reader033/viewer/2022042412/5f2c8157a21f4a0f294bc91a/html5/thumbnails/17.jpg)
ApacheAiravata:asoftwareframeworkforsupportingexecutionandmanagementofcomputationalscientificapplicationsandworkflows.• Mainfocusisingridbasedsystems
> Severalcomponents:• Airavata API• Orchestrator• WorkflowInterpreter• ApplicationFactory(Gfac)• Registry• Messaging
Airavata
43
![Page 18: DanSellars Manager,SoftwareDevelopment CANARIE€¦ · support research, education, and scientific collaboration. >60+ HUBzero-based sites serving different communities •Interactive](https://reader033.fdocuments.in/reader033/viewer/2022042412/5f2c8157a21f4a0f294bc91a/html5/thumbnails/18.jpg)
GenApp:amodularframeworkformulti-scalesciencecomputations.
> BuildsGUI-basedandweb-basedapplicationsonacollectionofJSONwrappedmodules• Extendableandadaptabletonewtargetlanguagesandenvironments
>CanbeintegratedwithAiravata• Providesthecapabilitytoharnessdistributedcomputingresources
*NottobeconfusedwithGenAP!
GenApp*
44
![Page 19: DanSellars Manager,SoftwareDevelopment CANARIE€¦ · support research, education, and scientific collaboration. >60+ HUBzero-based sites serving different communities •Interactive](https://reader033.fdocuments.in/reader033/viewer/2022042412/5f2c8157a21f4a0f294bc91a/html5/thumbnails/19.jpg)
> JustabouttostartPhase2>Gaincommunityfeedback>RefineactivitiesforinclusioninPhase3e.g.• DeployatestinstanceontheDAIRCloud?• Willrepackagingmakeiteasiertoinstall?• Adding/integratingservicesofusetoallusers i.e.fromscience.canarie.ca?• Bettertrainingmaterials?• Wouldconsultingservicesbebeneficial?• PossibleintegrationwithResearchDataManagement(RDM)tools
>Offerasareusableplatformsupportedbyusforuseinafuturecall
NextSteps
45
![Page 20: DanSellars Manager,SoftwareDevelopment CANARIE€¦ · support research, education, and scientific collaboration. >60+ HUBzero-based sites serving different communities •Interactive](https://reader033.fdocuments.in/reader033/viewer/2022042412/5f2c8157a21f4a0f294bc91a/html5/thumbnails/20.jpg)
>Wouldthishavebeenahelpwhenyoustarteddevelopment?>Doyouhaveanyadvice?>WhatdoyouseeasthebestwaythatCANARIEcouldoffersupport?• Provideexpertiseonintegration?• Extendinginfrastructurefunctionality?• IntegratewithComputeCanadaservices?
>Wouldyoubeinterestedingettinginvolved?• Advisorycapacity?• Usecaseprovider?• Offeringresearchfacingsoftwareforintegration?
Whatcommunityinputwouldwelike?
46
![Page 21: DanSellars Manager,SoftwareDevelopment CANARIE€¦ · support research, education, and scientific collaboration. >60+ HUBzero-based sites serving different communities •Interactive](https://reader033.fdocuments.in/reader033/viewer/2022042412/5f2c8157a21f4a0f294bc91a/html5/thumbnails/21.jpg)
>TalkwiththeCANARIESoftwareteamduringtheevent> Email:[email protected]>Chooseitasadiscussiontopicfortomorrow>WewillaskagainintheclosingQ&Asession>Now,ifyouhavesome!Wehavesomequestions…
HowtoGiveFeedback
47
![Page 22: DanSellars Manager,SoftwareDevelopment CANARIE€¦ · support research, education, and scientific collaboration. >60+ HUBzero-based sites serving different communities •Interactive](https://reader033.fdocuments.in/reader033/viewer/2022042412/5f2c8157a21f4a0f294bc91a/html5/thumbnails/22.jpg)
Thank you!Questions?
48