Regional Data DMZ in Support of Distributed Applications ......Regional Data DMZ • High-bandwidth...
Transcript of Regional Data DMZ in Support of Distributed Applications ......Regional Data DMZ • High-bandwidth...
![Page 1: Regional Data DMZ in Support of Distributed Applications ......Regional Data DMZ • High-bandwidth network connectivity between the regional networks, PennREN (KINBER) and NJEdgeas](https://reader030.fdocuments.in/reader030/viewer/2022041118/5f2fae0629e7b602e812dc31/html5/thumbnails/1.jpg)
5775AllentownBlvd.Suite101Harrisburg,PA17112
Internet2 Technology ExchangeOctober 17, 2017
GwendolynHuntoon- KINBERKennethMiller- PennStateJimStankiewicz - NJEDge.NetBarrvonOehsen - Rutgers
Regional Data DMZ in Support of Distributed Applications in Pennsylvania and New Jersey
![Page 2: Regional Data DMZ in Support of Distributed Applications ......Regional Data DMZ • High-bandwidth network connectivity between the regional networks, PennREN (KINBER) and NJEdgeas](https://reader030.fdocuments.in/reader030/viewer/2022041118/5f2fae0629e7b602e812dc31/html5/thumbnails/2.jpg)
Agenda• Motivation• CampusNetwork• RegionalNetwork• CurrentStatus• NextSteps
![Page 3: Regional Data DMZ in Support of Distributed Applications ......Regional Data DMZ • High-bandwidth network connectivity between the regional networks, PennREN (KINBER) and NJEdgeas](https://reader030.fdocuments.in/reader030/viewer/2022041118/5f2fae0629e7b602e812dc31/html5/thumbnails/3.jpg)
RegionalDataDMZ• High-bandwidthnetworkconnectivitybetweentheregionalnetworks,PennREN(KINBER)andNJEdge aswellasindividualorganizationslocatedinPennsylvaniaandNewJersey.
• Long-termgoalofconnectingthisregionalinfrastructuretothebroadercommunityviaregionalandnationalnetworkconnections,includingInternet2.
• InitialapplicationtoutilizethisinfrastructureistheVirtualDataCollaboratory (VDC).– NSFfundedDIBBSprojectwiththegoalofestablishingstateoftheartdata-intensivecomputingsolutions,storage,andnetworking,federatedwithaninnovativedataserviceslayer
![Page 4: Regional Data DMZ in Support of Distributed Applications ......Regional Data DMZ • High-bandwidth network connectivity between the regional networks, PennREN (KINBER) and NJEdgeas](https://reader030.fdocuments.in/reader030/viewer/2022041118/5f2fae0629e7b602e812dc31/html5/thumbnails/4.jpg)
DataDMZTopologyRutgers UniversityPennsylvania State University
NJEDge
KINBER
©2017 Rutgers, The State University of New Jersey All Rights Reserved
10G 10G
10G
100G
100G
10GHill CenterPiscataway
VDC Data Hub
NJEdgePhiladelphia
VDS Data Hub
10G
10G
Halsey StNewark
RutgersCampusNetwork
PennStateCampusNetwork
200G
200G
CoreRouter
PennStateScience
DMZ
200G
VDC Data DMZ Topology
BorderRouter
10G
Broad StPhiladelphia
Campus Edge RouterPhiladelphia
PennRENMPLS
Network
NJEdgeNewark
10G
![Page 5: Regional Data DMZ in Support of Distributed Applications ......Regional Data DMZ • High-bandwidth network connectivity between the regional networks, PennREN (KINBER) and NJEdgeas](https://reader030.fdocuments.in/reader030/viewer/2022041118/5f2fae0629e7b602e812dc31/html5/thumbnails/5.jpg)
VDCApplication• CIF21DIBBs:EI:VirtualDataCollaboratory:ARegional
CyberinfrastructureforCollaborativeDataIntensiveScience(NSFAward1640834)- PI:ManishParashar;Co-PI:GraceAgnew,JamesvonOehsen,
Jenni-LouiseEvans,Vasant Honavar- CollaborationbetweenRutgers,PennState,NJEdge andKINBER- LeveragesconceptsfromthePRP
• Applications– DecipheringSequenceandStructuralCorrelatesofProtein
NucleicAcidInteractions(H.Berman,RU&V.Honavar,PSU)– High-VolumeCityDataSharingandProcessingforSmart,
Resilient,andSustainableCities(J.Gong,RU;Z.Zhu,CUNY;X.Liang,UniversityofPittsburgh;M.Balduccini,DrexelUniversity)
– OceanObservatoriesInitiative(I.Rodero,RU,M.Parashar,RU)
![Page 6: Regional Data DMZ in Support of Distributed Applications ......Regional Data DMZ • High-bandwidth network connectivity between the regional networks, PennREN (KINBER) and NJEdgeas](https://reader030.fdocuments.in/reader030/viewer/2022041118/5f2fae0629e7b602e812dc31/html5/thumbnails/6.jpg)
• VDCHub:Scalabledata-intensivecomputingplatform
• Dataservicestosupportresearchworkflows
• RegionalsciencedataDMZnetwork
Network Service Layer
Data Service Layercataloging, curating, querying, discovery, federation, etc
Science & Education Use Cases
Data DMZ
PA VDC Data Hub NJ VDC Data Hub
KINBER NJEDGE
National Infr. National Infr.
PA VDC Spokes: Penn State, Univ. of Pittsburgh, Drexel, etc.
NJ VDC Spokes: Rutgers University (New Brunswick, Newark, Camden), etc.
VDCArchitecture
![Page 7: Regional Data DMZ in Support of Distributed Applications ......Regional Data DMZ • High-bandwidth network connectivity between the regional networks, PennREN (KINBER) and NJEdgeas](https://reader030.fdocuments.in/reader030/viewer/2022041118/5f2fae0629e7b602e812dc31/html5/thumbnails/7.jpg)
VDCDataDMZ• Supportsdataimport/exportserviceswithnecessaryqualitiesofservicestoenableefficientandtransparentaccesstodataandcomputeregardlessofascientist’slocation.
• Components– DataDMZbackboneconsistsofdirect10GEconnectionsbetweenRutgers,NJEdge andKINBER
– DataHubsconnectdirectlytotheDataDMZorthroughtheirregionalnetwork
– DataSpokesconnectthroughtheregionalnetwork
– FIONAsdeployedatHubandSpokesites
![Page 8: Regional Data DMZ in Support of Distributed Applications ......Regional Data DMZ • High-bandwidth network connectivity between the regional networks, PennREN (KINBER) and NJEdgeas](https://reader030.fdocuments.in/reader030/viewer/2022041118/5f2fae0629e7b602e812dc31/html5/thumbnails/8.jpg)
VDCProjectComponents• VDCHubs– systemsites– RutgersUniversity– MainCampus– PennState– MainCampus
• VDCSpokes– collaborationsites– NewJersey– RutgersCamden,RutgersNewark– Pennsylvania– Drexel,Temple,UniversityofPittsburgh
– NewYork– CityUniversityofNewYork• DataDMZBackbone– NJEdge andPennREN(KINBER)
![Page 9: Regional Data DMZ in Support of Distributed Applications ......Regional Data DMZ • High-bandwidth network connectivity between the regional networks, PennREN (KINBER) and NJEdgeas](https://reader030.fdocuments.in/reader030/viewer/2022041118/5f2fae0629e7b602e812dc31/html5/thumbnails/9.jpg)
Rutgers/NewJerseyApplications• BrainResearch• MedicalImaging• Genomics• Genetics• Bioinformatics• ObservationalAstronomy• ExperimentalPhysics• ClimateModeling• NetworkResearchCommunitiestofullyutilizeCICNet
![Page 10: Regional Data DMZ in Support of Distributed Applications ......Regional Data DMZ • High-bandwidth network connectivity between the regional networks, PennREN (KINBER) and NJEdgeas](https://reader030.fdocuments.in/reader030/viewer/2022041118/5f2fae0629e7b602e812dc31/html5/thumbnails/10.jpg)
RutgersDMZ– LocalResearchPlatform
RequiresACItobeinplace– fast/low-latencynetworks,ScienceDMZs,SDN,DataTransferNodes(FIONAs),perfSONAR,XDMod,AdvancedComputing,andStorage.Buildingblockforregion,national…
![Page 11: Regional Data DMZ in Support of Distributed Applications ......Regional Data DMZ • High-bandwidth network connectivity between the regional networks, PennREN (KINBER) and NJEdgeas](https://reader030.fdocuments.in/reader030/viewer/2022041118/5f2fae0629e7b602e812dc31/html5/thumbnails/11.jpg)
OneRutgersResearchPlatform• RequiresACItobeinplace– fast/low-latencynetworks,ScienceDMZs,
SDN,perfSONAR,AdvancedComputing,Storage,DataTransferNodes(DTNs),anda100Gb/sconnectiontotheoutsideworld
• ResourceswillbedistributedacrossNewBrunswick/Piscataway,Newark,andCamden
• TieredStoragesolutionthatwillincludeHIPAA/FISMAcompliance• Designedtobeatestbed toservemultipleresearchneeds(including
industry)• Elasticinthesensethatwewillgrowandshrinkintocloudresources
basedondemandandjobtype(OSG,Google,Amazon,Azure)• CouplesNSFfundednationalprojectsandcommercialcloudservices
directlyintoourenvironmentcreatingaone-stopshopfortheresearcher• DesignedtobeaPlug-N-PlayenvironmentwithdeploymentofDTNs
(FIONAS)• Asnetworkisupgraded,moreresearchgroupswillbeadded
![Page 12: Regional Data DMZ in Support of Distributed Applications ......Regional Data DMZ • High-bandwidth network connectivity between the regional networks, PennREN (KINBER) and NJEdgeas](https://reader030.fdocuments.in/reader030/viewer/2022041118/5f2fae0629e7b602e812dc31/html5/thumbnails/12.jpg)
PennState/PennsylvaniaApplications• Meteorology• ClimateModeling• Bioinformatics• BiochemistryandMolecularBiology• Cryo-electronmicroscopy• Astronomy
![Page 13: Regional Data DMZ in Support of Distributed Applications ......Regional Data DMZ • High-bandwidth network connectivity between the regional networks, PennREN (KINBER) and NJEdgeas](https://reader030.fdocuments.in/reader030/viewer/2022041118/5f2fae0629e7b602e812dc31/html5/thumbnails/13.jpg)
PennStateScienceDMZ
![Page 14: Regional Data DMZ in Support of Distributed Applications ......Regional Data DMZ • High-bandwidth network connectivity between the regional networks, PennREN (KINBER) and NJEdgeas](https://reader030.fdocuments.in/reader030/viewer/2022041118/5f2fae0629e7b602e812dc31/html5/thumbnails/14.jpg)
Collaboration• Formednetworkinggroupaspartofthecollaboration–Mailinglistandbiweeklymeetings– NetworkengineersandprojectparticipantsfromRutgers,PennState,KINBERandNJEdge
• Activities– TechnicaldetailsforimplementingDataDMZ– Generalexchangeoftechnicalinformation,bestpractices
![Page 15: Regional Data DMZ in Support of Distributed Applications ......Regional Data DMZ • High-bandwidth network connectivity between the regional networks, PennREN (KINBER) and NJEdgeas](https://reader030.fdocuments.in/reader030/viewer/2022041118/5f2fae0629e7b602e812dc31/html5/thumbnails/15.jpg)
ProjectStatus• Itishard!– Newnetworkconnections,forexample,tothespecificVDCHublocationateachcampus
– Accommodateinfrastructureupgrades• NewmachineroomatPennState• NJEdge backboneupgrade• PennRENmovetonewcolocationfacility
– Policy– whopaysforthecostsofthenewconnectionifitwasn’tincludedintheoriginalgrant
– Identifyinginitialtestingplatforms
![Page 16: Regional Data DMZ in Support of Distributed Applications ......Regional Data DMZ • High-bandwidth network connectivity between the regional networks, PennREN (KINBER) and NJEdgeas](https://reader030.fdocuments.in/reader030/viewer/2022041118/5f2fae0629e7b602e812dc31/html5/thumbnails/16.jpg)
Observations• Baselinenetworktests– ExistingperfSONARplatforms,eventuallyincludeFIONAplatformsateachsite
• NetworkconnectivitypriortoconnectingDMZ– Notoptimal– 3Internet2providers(OmniPoP,DrexelandMAGPI)
– InitialVDCHubtraceroute –• ReturnpathusedthecommoditynetworkconnectionandnottheregionalnetworkorInternet2connection
![Page 17: Regional Data DMZ in Support of Distributed Applications ......Regional Data DMZ • High-bandwidth network connectivity between the regional networks, PennREN (KINBER) and NJEdgeas](https://reader030.fdocuments.in/reader030/viewer/2022041118/5f2fae0629e7b602e812dc31/html5/thumbnails/17.jpg)
InitialDataDMZperfSONARDashboard
![Page 18: Regional Data DMZ in Support of Distributed Applications ......Regional Data DMZ • High-bandwidth network connectivity between the regional networks, PennREN (KINBER) and NJEdgeas](https://reader030.fdocuments.in/reader030/viewer/2022041118/5f2fae0629e7b602e812dc31/html5/thumbnails/18.jpg)
What’sNext
• LeveragethedataDMZconcepttodevelopa“regionalresearchplatform”.
• FindsciencedriversamongtheinitialhubandspokesitesassociatedwiththeVDC.
• Understandopportunitiesforexpandingtoothersites.– InNewJerseyandPennsylvaniausingtheregionalnetworksforconnectivity.
– Intheregion• Connecttothenationalfabric.
![Page 19: Regional Data DMZ in Support of Distributed Applications ......Regional Data DMZ • High-bandwidth network connectivity between the regional networks, PennREN (KINBER) and NJEdgeas](https://reader030.fdocuments.in/reader030/viewer/2022041118/5f2fae0629e7b602e812dc31/html5/thumbnails/19.jpg)
10/18/17 19
Q&A- Discussion
ContactInformation:
WendyHuntoon([email protected])BarrVonOeshen ([email protected])KenMiller([email protected])JimStankiewicz)([email protected])