GENI Racks : Infrastructure Overview
description
Transcript of GENI Racks : Infrastructure Overview
![Page 1: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/1.jpg)
Sponsored by the National Science Foundation 1March 14, 2012
GENI Racks: Infrastructure Overview
Heidi DempseyMarch 14, 2012
www.geni.net
![Page 2: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/2.jpg)
Sponsored by the National Science Foundation 2March 14, 2012
• GENI Racks • GENI Racks Status• ExoGENI Racks• InstaGENI Racks• OpenSource and International OF and Racks
• MesoScale• Regionals and GENI core evolution• Production Evolution• Using the Infrastructure
Agenda:
![Page 3: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/3.jpg)
Sponsored by the National Science Foundation 3March 14, 2012
GENI Racks Status
• GENI Racks projects are taking place to build out the GENI Infrastructure in the US.
• Racks provide reservable sliceable compute and network resources using a single Aggregate Manager.
• AM API compliance• GENI v3 Rspec support• Federation with Slice
Authorities (GPO, PG, PLC)
![Page 4: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/4.jpg)
Sponsored by the National Science Foundation 4March 14, 2012
GENI Racks Status
• GENI Racks design based on GPO requirements.• GPO Infrastructure team will run Acceptance
Tests to validate integration, experimenter and monitoring features.
• GENI Racks projects timeline:
![Page 5: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/5.jpg)
Sponsored by the National Science Foundation 5March 14, 2012
GENI Racks Status
• GPO software team has developed GENI AM API Acceptance Tests, now available in GCF 1.6.1:– http://trac.gpolab.bbn.com/gcf/wiki/GettingGcf– http://trac.gpolab.bbn.com/gcf/wiki/AmApiAcceptanceTests
• Acceptance Tests are used by rack teams to verify GENI AM API compliance.
• Aggregates that passed AM API acceptance tests:–PG Utah (RSpecs pass rspeclint)–PLC (RSpecs pass rspeclint)–FOAM 0.6.3
![Page 6: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/6.jpg)
Sponsored by the National Science Foundation 6March 14, 2012
GENI Racks Status
• GPO Infrastructure team has defined a System Acceptance Test Plan for GENI Racks:http://groups.geni.net/geni/wiki/GENIRacksHome/AcceptanceTests
• System Acceptance Tests will be run on each of the GENI Racks when rack development is completed.
• Focus is on :– Experimenter requirements – Integrated rack solution – Monitoring features reaching production level
• As part of each GENI Racks deployment, the GPO is an initial aggregate owner and will run a delivery evaluation.
![Page 7: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/7.jpg)
Sponsored by the National Science Foundation 7March 14, 2012
GENI Racks Status
• GENI Racks Projects being deployed:– ExoGENI A high performance, flexible virtual networking
topologies solution including OpenFlow, that also delivers a powerful platform for multi-site cloud applications. These racks are typically deployed as an integrated part of a campus network.
– InstaGENI - A mid-range, expandable GENI Racks solution that can will be deployed at a large number of campuses, delivering Internet cloud applications support, along with Openflow and VLAN networking. These racks are normally deployed outside a site firewall.
– Starter Racks: Deployed by the GPO, a project to deliver an early low-end solution for GENI Racks.
![Page 8: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/8.jpg)
Sponsored by the National Science Foundation 8March 14, 2012
GENI Racks - ExoGENI
• ExoGENI – High-performance GENI Racks – a partnership between
RENaissance Computing Institute (RENCI), Duke and IBM.
– ExoGENI racks deliver support for multi-domain cloud structure with flexible virtual networking topologies that allow combining ExoGENI, Meso-scale OpenFlow and WiMAX resources.
![Page 9: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/9.jpg)
Sponsored by the National Science Foundation 9March 14, 2012
GENI Racks - ExoGENI
• ExoGENI deployment schedule 2012:
![Page 10: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/10.jpg)
Sponsored by the National Science Foundation 10March 14, 2012
GENI Racks - InstaGENI
• InstaGENI– mid-range, expandable
GENI Racks at large number of campuses
– A small ProtoGENI cluster with OpenFlow networking and FOAM aggregate management
– Typically found outside the site firewall.
![Page 11: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/11.jpg)
Sponsored by the National Science Foundation 11March 14, 2012
GENI Racks - InstaGENI
• InstaGENI deployment schedule 2012:
![Page 12: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/12.jpg)
Sponsored by the National Science Foundation 12March 14, 2012
Open Source and International OF and Racks
• NEC– Proposing new racks – Using NEC switches, TREMA and OpenStack – Implemented with open source community– Based on commercial components already used in
GENI • OFELIA
– An European Union venture with 12 industry and academic partners
– Includes 5 OpenFlow campuses– Solution includes an aggregate manager that is similar
to the GENI AM.
![Page 13: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/13.jpg)
Sponsored by the National Science Foundation 13March 14, 2012
Mesoscale: Building at-scale Infrastructure
• GENI VLAN data plane• Public IP control plane• GENI AM API programmable interface • GENI shared monitoring and reporting• GENI operations policies and support • Brave IT staff and researchers on campuses• Brave regionals and core networks• Tools
What do I need besides racks?
![Page 14: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/14.jpg)
Sponsored by the National Science Foundation 14March 14, 2012
Mesocale Overview
![Page 15: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/15.jpg)
Sponsored by the National Science Foundation 15March 14, 2012
MesoScale Spiral4 Deployments
![Page 16: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/16.jpg)
Sponsored by the National Science Foundation 16March 14, 2012
MesoScale - Utah Education Network
UEN, ProtoGENI and InstaGENI:
![Page 17: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/17.jpg)
Sponsored by the National Science Foundation 17March 14, 2012
Mesoscale – Southern Crossroads
SOX OF Regional
![Page 18: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/18.jpg)
Sponsored by the National Science Foundation 18March 14, 2012
Regionals: CENIC (California)
CENIC proposed OpenFlow Topology
![Page 19: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/19.jpg)
Sponsored by the National Science Foundation 19March 14, 2012
Regionals - Midwest OpenFlow Crossroads
MOXI Architecture – Aggregating Regionals
![Page 20: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/20.jpg)
Sponsored by the National Science Foundation 20March 14, 2012
Regionals - Shared Fiber
MOXI I-Light Architecture
![Page 21: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/21.jpg)
Sponsored by the National Science Foundation 21March 14, 2012
Expanding regional testbeds - GpENI + KanREN
![Page 22: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/22.jpg)
Sponsored by the National Science Foundation 22March 14, 2012
StarLight/MREN
University of IllinoisUrbana
Champaign
I2 at StarLight
ESnet at StarLight
GENInet atStarLight/MREN Facility
MRENE1200lSwitch
OpticalSwitch
ICCN/I-WIRE
StarLightE1200Switch
NLRAt
StarLightOpticalSwitch
I2ION
ESnet
OpticalSwitch
Multiple EU, Asian, South
American Sites
NDDI
DYNES
InstaGENI RackWith OF SWiCAIR
GENI OF SWiCAIR
Multiple National Regional, State Net
Connections
StarLight/MREN
![Page 23: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/23.jpg)
Sponsored by the National Science Foundation 23March 14, 2012
University of Utah, Princeton University, GPO, Northwestern University, Clemson University, Georgia Tech , University of Kansas , New York University
University of Victoria
GENI Core backbone NOX
GPNNYSERNET
CANARIEBCNET
SL/MREN
SOX
MAGPIUEN
InstaGENI Spiral 4
![Page 24: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/24.jpg)
Sponsored by the National Science Foundation 24March 14, 2012
ExoGENI Spiral 4
FIU tbd
![Page 25: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/25.jpg)
Sponsored by the National Science Foundation 25March 14, 2012
NLR OpenFlow Expansion
![Page 26: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/26.jpg)
Sponsored by the National Science Foundation 26March 14, 2012
Internet2 OpenFlow Expansion and NDDI
![Page 27: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/27.jpg)
Sponsored by the National Science Foundation 27March 14, 2012
OpenFlow integration and test
• Working closely with ONF and Stanford• FOAM AM now at all Spiral 4 OpenFlow sites• New firmware upgrades for some switches• Stanford campus expansion and CENIC migration• Any-to-any OpenFlow connections in Spiral 4
![Page 28: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/28.jpg)
Sponsored by the National Science Foundation 28March 14, 2012
Evolving Production Support
• Help:– [email protected] mailing list– GMOC helpdesk (Marianne Chitwood at Experimenter Tools and
Services GEC13 session) http://gmoc.grnoc.iu.edu/gmoc/index/support.html
– GEC "coding" sprints– IRC/chat (informal)
• Prototype monitoring and status for Meso-scale sites:– http://monitor.gpolab.bbn.com (at GPO)– http://gmoc-db.grnoc.iu.edu (at GMOC)– much more new coming with GENI Rack deployments
• GPO working with GMOC and GENI Rack Teams to get production level monitoring and statistics.
• Implement the GMOC Concept of Operations by refining the GMOC API format.
![Page 29: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/29.jpg)
Sponsored by the National Science Foundation 29March 14, 2012
Evolving Production Support
Meso-scale site statistics from GEC12-GEC13• GPO PG Usage statistics:
– Overall slice creation attempts: 1992 (Successes: 1989 Failures: 3 )– Experimenter slices: 265 ( 29 distinct non-GPO PG users )
• Site Availability Statistics:Site %Internet2 99.8
NLR 96.1
Stanford 74.3
GPO 99.4
Clemson 97.7
Rutgers 93.0
GATech 94.7
![Page 30: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/30.jpg)
Sponsored by the National Science Foundation 30March 14, 2012
Evolving Production Support
• Defining incidence response procedures Legal, Law Enforcement and Regulatory Plan– Emergency Stop Procedure
• Security and GENI Legal, Law Enforcement and Regulatory Contacts: – Adam Slagell ([email protected]) primary– Steve Schwab ([email protected])
![Page 31: GENI Racks : Infrastructure Overview](https://reader036.fdocuments.in/reader036/viewer/2022070501/5681695a550346895de10b18/html5/thumbnails/31.jpg)
Sponsored by the National Science Foundation 31March 14, 2012
Using the Infrastructure
• Experiments• Slice Around the World!
– A GENI international collaboration– To include various types of racks located in 4 continents
to provide resources into a common slice – Sites in Japan (CoreLab), Germany (G-Lab), and Brazil
(LARC)– Several US GENI Rack sites (TBD)– To take place July 2012 at GEC 14
• What do you want to do?