Download - GENI Racks : Infrastructure Overview

Sponsored by the National Science Foundation 1March 14, 2012

GENI Racks: Infrastructure Overview

Heidi DempseyMarch 14, 2012

www.geni.net


• GENI Racks • GENI Racks Status• ExoGENI Racks• InstaGENI Racks• OpenSource and International OF and Racks

• MesoScale• Regionals and GENI core evolution• Production Evolution• Using the Infrastructure

Agenda:


GENI Racks Status

• GENI Racks projects are taking place to build out the GENI Infrastructure in the US.

• Racks provide reservable sliceable compute and network resources using a single Aggregate Manager.

• AM API compliance• GENI v3 Rspec support• Federation with Slice

Authorities (GPO, PG, PLC)


GENI Racks Status

• GENI Racks design based on GPO requirements.• GPO Infrastructure team will run Acceptance

Tests to validate integration, experimenter and monitoring features.

• GENI Racks projects timeline:


GENI Racks Status

• GPO software team has developed GENI AM API Acceptance Tests, now available in GCF 1.6.1:– http://trac.gpolab.bbn.com/gcf/wiki/GettingGcf– http://trac.gpolab.bbn.com/gcf/wiki/AmApiAcceptanceTests

• Acceptance Tests are used by rack teams to verify GENI AM API compliance.

• Aggregates that passed AM API acceptance tests:–PG Utah (RSpecs pass rspeclint)–PLC (RSpecs pass rspeclint)–FOAM 0.6.3

http://trac.gpolab.bbn.com/gcf/wiki/GettingGcf

http://trac.gpolab.bbn.com/gcf/wiki/GettingGcf

http://trac.gpolab.bbn.com/gcf/wiki/AmApiAcceptanceTests


GENI Racks Status

• GPO Infrastructure team has defined a System Acceptance Test Plan for GENI Racks:http://groups.geni.net/geni/wiki/GENIRacksHome/AcceptanceTests

• System Acceptance Tests will be run on each of the GENI Racks when rack development is completed.

• Focus is on :– Experimenter requirements – Integrated rack solution – Monitoring features reaching production level

• As part of each GENI Racks deployment, the GPO is an initial aggregate owner and will run a delivery evaluation.

http://groups.geni.net/geni/wiki/GENIRacksHome/AcceptanceTests

http://groups.geni.net/geni/wiki/GENIRacksHome/AcceptanceTests


GENI Racks Status

• GENI Racks Projects being deployed:– ExoGENI A high performance, flexible virtual networking

topologies solution including OpenFlow, that also delivers a powerful platform for multi-site cloud applications. These racks are typically deployed as an integrated part of a campus network.

– InstaGENI - A mid-range, expandable GENI Racks solution that can will be deployed at a large number of campuses, delivering Internet cloud applications support, along with Openflow and VLAN networking. These racks are normally deployed outside a site firewall.

– Starter Racks: Deployed by the GPO, a project to deliver an early low-end solution for GENI Racks.

http://groups.geni.net/geni/wiki/GENIRacksHome




GENI Racks - ExoGENI

• ExoGENI – High-performance GENI Racks – a partnership between

RENaissance Computing Institute (RENCI), Duke and IBM.

– ExoGENI racks deliver support for multi-domain cloud structure with flexible virtual networking topologies that allow combining ExoGENI, Meso-scale OpenFlow and WiMAX resources.


GENI Racks - ExoGENI

• ExoGENI deployment schedule 2012:


GENI Racks - InstaGENI

• InstaGENI– mid-range, expandable

GENI Racks at large number of campuses

– A small ProtoGENI cluster with OpenFlow networking and FOAM aggregate management

– Typically found outside the site firewall.


GENI Racks - InstaGENI

• InstaGENI deployment schedule 2012:


Open Source and International OF and Racks

• NEC– Proposing new racks – Using NEC switches, TREMA and OpenStack – Implemented with open source community– Based on commercial components already used in

GENI • OFELIA

– An European Union venture with 12 industry and academic partners

– Includes 5 OpenFlow campuses– Solution includes an aggregate manager that is similar

to the GENI AM.


Mesoscale: Building at-scale Infrastructure

• GENI VLAN data plane• Public IP control plane• GENI AM API programmable interface • GENI shared monitoring and reporting• GENI operations policies and support • Brave IT staff and researchers on campuses• Brave regionals and core networks• Tools

What do I need besides racks?


Mesocale Overview


MesoScale Spiral4 Deployments


MesoScale - Utah Education Network

UEN, ProtoGENI and InstaGENI:


Mesoscale – Southern Crossroads

SOX OF Regional


Regionals: CENIC (California)

CENIC proposed OpenFlow Topology


Regionals - Midwest OpenFlow Crossroads

MOXI Architecture – Aggregating Regionals


Regionals - Shared Fiber

MOXI I-Light Architecture


Expanding regional testbeds - GpENI + KanREN


StarLight/MREN

University of IllinoisUrbana

Champaign

I2 at StarLight

ESnet at StarLight

GENInet atStarLight/MREN Facility

MRENE1200lSwitch

OpticalSwitch

ICCN/I-WIRE

StarLightE1200Switch

NLRAt

StarLightOpticalSwitch

I2ION

ESnet

OpticalSwitch

Multiple EU, Asian, South

American Sites

NDDI

DYNES

InstaGENI RackWith OF SWiCAIR

GENI OF SWiCAIR

Multiple National Regional, State Net

Connections

StarLight/MREN


University of Utah, Princeton University, GPO, Northwestern University, Clemson University, Georgia Tech , University of Kansas , New York University

University of Victoria

GENI Core backbone NOX

GPNNYSERNET

CANARIEBCNET

SL/MREN

SOX

MAGPIUEN

InstaGENI Spiral 4


ExoGENI Spiral 4

FIU tbd


NLR OpenFlow Expansion


Internet2 OpenFlow Expansion and NDDI


OpenFlow integration and test

• Working closely with ONF and Stanford• FOAM AM now at all Spiral 4 OpenFlow sites• New firmware upgrades for some switches• Stanford campus expansion and CENIC migration• Any-to-any OpenFlow connections in Spiral 4


Evolving Production Support

• Help:– [email protected] mailing list– GMOC helpdesk (Marianne Chitwood at Experimenter Tools and

Services GEC13 session) http://gmoc.grnoc.iu.edu/gmoc/index/support.html

– GEC "coding" sprints– IRC/chat (informal)

• Prototype monitoring and status for Meso-scale sites:– http://monitor.gpolab.bbn.com (at GPO)– http://gmoc-db.grnoc.iu.edu (at GMOC)– much more new coming with GENI Rack deployments

• GPO working with GMOC and GENI Rack Teams to get production level monitoring and statistics.

• Implement the GMOC Concept of Operations by refining the GMOC API format.

mailto:[email protected]

http://monitor.gpolab.bbn.com/




http://gmoc-db.grnoc.iu.edu/



http://groups.geni.net/geni/attachment/wiki/GENIMetaOps/GENI-Concept-of-Operations-v2.1.doc?format=raw



Meso-scale site statistics from GEC12-GEC13• GPO PG Usage statistics:

– Overall slice creation attempts: 1992 (Successes: 1989 Failures: 3 )– Experimenter slices: 265 ( 29 distinct non-GPO PG users )

• Site Availability Statistics:Site %Internet2 99.8

NLR 96.1

Stanford 74.3

GPO 99.4

Clemson 97.7

Rutgers 93.0

GATech 94.7



• Defining incidence response procedures Legal, Law Enforcement and Regulatory Plan– Emergency Stop Procedure

• Security and GENI Legal, Law Enforcement and Regulatory Contacts: – Adam Slagell ([email protected]) primary– Steve Schwab ([email protected])

http://groups.geni.net/geni/wiki/GpoDoc





Using the Infrastructure

• Experiments• Slice Around the World!

– A GENI international collaboration– To include various types of racks located in 4 continents

to provide resources into a common slice – Sites in Japan (CoreLab), Germany (G-Lab), and Brazil

(LARC)– Several US GENI Rack sites (TBD)– To take place July 2012 at GEC 14

• What do you want to do?