RSpecs Engineering Meeting

Testbeds as a Service: GENIHeidi Picher DempseyInternet2 Annual MeetingApril 8, 2014 www.geni.net Sponsored by the National Science Foundation#April 8, 2014,11GENI provides a virtual lab for networking and distributed systems research and educationGENI started with exploratory, rapid prototyping 5 years agoGENI design assumes federation of autonomously owned and operated systemsYearly prototyping cycle for an idea: develop, integrate and operateExperimenters use the testbed while we are building it outEven prototypes have activist users, and must evolve to satisfy those users or fade away. Two of five original design frameworks predominate now.Horizontal dataplane slicing as a service (or sometimes just engineered)Vertical control plane APIs to negotiate and allocate resourcesFundsin handNeedsfundingSponsored by the National Science Foundation#April 8, 2014,GENI: Infrastructure for Experimentation

GENI provides compute, network, and wireless resources that can be connected in experimenter-specified Layer 2 topologies.Sponsored by the National Science Foundation#April 8, 2014,GENI is a nationwide suite of infrastructure forat scale experiments in networking, distributed systems, security, and novel applications.

GENI opens up huge new opportunitiesLeading-edge research in next-generation internetsRapid innovation in novel, large-scale applicationsKey GENI concept: slices & deep programmabilityInternet: open innovation in application programsGENI: open innovation deep into the network

3GENI: Infrastructure for Experimentation

GENI provides compute resources that can be connected in experimenter specified Layer 2 topologies.Sponsored by the National Science Foundation#April 8, 2014,GENI is a nationwide suite of infrastructure forat scale experiments in networking, distributed systems, security, and novel applications.

GENI opens up huge new opportunitiesLeading-edge research in next-generation internetsRapid innovation in novel, large-scale applicationsKey GENI concept: slices & deep programmabilityInternet: open innovation in application programsGENI: open innovation deep into the network

4

Multiple GENI Experiments run Concurrently

Resources can be shared between slicesExperiments live in isolated slicesSponsored by the National Science Foundation#April 8, 2014,5GENI is Deeply Programmable

I install software I want throughout my network slice (into routers, switches, ) or control switches using OpenFlowExperimenters can set up custom topologies, protocols and switching of flowsSponsored by the National Science Foundation#April 8, 2014,Experimenters set up custom:topologies protocols forwarding

6 United States GENI Resources Flexible network / cloud research infrastructureOver 1800 users (March, 2014)52 racks installed/in progress10 WiMAX (50 LTE planned)VMs, bare metal nodes, SDN switches (OpenFlow 1.0), software routing or OVS OpenFlow, WiMAX/LTE base stations and clients all available to experimenters.

MetroResearchBackbones

InternetISP

Regional NetworksCampus

g

g

g

Legend

GENI-enabled hardwareLayer 3Control PlaneLayer 2Data Plane

Sponsored by the National Science Foundation#April 8, 2014,International Federation Activities

International Federation API for clearinghouse functions.Supported for multiple clearinghouses.Joint GENI/FIRE (US/EU) capability demonstrated this year (not operating yet)GENI dataplane slices extend to other research networks by special arrangement now (Japan, Korea, Australia) Shared monitoring prototype planned for 2014Investigating/prototyping standards for experimenter-driven dataplane resource negotiation and provisioningNSI, OSCARSGENI StitchingSDN ExchangesSponsored by the National Science Foundation#April 8, 2014,Brecht Vermeulen, brecht.vermeulen@iminds.be, iMinds monitoring prototypeCees De Laat University of Amsterdam other federation and ExoGENI rack 8Campus Requirements for Shared ServicesSites provide space, power, security (as with other campus IT resources)Provide at least 1Gbps OpenFlow/SDN path from rack to campus boundary *Provide connection from rack to on-campus resources (varies by campus, usually SDN)*Operate with up-to-date GENI-specified software (e.g. AM API, OpenStack) Provide no-cost access to rack resources for GENI authorized users at other campusesProvide points of contact for GENI response team (see http://groups.geni.net/geni/attachment/wiki/ComprehensiveSecurityPgm/Aggregate Provider Agreement v3.pdf ) ** No STP or MAC learning

Sponsored by the National Science Foundation#April 8, 2014,Process Requirements for Shared Services

Standard installation processeshttp://groups.geni.net/geni/wiki/GENIRacksHome/RacksChecklistStatus System Acceptance TestingProduction: InstaGENI, ExoGENI Provisional: Dell (OpenGENI), Cisco Shared site resource and access detailshttp://groups.geni.net/geni/wiki/GeniAggregateSponsored by the National Science Foundation#April 8, 2014,Process Requirements (cont.)Site confirmation tests with logs and RSPECshttp://groups.geni.net/geni/wiki/GENIRacksHome/InstageniRacks/ConfirmationTestStatus

http://groups.geni.net/geni/wiki/GENIRacksHome/ExogeniRacks/ConfirmationTestStatusEmergency Stop and Legal, Law Enforcement and Regulatory Event Coordination (GMOC at Indiana University)Shared monitoring infrastructure and shared operations (6 major ops groups)

Sponsored by the National Science Foundation#April 8, 2014,University of Kentucky Ops Monitoring

Dashboard of CollectorSponsored by the National Science Foundation#April 8, 2014,ION openflow mesoscale

Emphasize different use case under common simple architecture

12Network Engineering Requirements for Shared Services

L2 dataplane engineeringcampuses, regional, core and international networksmany vendors and technologies 1-100GBE interfaces (GENI shares with other R&E projects)Shared or exclusive experimenter VLANs on interfaces depending on experiment (mostly exclusive)SDN (OpenFlow 1.0) switches with experimenters and sometimes R&E networks controllers (many vendors, varying implementation of standards)Standard Internet control plane Internet2 AL2S cross-connects and IONhttp://groups.geni.net/geni/wiki/GENIOESSTopologiesPerformance - IONtoAL2SPerformance

Sponsored by the National Science Foundation#April 8, 2014,Process=what do we have, is it what we expect (has it changed)Engineering=can we connect it (ports, VLANs, transceivers, etc.)

13Network Engineering (continued)GENI dynamic stitching available at 12 racks via Internet2 IONhttp://groups.geni.net/geni/wiki/GeniNetworkStitchingSitesOver 16,000 stitched slivers since November, 2013OESS GENI Stitching Aggregate coming soonStitching operations monitoring prototyping with MAX, Internet2

Sponsored by the National Science Foundation#April 8, 2014,Slice credentialsSoftware: Clearinghouse and AggregatesClearinghouse: manages users, projects and slicesStandard credentials shared via custom API or new Common CH APIGENI supported accounts: GENI Portal/CH, PlanetLab CH, ProtoGENI CHAggregate: provides resources to GENI experimentersTypically owned and managed by an organizationSpeaks the GENI Aggregate Manager API (AM API)http://groups.geni.net/geni/wiki/GAPI_AM_API_V3 most recent versionhttp://trac.gpolab.bbn.com/gcf download reference implementation (gcf), OMNI command line clientExamples: PlanetLab, Emulab, GENI racks on various campuses

Create & Register SliceResearcher

Aggregate Manager API - listResources - createSliver AggregateManagerAggregate ResourcesusersslicesclearinghouseprojectsToolSponsored by the National Science Foundation#April 8, 2014,Campus, NetEng and Process get horizontal connections workingControl plane software need standard APIs to get resources dropped in15GENI SliversSliver: One or more resources provided by an aggregatee.g. Bare machines, virtual machines, VLANsBackbone #1Backbone #2Campus#3Campus#2Access#1CommercialCloudsCorporateGENI suitesOther-NationProjectsResearchTestbedCampusMy GENI Slice

My slice contains slivers from many aggregates.Sponsored by the National Science Foundation#April 8, 2014,Software: RSpecsRSpecs: Lingua franca for describing and requesting resourcesMachine language for negotiating resources between experiment and aggregateExperimenter tools eliminate the need for most experimenters to write or read Rspec

RSpec for requesting a single nodeSponsored by the National Science Foundation#April 8, 2014,Key pieces of software to express transactions about resources17Reserving Resources using RSpecs and the AM API Experimenter tools and aggregates talk to each other using resource specifications (RSpecs) and the GENI Aggregate Manager API (GENI AM API)Advertisement RSpec: What does an aggregate have?Request RSpec: What does the experimenter want?Manifest RSpec: What does the experimenter have?AggregateManagerExperimenterTool

ListResources()Advertisement RSpecCreateSliver(Request RSpec, )Manifest RSpecListResources(SliceName, )Manifest RSpecWhat do you have?I have I would like You have What do I have?You have Sponsored by the National Science Foundation#April 8, 2014,GENI Design ActivitiesOpen to all http://groups.geni.net/geni/wiki/GeniDesignMailing lists http://lists.geni.net/mailman/listinfogeni-annouce@geni.net most generalRegular calls and design reviews announced through interest group mailing listsIRC/chat (mostly operations)http://groups.geni.net/geni/wiki/HowTo/ConnectToGENIChatRoomGENI Engineering Conferences (3 per year)June 21-24, 2014 University of California, Davis (Travel grants available)

Sponsored by the National Science Foundation#April 8, 2014,