Sponsored by the National Science Foundation

Measurement SystemSpiral 2 Year-end Project Review

University of Wisconsin, Colgate University, Boston University

PI: Paul Barford, Joel Sommers, Mark Crovella

Staff: Mike Blodgett, Charles ThomasStudents: Tiantong Yu, John Raffensperger, Ananya Das

August 30, 2010

Sponsored by the National Science Foundation 2INSERT PROJECT REVIEW DATE

Project Summary

• Objectives– Develop network measurement capability for GENI– ProtoGENI front end– Aggregate manager that arbitrates between ProtoGENI and sensors– Packet capture sensor systems that can run on commodity hardware– Packet transformation, authenticated/privacy preserving, and backend storage

• Spiral 1– Completed specifications– Completed test suites– Completed basic prototypes

• Spiral 2– 95% of target tasks are complete– Completed and tested major components of the system– Beginning rollout on NLR– ProtoGENI integration pending– Demoed system at GEC8

• Other– Many challenges despite professional programmers with some student involvement– Chairing GENI I & M Working Group

Sponsored by the National Science Foundation 3INSERT PROJECT REVIEW DATE

Milestone & QSR StatusID Milestone Status On

Time?On

Wiki?GPO

signoff?

S2.a Improve test suite for I2 or NLR deployment

The work on this milestone is complete. While the test suite continues to expand, we are satisfied that we can effectively assess the system.

Late Complt No*

S2.b Specify and develop library of packet transformations

We have implemented two of the most important transformations: flow aggregation and anonymization

Late Complt No*

S2.c Implement GENI spiral 2 identity management mechanisms

While authentication capability has been completed, the issue of authorization per sensor remains open

Late Complt No*

S2.d Develop improved functionality prototype

Dozens of updates have been made to the Spiral 1 prototype. The system is deployable but not ProtoGENI integrated.

Late Complt No*

S2.e Measurement prototype release for I2 or NLR deployment

We are in the process of doing the first NLR deployment

Late Complt No*

S2.f Update to Spec based on test deployment and user feedback

We have had no external users to date Late No No*

QSR: 4Q2009 N/A

QSR: 1Q2010 N/A

QSR: 2Q2010 Delivered on 7/10/2010 Late Complt No*

* The GPO has not signed off on any of our spiral 1 or spiral 2 milestones

Sponsored by the National Science Foundation 4INSERT PROJECT REVIEW DATE

Accomplishments 1: Advancing GENI Spiral 2 Goals

• Per the GENI Spiral 2 Overview, the objectives are focused on “moving toward experimentation with specific focus on integration, interoperability and identity management.

• Toward experimentation• We have developed the three key functional elements of our system (GUI, Aggregate Mgr. and

Sensor) to the point where they can be deployed in the wide area.• The availability of our system enables researchers using GENI to specify and experiment, capture

packets, transform the packets and archive the packets. This is unique/valuable capability.

• Toward integration• Our key integration point is ProtoGENI. This has been a MAJOR difficulty over the past year.

The FACT is that the many aspects of ProtoGENI and ill defined, under development or completely undefined. Eg. we are the first to try to use the ProtoGENI Reference Component Manager and are helping to develop and debug that system.

• Our system has been developed with modular, well defined interfaces that can easily be extended to other, stable components of GENI.

• Toward interoperability• Our system has been designed to be extensible and to interoperate with other systems• There are no active interoperability targets yet, but we are talking with UK (J. Griffioen)

• Toward identity management• Our system uses ProtoGENI’s user authentication system• Link resource management is TBD

Sponsored by the National Science Foundation 5INSERT PROJECT REVIEW DATE

Accomplishments 2:Other Project Accomplishments

• All Wisconsin Advanced Internet Lab (WAIL) resources are available via the ProtoGENI API

• Established layer 2 connectivity from WAIL to to multiple national backbones (I2 ION, NLR Framenet, ProtoGeni, Openflow), which paves the way for broad deployment going forward

• Participated in all GEC’s• PI-Barford is co-chair of the GENI Instrumentation and Measurement Working

Goup– Initial meeting of the GIMS Working Group had relatively light attendance, but GEC8

attendance was very strong– Active and growing specification of I & M specs.

• Undergraduate involvement at Colgate University under PI-Sommers– Funds were secured from Colgate to hire under grad research assistants for the academic year

and to send them to GEC8

Sponsored by the National Science Foundation 6INSERT PROJECT REVIEW DATE

Issues

• The single most significant issue for our project is the fact that specifications and implementations of the ProtoGENI control framework are fluid. This is not a criticism of ProtoGENI or the Utah folks (they have a lot on their plate and are making good progress)! Fluid implementations hinder our progress toward making our capabilities available to researchers.

• In order for our capabilities to be broadly available, we will need to deploy measurement sensors remotely. This is a time consuming and costly process, much of which is beyond our control. This makes timing on deliverables difficult to project.

• We are spending about 2x more hours on this project than funds provide for. This implementation is very complex so managing to stated milestones will continue to be challenging.

Sponsored by the National Science Foundation 7INSERT PROJECT REVIEW DATE

Plans

• Remainder of Spiral 2– Complete the ProtoGENI integration – end of Sept. ‘10– Continue tests on sensor scalability – end of Sept ‘10– Complete deployment on NLR – end of Sept. ’10

• Spiral 3– MANY ideas for what is required going forward!– Continue to work with ProtoGENI to enable the I & M system to be used in that control

framework– Create workflow system that enables researchers to be able to use GENI without having to be

an expert in GENI – Backend tools for data analysis– Broader deployment in NLR toward the goal of supporting experiments using ProtoGENI

framework– Integration with another control framework (not sure which makes the most sense)– Interoperability with another measurement system (UK group, others)– Extension of capabilities for GENI operations and management