End-to-End Performance Initiative

End-to-End Performance Initiative

Russ HobbyMay 30, 2001Internet2 Campus WorkshopAtlanta, Georgia

Internet2 Campus Workshop (May 30, 2001) 2

The Problem

Even with high bandwidth network links, the Internet2 community often does not see expected performance.


E2E Perf Initiative Vision

To enable the end-user to obtain optimal performance from the available current and future infrastructure on a routine basis.


Work to Date

Initial planning in the late fall and winter

Campus Workshop in San Diego

Planning Meeting in Ann Arbor

Recasting of work plan

Formation of Design Team

Design Team White Paper

Spring Member Meeting

New Initiative Director, Cheryl Munn-Freemon Starts June 5


Design Team

The End-to-End Performance Initiative Design Team includes:

George Brett, NCSA/NLANR DAST/Web 100

Claudia de Luna, NASA Jet Propulsion Laboratory

Doug Gale, OARnet

Andy Germain, NASA Goddard Space Flight Center

Terry Gray, University of Washington and Pacific/Northwest GigaPoP

Wendy Huntoon, PSC/NLANR NCNE

Basil Irwin, Web100

Cheryl Munn-Fremon, University of Michigan

Ronn Ritke, SDSC/NLANR MOAT

Matthew Schmitz, Cisco Systems

Internet2 Staff Participants:

Guy Almes, Laurie Burns, Steve Corbató, Ted Hanss, Russ Hobby (chair), Kathleen Young, and Matt Zekauskas.


The Initiative is

A Coordinating Structure• Will not replace current activities in the area• Will encourage work where there are missing activities• Coordinate activities to support E2E Performance• Help to move developments into operation

A Communications Facilitator • Promote communications for common areas• Tools for cross-area communications

A Knowledge Repository• Collect and disseminate knowledge gained• Distribute tools developed


Participants

The Initiative is Structured Around Partnerships among

•Applications Communities•Network Operators•Gigapops•Network Researchers•Campuses•Corporate partners• Internet2 Staff


Applications Communities

They are the reason to have the network!

The Initiative will:• Work closely with selected test communities• Focus on helping them do what they want to do• Use their key applications to evaluate and improve network performance


Campuses include the “Ends” in End-to-End

Campus concerns include:

Campus Users - overall performance and end result of the application.

System Administrators - computer hardware and operating system.

Network Operators - performance of the network.


Focus Areas

Applications End-to-End

Host Computer and Operating Systems

The Network

Operational Support


End-to-End Applications

Develop Test Case Disciplines • Study and Resolve Their Problems• Examples:

–High Energy Physics–Astronomy–Medicine

Identify Key Applications to Test Performance–FTP–Video Conferencing–Remote Instrument Control


End-to-End Applications

Develop Techniques and Tools to Make Networks Friendly to Applications

• Applications Design –Best Practices–Resource Determination

• Implementation–Best Practices–Software Libraries–Applications Development Systems

• Operation –Obtaining Resources–Self Tuning Applications–Capabilities to Isolate Problems


Host Computer and Operating System

Web100 is a Key Player for this Area

Techniques and Tools to Analyze• The Various Computer Sub-systems and Software• Different Hardware/Operating System Combinations and present options for to obtain optimal performance

• Optimal Computer Configurations

Publicize Methodologies, Tools, and Results • Case Studies, Best Common Practices• Analysis Tools for Different Computers


Host/OS Sub-Layers

API/library interface for accessing network resources

Kernel interface

Kernel memory-management subsystem

TCP-handling stack

IP-handling stack

Device driver and driver interface to kernel

NIC

Host bus or buses

Memory subsystem

CPU

Disk subsystem


The Network

Establish a Common Measurement Infrastructure• Standard Instrumentation Locations along the Path• Common Data Sets Collected• Applications Reference Servers• Download of Special Testing Software

Develop Analysis Tools• Study Network Behavior• Pinpoint Source of Problems• Determine the Health of the Network


Operational Support

Develop a Coordination and Communication Structure for Support Personnel Groups

• Computer System Administrators, LAN Managers, Campus NOCs

• Access to Experts• Cross-Campus Support

Establish the Performance Evaluation and Review Framework (PERF)

• A Coordination Structure to Study and Resolve Hard Problems

• Help populate the Knowledgebase of Solutions


Operational Support

Other Operational Developments

•Knowledgebase creation and use

•Cross-Domain Trouble Ticket System for use by NOCs (initially) and End-Users (later)

•Standard Sets of Operational Data that everyone can use to determine network capabilities and limitations.


Initiative Management and Support

Initiative Structure• Series of Calls for Participation (CFPs)• Participation by Internet2 Community Partners• Initiative Management Structure• An Initiative Advisory Committee

Internet2 Provides• Initiative Management• Communications Tools• Information Resources and Tools• Evaluation and Assessment


Show Me the Money

UCAID has committed ~$1.5 million in project funding to provide central coordination and support

Initiative coordination activities include proactively identifying potential funding sources and developing funding opportunities

Potential funding agencies have participated in the planning stages and discussions will continue


Next Steps

White paper still open for comments

Design Team work continuesProduce an action plan and post

Develop the Calls for Participation

Specify review process

Issue first set of CFPs, and begin work in specific areas

Form an advisory and management structures


Further Information

End-to-End Performance Initiative

http://www.internet2.edu/e2eperf/

Initiative Design Paper

http://www.internet2.edu/e2eperf/papers/End-to-End-Perf-Design-Paper.pdf

End-to-End Performance Initiative

Documents

Transcript of End-to-End Performance Initiative