JRA4 Update

23
INFSO-RI-508833 Enabling Grids for E-sciencE www.eu-egee.org JRA4 Update Ratnadeep Abrol EPCC, The University of Edinburgh, UK

description

JRA4 Update. Ratnadeep Abrol EPCC, The University of Edinburgh, UK. Contents. Network Performance Monitoring What is NPM? Architecture and Interface Bandwidth Allocation Reservation What is a BAR service ? Architecture & Interface for BAR Issues. Network Performance Monitoring (NPM). - PowerPoint PPT Presentation

Transcript of JRA4 Update

Page 1: JRA4 Update

INFSO-RI-508833

Enabling Grids for E-sciencE

www.eu-egee.org

JRA4 Update

Ratnadeep Abrol

EPCC, The University of Edinburgh, UK

Page 2: JRA4 Update

2nd EGEE Conference. PTF meeting. 2

Enabling Grids for E-sciencE

INFSO-RI-508833

Contents

• Network Performance Monitoring– What is NPM?– Architecture and Interface

• Bandwidth Allocation Reservation– What is a BAR service ?– Architecture & Interface for BAR

• Issues

Page 3: JRA4 Update

2nd EGEE Conference. PTF meeting. 3

Enabling Grids for E-sciencE

INFSO-RI-508833

Network Performance Monitoring (NPM)

Page 4: JRA4 Update

2nd EGEE Conference. PTF meeting. 4

Enabling Grids for E-sciencE

INFSO-RI-508833

What is NPM?

• Main function– Provides network performance data

to high level middleware (JRA1)• available bandwidth between end sites (CEs and SEs)

• allows for calculation of equivalent of Network Cost Function in EDG

to NOCs and GOCs• end site and backbone statistics

• e.g. round trip time, one way delay, available bandwidth... to end users

• end site statistics

• allows simple examination of network problems

Page 5: JRA4 Update

2nd EGEE Conference. PTF meeting. 5

Enabling Grids for E-sciencE

INFSO-RI-508833

What is NPM?

• Additional functions– Running on demand network tests

for NOCs and GOCs useful for diagnosing faults

– Alarms for NOCs and GOCs useful for diagnosing faults

Page 6: JRA4 Update

2nd EGEE Conference. PTF meeting. 6

Enabling Grids for E-sciencE

INFSO-RI-508833

Architecture and Interface

Page 7: JRA4 Update

2nd EGEE Conference. PTF meeting. 7

Enabling Grids for E-sciencE

INFSO-RI-508833

High Level Overview

• Provides access to Network Monitoring Frameworks– End to End Frameworks

e.g. PingER, EDG WP7, GridMon, IEPM-BW, home grown

– Backbone Frameworks e.g. perfmonit, GN2’s own, Internet2, piPEs, home grown

Page 8: JRA4 Update

2nd EGEE Conference. PTF meeting. 8

Enabling Grids for E-sciencE

INFSO-RI-508833

High Level Overview

Middleware GOC/NOC

End Site

EDG WP7

End Site

Home grown

Backbone

PerfmonitBackbone

piPEs

Backbone

GN2

NPM Glue

End Site NPM request End Site or Backbone NPM request

Page 9: JRA4 Update

2nd EGEE Conference. PTF meeting. 9

Enabling Grids for E-sciencE

INFSO-RI-508833

Framework Interfaces

• Problem: Each framework exposes own interface– NM-WG

piPES, perfmonit

– R-GMA EDG WP7

– Flat file GridMon

• Solution: Require that frameworks support NM-WG– NM-WG is GGF working group– “NMWG will determine with of the network characteristics are

relevant to Grid applications and pursue standardization of the attributes to describe these characteristics.”

– Define a request/report schema to gather network monitoring statistics.

Page 10: JRA4 Update

2nd EGEE Conference. PTF meeting. 10

Enabling Grids for E-sciencE

INFSO-RI-508833

High Level Architecture

End Site

EDG WP7

NM-WG

Backbone

Perfmonit

NM-WG

End Site

Home grown

NM-WG

Backbone

piPEs

NM-WG

Backbone

GN2

NM-WG

Middleware GOC/NOC

NPM Glue

Page 11: JRA4 Update

2nd EGEE Conference. PTF meeting. 11

Enabling Grids for E-sciencE

INFSO-RI-508833

Interaction with NPM

• High Level Middleware– Similar to interaction with WP7 in EDG

End site information published to a Grid Information System (GIS) HLM retrieves information from GIS

• NOC/COG– Interacts with diagnostic client

Allows measurement to be built up from along a route Require backbone as well as end site information Will talk directly to NPM Glue

• End users– Interacts with simple client

Provides information on current state of the network Will talk directly to NPM Glue

Page 12: JRA4 Update

2nd EGEE Conference. PTF meeting. 12

Enabling Grids for E-sciencE

INFSO-RI-508833

High Level Architecture – take 2

End Site

EDG WP7

NM-WG

Backbone

Perfmonit

NM-WG

End Site

Home grown

NM-WG

Backbone

piPEs

NM-WG

Backbone

GN2

NM-WG

Grid

Information

System

MiddlewareGOC/NOC

Diagnostic Client

NPM Glue

NM-WG

Page 13: JRA4 Update

2nd EGEE Conference. PTF meeting. 13

Enabling Grids for E-sciencE

INFSO-RI-508833

Bandwidth Allocation and Reservation (BAR)

Page 14: JRA4 Update

2nd EGEE Conference. PTF meeting. 14

Enabling Grids for E-sciencE

INFSO-RI-508833

What is a BAR service ?

• The BAR service will allow (JRA1) Higher Level Middleware (HLM) to reserve network services between two end points.

• Middleware, for example, can use this service to request reservations on guaranteed bandwidth between two end-points during a certain period of time.

• Or it can use this service to reserve a transfer of given volume of data within a given period of time between two end-points.

Page 15: JRA4 Update

2nd EGEE Conference. PTF meeting. 15

Enabling Grids for E-sciencE

INFSO-RI-508833

BAR Requirements

• Time-windowed bulk transport – Guarantee of average bandwidth, B, starting at time S and

ending at time E. – ‘Guaranteed and Configurable Bandwidth’ requirement from the

joint document.

• Time-windowed bandwidth guaranteed transport– Fixed guaranteed bandwidth, B, starting at time S and ending at

time E. – ‘Guaranteed Delivery Time’ requirement from the joint document.

• Time-windowed high reliability transport– Option to guarantee a very high reliability. In other words, an

option that provides better Mean Time Between Failures (MTBF).

– ‘Restoration after Failure’ requirement from the joint document.

Page 16: JRA4 Update

2nd EGEE Conference. PTF meeting. 16

Enabling Grids for E-sciencE

INFSO-RI-508833

BAR Requirements

• Confidential transport– Implement a high confidentiality connection option. – ‘Encryption During Transmission’ requirement from the joint

document.

• Long term mission critical transport– Minimum possible latency and very high reliability over a long

period. – ‘Long Term Low Latency Low Bandwidth QoS’ requirement from

the joint document

• Time-windowed delay/jitter sensitive transport.– Low latency and jitter, starting at time S and ending at time E. – ‘Long Term Low Latency Low Bandwidth QoS’ requirement from

the joint document

Page 17: JRA4 Update

2nd EGEE Conference. PTF meeting. 17

Enabling Grids for E-sciencE

INFSO-RI-508833

Architecture and Interface

Page 18: JRA4 Update

2nd EGEE Conference. PTF meeting. 18

Enabling Grids for E-sciencE

INFSO-RI-508833

An architecture for BAR

• An overview of how BAR fits into rest of the architecture

HLM HLM

BAR

NSAP NSAP

Network

BAR

Domain 1 Domain 2 Domain 3

Grid

Network

NSAPL-NSAP L-NSAP

Page 19: JRA4 Update

2nd EGEE Conference. PTF meeting. 19

Enabling Grids for E-sciencE

INFSO-RI-508833

Interface to BAR

• The document DJRA4.1, “Specification of Interfaces For Bandwidth Reservation Service”, shows the current view on the BAR interface.– Absolutely not cast in stone– https://edms.cern.ch/document/501154/1

• The document gives detailed explanation of types of reservation services offered by BAR

• Please send comments to:[email protected]

Page 20: JRA4 Update

2nd EGEE Conference. PTF meeting. 20

Enabling Grids for E-sciencE

INFSO-RI-508833

BAR Web Services

• JRA4 BAR translates HLM to NSAP and vice versa– It assumes the HLM (JRA1) and the NSAP (GN2) functionality.– As a result, some of the requirements may not be possible to be

catered for, as the necessary Network facilities may not be available within the EGEE timeframe

HLM NSAPBAR Web Service

RequestServicePT

ModifyServicePT

CancelServicePT

QueryServicePT

NotificationPT

FaultTypesPT

RequestServicePT

ModifyServicePT

CancelServicePT

QueryServicePT

NotificationPT

FaultTypesPT

Page 21: JRA4 Update

2nd EGEE Conference. PTF meeting. 21

Enabling Grids for E-sciencE

INFSO-RI-508833

Port Types

• RequestService makes initial request– E.g., to reserve a guaranteed bandwidth between two end

points.

• ModifyService– Complex task we need to understand better– Prototype due Feb ’05 will help

• CancelService• QueryService• Notification

– Start/end times– Failure of request

Page 22: JRA4 Update

2nd EGEE Conference. PTF meeting. 22

Enabling Grids for E-sciencE

INFSO-RI-508833

Issues

Page 23: JRA4 Update

2nd EGEE Conference. PTF meeting. 23

Enabling Grids for E-sciencE

INFSO-RI-508833

Issues

• Requirements clarification and prioritisation– Collaboration with GN2, EGEE::SA2 and EGEE::JRA1 mainly

• Authorisation and Authentication– JRA1 will use VOMS– Network is likely to use Shibboleth or PERMIS

• WS-Agreement

• To integrate or not to integrate?– BAR and NPM should share AAA architecture, perhaps

implementation– Do they really have anything else in common?