DWDM-RAM: Enabling Grid Services with Dynamic Optical Networks

1

DWDM-RAM:Enabling Grid Services with Dynamic Optical

NetworksS. Figueira, S. Naiksatam, H.

Cohen,D. Cutrell, P. Daspit, D. Gutierrez,D. Hoang, T. Lavian, J. Mambretti,

S. Merrill, F. Travostino

2

DWDM-RAM

DARPA-funded projectSanta Clara, CA

Nortel NetworksSanta Clara University

Chicago, ILiCAIR / Northwestern University

AustraliaUniversity of Technology, Sydney

3

DWDM-RAM

GoalMake dynamic optical network usable

by grid applicationsProvide lightpaths as a serviceDesign and implement in prototype a

new type of grid service architecture optimized to support data-intensive grid applications through advanced optical network

4

Why Dynamic Optical Network?

Packet-switching technologyGreat solution for small-burst

communication, such as email, telnet, etc.

Data-intensive grid applicationsInvolves moving massive amounts of

dataRequires high and sustained bandwidth

5


DWDMBasically circuit switchingEnable QoS at the Physical LayerProvide

High bandwidthSustained bandwidth

6


DWDM based on dynamic wavelength switchingEnable dedicated optical paths to be

allocated dynamically

In a few seconds…

A B A

C

7


Any drawbacks?The overhead incurred during end-to-

end path setup

Not really a problemThe overhead is amortized by the

long time taken to move massive amounts of data

8


Setup time = 48 sec, Bandwidth=920 Mbps

0%10%20%30%40%50%60%70%80%90%

100%

100 1000 10000 100000 1000000 10000000

File Size (MBytes)

Se

tup

tim

e /

To

tal T

ran

sfe

r T

ime

500GB

When dealing with data-intensive applications, overhead is

insignificant!

9

Why Grid Services?

Applications need access to the networkTo request and release lightpaths

Grid servicesCan provide an interface to allocate

and release lightpaths

10

DWDM-RAM Architecture

DataCenter

1

n

1

n

DataCenter

Data-Intensive Applications

Dynamic Lambda, Optical Burst, etc., Grid services

DataTransfer Service

Basic NetworkResource

Service

NetworkResource Scheduler

Network Resource Service

DataHandlerService

Information S

ervice

Application MiddlewareLayer

Network ResourceMiddlewareLayer

Connectivity and Fabric Layers

OGSI-ification API

NRS Grid Service API

DTS API

Optical path control

11


Applications

Data Transfer Scheduling

Network Resource Scheduling

Communication Protocols

ODIN

OMNInetFabric

Connectivity

Resource

Collective

Application

12


Applications




ODIN

OMNInetFabric

Connectivity

Resource

Collective

Application

13


OMNInet - photonic testbed networkFour-node multi-site optical metro

testbed network in Chicago -- the first 10GE service trial!

All-optical MEMS-based switching and advanced high-speed services

Partners: SBC, Nortel, iCAIR at Northwestern, EVL, CANARIE, ANL

14

4x10GE

Northwestern U

OpticalSwitchingPlatform

Passport8600

ApplicationCluster

OMNInet Core Nodes

ApplicationCluster


Passport8600

4x10GE

StarLight

OPTera Metro5200

ApplicationCluster


Passport8600

4x10GE8x1GE

UIC

CA*net3--Chicago


Passport8600

Closed loop

4x10GE8x1GE

8x1GE

8x1GELoop

15


ODIN - Optical Dynamic Intelligent NetworkSoftware suite that controls the OMNInet

through lower-level API callsDesigned for high-performance, long-term

flow with flexible and fine grained controlStateless server, which includes an API to

provide path provisioning and monitoring to the higher layers

16


Applications




ODIN

OMNInetFabric

Connectivity

Resource

Collective

Application

17


Communication ProtocolsCurrently, using standard off-the-shelf

communication protocol suites Provide communication between application

clients and DWDM-RAM services and between DWDM-RAM components

Communication consists of mainly SOAP messages in HTTP envelopes transported over TCP/IP connections

18


Applications




ODIN

OMNInetFabric

Connectivity

Resource

Collective

Application

19


Network Resource SchedulingEssentially a resource management

serviceMaintains schedules and provisions

resources in accordance with the schedule

Provides an OGSI compliant interface to request the optical network resources

20


Applications




ODIN

OMNInetFabric

Connectivity

Resource

Collective

Application

21


Data Transfer SchedulingDirect extension of the NRS service,

provides an OGSI interfaceShares the same backend scheduling

engine and resides on the same hostProvides a high-level functionalityAllow applications to schedule data

transfers without the need to directly reserve lightpaths

The service also perform the actual data transfer once the network is allocated

22


Uses standard ftpUses NRS to allocate lambdasUses OGSI calls to request network resources

λData Receiver Data Source

FTP client FTP server

DTS NRS

Client App

23


Applications




ODIN

OMNInetFabric

Connectivity

Resource

Collective

Application

24


ApplicationsTarget is data-intensive applications

since their requirements make them the perfect costumer for DWDM networks

25

DWDM-RAM Modes

Applications may request a data transfer

Applications



26

DWDM-RAM Modes

Applications may request a network connection

Applications


27

DWDM-RAM Modes

Applications may request a set of resources through any resource allocator, which will handle the network reservation

Applications


Resource Allocator

28

The Network Service

The NRS is the key for providing network as a resourceIt is a service with an application-level

interfaceUsed for requesting, releasing, and

managing the underlying network resources

29

The Network Service

NRSUnderstands the topology of the

networkMaintains schedules and provisions

resources in accordance with the schedule

Keeps one scheduling map for each lambda in each segment

30

The Network Service

4 Scheduling maps:Each with a vector of time intervals for keeping the reservations

31

The Network Service

4 scheduling maps for each segment

32

The Network Service

NRSProvides an OGSI-based interface to

network resourcesRequest parameters

Network addresses of the hosts to be connectedWindow of time for the allocationDuration of the allocationMinimum and maximum acceptable bandwidth

(future)

33

The Network Service

NRS Provides the network resource

On demandBy advance reservation

Network is requested within a windowConstrainedUnder-constrained

34

The Network Service

On DemandConstrained window: right now!Under-constrained window: ASAP!

Advance ReservationConstrained window

Tight window, fits the transference time closely

Under-constrained windowLarge window, fits the transference time looselyAllows flexibility in the scheduling

35

The Network ServiceUnder-constrained window

Request for 1/2 hour between 4:00 and 5:30 on Segment D granted to User W at 4:00

New request from User X for same segment for 1 hour between 3:30 and 5:00

Reschedule user W to 4:30; user X to 3:30. Everyone is happy.

Route allocated for a time slot; new request comes in; 1st route can be rescheduled for a later slot within window to accommodate new request

4:30 5:00 5:304:003:30

W

4:30 5:00 5:304:003:30

X

4:30 5:00 5:304:003:30

WX

36

Experiments

Experiments have been performed on the OMNInetEnd-to-end FTP transfer over a 1Gbps

linkGoal

Exercise the network to show that the full bandwidth can be utilized

Demonstrate that the path setup time is not significant

37

End-to-End Transfer Time

0.5s 3.6s 0.5s 174s 0.3s 11s

OD

IN S

erve

r P

roce

ssin

g

File

tra

nsfe

r do

ne,

path

re

leas

ed

File

tra

nsfe

r re

ques

t ar

rives

Pat

h D

eallo

cati

on

req

ues

t

Dat

a T

ran

sfer

20 G

B

Pat

h ID

re

turn

ed

OD

IN S

erve

r P

roce

ssin

g

Pat

h A

lloca

tio

n

req

ues

t

25s

Net

wo

rk

reco

nfi

gu

rati

on

0.14sF

TP

set

up

ti

me

sumit

sumit9/20/2003Theme:Breakup of the end-to-end transfer time presented in the previous slide.Source: NWU

38

Application Level Measurements

File size: 20 GB

Path allocation: 29.7 secs

Data transfer setup time:

0.141 secs

FTP transfer time: 174 secs

Maximum transfer rate: 935 Mbits/sec

Path tear down time: 11.3 secs

Effective transfer rate: 762 Mbits/sec

sumit

sumit9/20/2003Theme:These are the application level measurements obtained by clocking predefined events.Source:Events defined by DC & HC (SC team). Measurements from logs generated at NWU.

Administrator

Measured at the DMS layer.This the total time required to setup the path and is measured from the time the request was made for the path, to the point when the call returned from the NRM and the data transfer was possible for the DMS.

Administrator

Administrator

Measured at the DMS layer.From the point when the DMS issues a request to the NRM to deallocate the path, to the point when the call returns from the NRM after the path is deallocated.

Administrator

Ideally this should be measured from the point when the DMS issues the request to the point when the Odin OGSI service receives the request.If thats not feasible, then we measure the time from the point when DMS issued the request and NRM obtained it. Then we multiply this by 2.

Administrator

Total size of the file that was transferred.

Administrator

Total time it took to transfer the file.

39

20GB File Transfer

40

Current Status

Allocation of one-segment lightpathOn demand allocation has been

tested at the OMNInetAdvance reservation has been

implemented but not tested at the OMNInet

41

Future Work

Nortel Networks / SURFnetLightpath allocationMultiple-segment lightpathsOptimized allocation when more than one

path is available

Scheduling in large-scale networks Involves different administrative and/or

geographic domainsRequires a distributed approach

42

Conclusion

Dynamic optical network is a key technology for data-intensive grid computingDWDM-RAM’s network service enables lightpaths to be provided as a primary resource

DWDM-RAM: Enabling Grid Services with Dynamic Optical Networks

Documents

Transcript of DWDM-RAM: Enabling Grid Services with Dynamic Optical Networks