Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer...

37
Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory

Transcript of Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer...

Page 1: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Paw

n: E

nabl

ing

Pee

r-to

-Pee

r In

tera

ctio

ns o

n th

e G

rid

Vin

cent

Mat

ossi

anS

prin

g 20

03

The

App

lied

Sof

twar

e S

yste

ms

Labo

rato

ry

Page 2: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

2/36

Pee

r-to

-pee

r com

putin

gce

ntra

lized

dece

ntra

lized

Page 3: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

3/36

Mot

ivat

ion

Mov

e to

war

ds d

ecen

traliz

ed c

ompu

ting

Dec

entra

lized

sys

tem

s bu

ild o

n c

omm

on la

yers

of

pro

toco

ls a

nd m

echa

nism

s Th

e G

rid c

omm

unity

is a

ddre

ssin

g lo

w-le

vel

requ

irem

ents

and

spe

cific

atio

n su

ch a

s se

curit

y,

reso

urce

allo

catio

n an

d m

anag

emen

t. G

rid a

pplic

atio

ns re

quire

hig

h-le

vel p

eer-

to-p

eer

inte

ract

ions

whi

ch re

mai

n an

ope

n pr

oble

m

Page 4: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

4/36

Aut

onom

ic C

ompu

tatio

nal C

olla

bora

tory

on

the

Grid

-E

nabl

ing

Glo

bal

Sci

entif

ic In

vest

igat

ion

Mod

els

dyna

mic

ally

co

mpo

sed.

“W

ebS

ervi

ces”

di

scov

ered

&

invo

ked.

Res

ourc

es d

isco

vere

d,

nego

tiate

d, c

o-al

loca

ted

on-th

e-fly

. M

odel

/Sim

ulat

ion

depl

oyed

Expe

rts q

uery

, co

nfig

ure

reso

urce

s

Exp

erts

inte

ract

and

co

llabo

rate

usi

ng

ubiq

uito

us a

nd

perv

asiv

e po

rtals

App

licat

ions

& S

ervi

ces

Mod

el A

Mod

el B

Lapt

op

PD

A

Com

pute

rS

cien

tist

Sci

entis

t

Res

ourc

es

Com

pute

rs, S

tora

ge,

Inst

rum

ents

, ...

Dat

a A

rchi

ve &

Sen

sors

Dat

aA

rchi

ves

Sen

sors

, Non

-T

radi

tiona

l Dat

aS

ourc

es

Exp

erts

min

e ar

chiv

e, m

atch

re

al-ti

me

data

with

hi

stor

y

Rea

l-tim

e da

ta in

ject

ion

(sen

sors

, lab

orat

ory

inve

stig

atio

ns,

inst

rum

ents

, dat

a ar

chiv

es),

Aut

omat

ed

min

ing

& m

atch

ing

Mod

els

writ

e in

to

the

arch

iveExp

erts

mon

itor/i

nter

act

with

/inte

rrog

ate/

stee

r mod

els

(“wha

t if”

scen

ario

s,…

). A

pplic

atio

n no

tifie

s ex

perts

of

inte

rest

ing

phen

omen

on.

Page 5: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

5/36

Pro

blem

sta

tem

ent

Def

ine

the

requ

irem

ents

and

sem

antic

s of

a

mes

sagi

ng s

ubst

rate

ena

blin

g ap

plic

atio

n in

tera

ctio

ns o

n th

e G

ridId

entif

y an

d im

plem

ent t

he c

orre

spon

ding

se

rvic

es a

nd m

echa

nism

sD

eplo

y an

d ev

alua

te s

uch

a m

essa

ging

su

bstra

te

Page 6: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

6/36

Dec

entra

lized

sys

tem

s… a

lot o

f iss

ues

?

Nam

ing

: How

to m

ap a

reso

urce

nam

e to

a lo

catio

n?D

isco

very

: How

to d

isco

ver a

nd p

ublis

h a

reso

urce

?R

outin

g: H

ow to

rout

e in

form

atio

n fro

m a

sou

rce

to a

de

stin

atio

n ad

dres

s?C

oord

inat

ion

: How

to m

aint

ain

orde

ring

of m

essa

ges

arriv

ing

from

dis

tribu

ted

node

s ?

Faul

t-tol

eran

ce: H

ow to

cop

e w

ith n

odes

failin

g sp

onta

neou

sly

in th

e ne

twor

k?Se

curit

y: H

ow to

gua

rant

ee a

uthe

ntic

atio

n, in

tegr

ity,

conf

iden

tialit

y of

mes

sage

s an

d pe

ers?

Thos

e is

sues

hav

e be

en a

ddre

ssed

Nam

ing

& D

isco

very

D

NS

Rou

ting

OS

PF

Coo

rdin

atio

n Ti

mes

tam

p al

gorit

hms

Faul

t-tol

eran

ce

Rep

licat

ion

Sec

urity

P

ublic

Key

Infra

stru

ctur

e

Page 7: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

7/36

Our

focu

s

Eng

inee

r a p

eer-t

o-pe

er m

essa

ging

su

bstra

te th

at e

xten

ds e

xist

ing

solu

tions

to

enab

le h

igh-

leve

l int

erac

tions

for s

cien

tific

ap

plic

atio

ns

Page 8: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

8/36

Con

tribu

tions

We

argu

e th

at b

uild

ing

larg

e-sc

ale

scie

ntifi

c co

llabo

ratio

ns b

enef

its fr

om a

pur

ely

peer

-to-p

eer

arch

itect

ure

as o

ppos

ed to

a c

lient

/ser

ver a

rchi

tect

ure.

We

defin

e th

e de

sign

requ

irem

ents

of a

pee

r-to

-pee

r m

essa

ging

mid

dlew

are.

We

impl

emen

t and

dep

loy

Paw

n, a

pee

r-to

-pee

r m

essa

ging

that

allo

ws

build

ing

inte

rope

rabl

e, a

dapt

ive,

an

d au

tono

mic

app

licat

ions

W

e ev

alua

te th

e pe

rform

ance

of P

awn

in a

real

-wor

ld

appl

icat

ion

Page 9: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

9/36

Talk

ove

rvie

wB

ackg

roun

d &

rela

ted

wor

kM

essa

ging

sys

tem

s,P

eer-

to-p

eer a

nd c

olla

bora

tive

prob

lem

sol

ving

Paw

n: D

esig

n an

d Im

plem

enta

tion

Arc

hite

ctur

eC

ompo

nent

sIn

tera

ctio

nsS

ervi

ces

App

licat

ion

Sce

nario

: Aut

onom

ic o

ptim

izat

ion

of o

il re

serv

oir

sim

ulat

ion

Exp

erim

enta

l eva

luat

ion

Com

mun

icat

ions

Stre

ss te

sts

Cos

ts (m

emor

y +

proc

essi

ng)

Con

clus

ions

and

futu

re w

ork

Page 10: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

10/3

6

Mes

sagi

ng s

yste

ms

4 br

oad

cate

gorie

s of

mes

sagi

ng s

yste

ms Not

for h

igh-

band

wid

th

stre

amin

g of

med

iaA

sync

hron

ous,

Sto

re a

nd

forw

ard

Mes

sage

Orie

nted

M

iddl

ewar

e

Not

for l

oose

ly c

oupl

ed

syst

ems

Imm

edia

te D

eliv

ery

Mes

sage

Pas

sing

Dep

ends

on

Rem

ote

Pro

cess

ing

Tim

eSi

mpl

eR

emot

e P

roce

dure

Cal

ls

Long

Pro

cess

Take

car

e of

eve

ryth

ing

Hig

h Ba

ndw

idth

Raw

Net

wor

kC

ons

Pros

Syst

em

2 br

oad

arch

itect

ures

Poi

nt –

to-p

oint

(e.

g. e

mai

l)

Pub

lishe

r/Sub

scrib

er (m

ailin

g lis

t)

Page 11: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

11/3

6

Mes

sagi

ng m

iddl

ewar

e : p

ublis

h/su

bscr

ibe

syst

ems

MO

Msu

ch a

s {J

ava

Mes

sage

Ser

vice

, IB

M M

QSe

ries,

LeS

ubsc

ribe}

can

:E

mbe

d m

essa

ge tr

ansa

ctio

n m

echa

nism

s in

sim

ple

to u

se A

PI

Pro

vide

flex

ible

del

iver

y an

d tra

nsfe

r gua

rant

ees

Use

que

ues

to s

tore

and

forw

ard

mes

sage

s be

twee

n ho

sts

Per

form

Con

tent

-bas

ed ro

utin

gE

nabl

e ev

ent n

otifi

catio

n ac

ross

WA

NM

essa

ging

for G

rid A

pplic

atio

ns s

uch

as {G

ridR

PC, X

Even

ts/X

Mes

sage

s}

Sup

port

for m

essa

ging

acr

oss

virtu

al o

rgan

izat

ions

P2P

Mes

sagi

ngfo

r Grid

App

licat

ions

suc

h as

Nar

adaB

roke

ring

Wid

e ar

ea e

vent

bro

kerin

g ta

rget

ing

larg

e sc

ale

colla

bora

tions

in e

duca

tion

and

scie

nce

Grid

mid

dlew

are

such

as

ICEN

IE

nabl

es c

ompo

nent

-bas

ed a

pplic

atio

n co

mpo

sitio

n fo

r e-S

cien

ce

Paw

nis

a p

ublis

h/su

bscr

ibe

syst

emC

ombi

nes

prop

ertie

s fro

m m

essa

ging

and

P2P

mes

sagi

ng o

n th

e G

ridto

pro

vide

pu

blis

her/s

ubsc

riber

func

tiona

litie

s (p

ush,

pul

l, re

ques

t/res

pons

e, tr

ansa

ctio

ns).

Focu

ses

on in

tera

ctio

n se

rvic

es to

sup

port

appl

icat

ion

mon

itorin

g an

d st

eerin

g,

colla

bora

tion,

and

app

licat

ion

exec

utio

n on

the

Grid

. E

xten

ds J

XTA

pip

e an

d re

solv

erse

rvic

es to

pro

vide

gua

rant

eed

appl

icat

ion-

leve

l mes

sage

de

liver

y.

Mes

sage

s co

ntai

n st

ate

info

rmat

ion,

that

allo

w th

e sy

stem

to re

cove

r fro

m fa

ilure

.

Page 12: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

12/3

6

P2P

col

labo

rato

ries

requ

irem

ents

Ben

efit

from

a p

eer-

to-p

eer a

rchi

tect

ure

Gro

up fo

rmat

ion

& C

olla

bora

tion

Mes

sagi

ngFl

exib

le d

eliv

ery

and

trans

port

guar

ante

es tr

ansp

aren

t to

the

user

Net

wor

k ar

chite

ctur

e &

Com

mun

icat

ion

mod

els

Syn

chro

nous

com

mun

icat

ion

for r

eal-t

ime

info

rmat

ion

trans

fers

Asy

nchr

onou

s co

mm

unic

atio

ns fo

r sto

ring

info

rmat

ion

whe

n of

fline

But

cer

tain

issu

es re

mai

n op

en p

robl

ems

Sec

urity

and

trus

tD

istri

bute

d da

ta a

rchi

val

Page 13: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

13/3

6

Paw

n O

verv

iew

Pro

vide

s m

essa

ging

mec

hani

sms

to e

nabl

e in

tera

ctio

ns

on th

e G

ridP

rovi

des

publ

ish/

subs

crib

e m

echa

nism

s ac

ross

pee

r-to

-pe

er d

omai

nsB

uild

s hi

gh-le

vel m

essa

ging

sem

antic

s on

top

of lo

w-

leve

l int

erac

tion

mod

aliti

es :

PU

SH

:e.

g. d

ynam

ic d

ata

inje

ctio

nP

ULL

: e.

g. m

onito

ring

RE

QU

ES

T/R

ES

PO

NS

E :

e.g.

dat

a in

terr

ogat

ion

TRA

NS

AC

TIO

N :

e.g.

ste

erin

gFI

LTE

RE

D M

ULT

ICA

ST:

e.g

. gro

up c

olla

bora

tion

Bui

lt on

top

of P

roje

ct J

XTA

Page 14: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

14/3

6

JXTA

: a fr

amew

ork

for p

2p a

pps

SU

N In

trodu

ced

JXTA

in A

pril

2001

M

otiv

atio

n is

pro

vide

d a

com

mon

pla

tform

fo

r p2p

Pro

ject

JX

TA d

efin

es6

Con

cept

s6

core

Pro

toco

lsA

Net

wor

k A

rchi

tect

ure

Com

mun

icat

ion

mod

els

(uni

cast

, pro

paga

te)

Page 15: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

15/3

6

Pro

ject

JX

TA: C

once

pts

Peer A

ny c

ompu

te-c

apab

le d

evic

e th

at “u

nder

stan

ds” a

sub

set o

f the

co

mm

on p

roto

cols

Peer

Gro

upA

gro

up o

f pee

rs th

at s

hare

sim

ilar i

nter

ests

Pipe

Com

mun

icat

ion

chan

nels

bet

wee

n pe

ers

Mod

ule

A g

ener

al b

ehav

ior d

escr

ibed

by

a pe

er o

r a p

eerg

roup

. JX

TA

sepa

rate

s th

e de

finiti

on o

f the

beh

avio

r fro

m it

s im

plem

enta

tion.

Adv

ertis

emen

tA

pub

lishe

d ne

utra

l doc

umen

t [X

ML]

des

crib

ing

a re

sour

ceSe

curit

yU

sing

sec

ure

sock

ets

for e

very

tran

smis

sion

. E

nfor

cing

mem

bers

hip

polic

ies

at e

very

pee

r

Page 16: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

16/3

6P

roje

ct J

XTA

: P

roto

cols

PDP

(Pee

r dis

cove

ry p

roto

col)

: use

d by

pee

rs to

adv

ertis

e th

eir o

wn

reso

urce

sPI

P(P

eer I

nfor

mat

ion

prot

ocol

) :

mon

itorin

g pe

ers

stat

us a

nd lo

adPB

P(P

ipe

Bin

ding

Pro

toco

l) : t

o es

tabl

ish

a vi

rtual

com

mun

icat

ion

chan

nel b

etw

een

peer

sPR

P(P

eer R

esol

ver P

roto

col)

: se

ndin

g an

d re

ceiv

ing

quer

ies

and

resp

onse

sR

VP(R

ende

zvou

s P

roto

col)

: to

prop

agat

e m

essa

ges

in a

pee

r gro

upER

P(E

ndpo

int R

outin

g P

roto

col)

: to

find

rout

es fr

om a

sou

rce

to a

de

stin

atio

n

Page 17: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

17/3

6

From

JX

TA to

Paw

nJX

TA P

rovi

des

core

cap

abili

ties

Publ

icat

ion:

endp

oint

s pu

blis

h un

ique

ly id

entif

ied

mes

sage

s.A

dver

tisem

ent:

Lang

uage

-inde

pend

ent d

ocum

ent d

escr

ibin

g a

reso

urce

C

achi

ng :

RV

pee

rs c

ache

adv

ertis

emen

ts m

ade

by e

very

end

poin

t and

mai

ntai

n co

nsis

tent

repl

icas

.R

outin

g :

path

to d

estin

atio

n is

det

erm

ined

by

the

near

est r

ende

zvou

s pe

erus

ing

the

endp

oint

rout

er p

roto

col

Paw

n ex

tend

s JX

TA to

pro

vide

Dis

trib

uted

obj

ect I

nter

actio

ns o

n to

p of

a p

eer-

to-p

eer s

ubst

rate

Ser

ializ

atio

n of

Obj

ects

to X

ML

stre

ams

Met

hod

invo

catio

n on

rem

ote

obje

cts

[RM

C]

Inte

rest

Sub

scrip

tion

Con

tent

-bas

ed in

form

atio

n di

ssem

inat

ion.

Eve

ry m

essa

ge c

arrie

s m

etad

ata

allo

win

g pe

ers

to re

gist

er in

tere

st o

n an

attr

ibut

e ba

sis.

Page 18: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

18/3

6

Paw

n co

ncep

tual

ove

rvie

w

Paw

n en

able

s an

d de

fines

ev

ery

part

of th

e fig

ure

on th

e rig

ht. T

his

figur

e ca

n be

read

as

:“P

eers

com

pose

mes

sage

s ha

ndle

d by

ser

vice

s th

roug

h sp

ecifi

c in

tera

ctio

n m

odal

ities

Page 19: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

19/3

6

Paw

n : c

ompo

nent

sad

verti

sem

ent

serv

ice

mec

hani

sm

Page 20: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

20/3

6

Paw

n: C

ompo

nent

s

Clie

nt P

eer:

Dep

loy

appl

icat

ions

for m

onito

ring

and

stee

ring

Col

labo

rate

with

oth

er p

eers

Ren

dezv

ous

Pee

rA

ll pe

ers

are

conn

ecte

d to

rend

ezvo

us fo

r dis

cove

ry.

Ren

dezv

ous

cach

e m

essa

ges.

D

ynam

ic m

essa

ge a

ggre

gatio

nA

pplic

atio

n P

eer

Pro

vide

s an

inte

rface

to th

e ap

plic

atio

n co

ntro

lsM

ay a

ct a

s a

prox

y fo

r rel

ayin

g qu

erie

s an

d re

spon

ses

Page 21: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

21/3

6

Paw

n: In

tera

ctio

ns

JXTA

com

mun

icat

ion

enab

led

thro

ugh:

Pip

es Syn

chro

nous

: blo

ckin

gA

sync

hron

ous:

non

blo

ckin

gR

esol

ver

End

-to-E

nd m

essa

ging

TCP

Stre

amD

atag

ram

pac

kets

Fi

ltere

d m

ultic

ast

Gro

up d

istri

butio

n

Paw

n se

rvic

es b

uild

on

thes

e co

mm

unic

atio

n m

echa

nism

s

Page 22: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

22/3

6

Paw

n: S

ervi

ces

App

licat

ion

Exe

cutio

n [A

EX

]S

tart,

sto

p an

d ge

t sta

tus

of A

pplic

atio

nsA

pplic

atio

n M

onito

ring

and

Ste

erin

g [A

MS

]A

pplic

atio

n qu

eryi

ng a

nd m

anag

emen

tA

pplic

atio

n R

untim

e an

d C

ontro

l [A

RC

]P

ublis

hes

appl

icat

ion

resp

onse

s an

d st

atus

Rem

ote

Met

hod

Cal

ls [R

MC

]P

rovi

des

sync

hron

ous/

asyn

chro

nous

RP

C c

alls

in a

pla

tform

an

d la

ngua

ge in

depe

nden

t man

ner

Gro

up c

omm

unic

atio

nH

andl

es te

xt m

essa

ges

betw

een

grou

ps o

f clie

nts

Page 23: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

23/3

6

Paw

n: A

MS

, AE

X, G

roup

com

mun

icat

ion

Ser

vice

s

Bui

ld o

n JX

TA’s

Res

olve

rse

rvic

eX

ML

Mes

sage

s co

ntai

nD

estin

atio

n, s

ourc

e,

appl

icat

ion

id, q

uery

ID,

quer

yTyp

e, u

niqu

e H

andl

er n

ame

Rel

iabi

lity

prov

ided

by

cach

ing

AR

C p

rovi

des

AP

I to

anno

unce

App

licat

ion

send

App

Res

pons

epu

blis

hUpd

ateM

essa

geno

tifyE

ndA

pplic

atio

nA

MS

pro

vide

s A

PI f

orse

ndA

ppR

eque

st

Page 24: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

24/3

6

Paw

n: A

RC

and

RM

C S

ervi

ces

RM

C b

uild

s on

non

-bl

ocki

ng J

XTA

pip

esD

efin

es a

n X

ML

inte

rface

to

the

rem

ote

met

hod

call

Use

s m

essa

ge q

ueue

s fo

r ord

erin

gM

essa

ges

carr

y un

ique

id

entif

iers

to m

aint

ain

cons

iste

nt, c

oord

inat

ed

appl

icat

ion

even

ts

Page 25: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

25/3

6

Sce

nario

: Aut

onom

ic o

il re

serv

oir o

ptim

izat

ion

Page 26: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

26/3

6

Sce

nario

: Act

ors

IPA

RS pa

ralle

l res

ervo

ir si

mul

atio

n fra

mew

ork

IPA

RS

Fact

ory

conf

igur

es in

stan

ces

of IP

AR

S s

imul

atio

nsde

ploy

s th

em o

n re

sour

ces

on th

e G

ridm

anag

es th

eir e

xecu

tion

VFS

A O

ptim

izat

ion

Opt

imiz

e th

e pl

acem

ents

of w

ells

and

the

inpu

ts (p

ress

ure,

tem

pera

ture

) to

IPA

RS

sim

ulat

ions

. E

cono

mic

Mod

elin

g S

ervi

ceU

ses

IPA

RS

sim

ulat

ions

out

puts

and

cur

rent

mar

ket p

aram

eter

s (o

il pr

ices

, cos

ts,

etc.

) to

com

pute

est

imat

ed re

venu

es fo

r a p

artic

ular

rese

rvoi

r con

figur

atio

n.

DIS

CO

VE

R C

lient

Por

tals

Pro

vide

the

expe

rts (s

cien

tists

, eng

inee

rs) w

ith c

olla

bora

tive

acce

ss to

the

othe

r pe

ers.

Page 27: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

27/3

6

Sce

nario

: P

eer D

eplo

ymen

t

Clie

nt a

uthe

ntic

ates

to th

e D

ISC

OV

ER

Ser

ver r

unni

ng G

lobu

sto

olki

t usi

ng G

SI

Onc

e au

then

ticat

ed C

lient

s ca

n de

ploy

IPA

RS

Fact

ory

and

VFS

A

optim

izat

ion

peer

s us

ing

Glo

bus

GR

AM

pro

toco

l on

avai

labl

e m

achi

nes

Page 28: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

28/3

6

Sce

nario

: P

eer D

isco

very

Pee

rs p

ublis

h ad

verti

sem

ents

des

crib

ing

thei

r ide

ntity

and

fu

nctio

nalit

ies

Usi

ng u

nder

lyin

g JX

TA D

isco

very

ser

vice

s, p

eers

dis

cove

r the

ad

verti

sem

ents

and

can

sta

rt in

tera

ctin

g

Page 29: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

29/3

6

Sce

nario

: Opt

imiz

atio

n P

roce

ss

VFS

A s

ends

a w

ell p

ositi

on g

uess

to IP

AR

SFa

ctor

yIP

AR

SFa

ctor

ych

ecks

in D

atab

ase

if gu

ess

has

alre

ady

been

run

If gu

ess

foun

d, re

sult

is re

turn

ed c

lient

s an

d ne

w g

uess

from

VFS

A is

gen

erat

edIf

not f

ound

an

IPA

RS

inst

ance

is ru

nIP

AR

S re

turn

s th

e no

rmal

ized

reve

nue

valu

e to

VFS

A O

ptim

izat

ion

Page 30: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

30/3

6

Sce

nario

: Pro

duct

ion

Run

for M

onito

ring

and

Ste

erin

g

Exp

erts

use

clie

nt p

orta

ls to

col

labo

rativ

ely

conn

ect t

o th

e ru

nnin

g ap

plic

atio

n, fo

r mon

itorin

g an

d st

eerin

g

Page 31: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

31/3

6

Exp

erim

enta

l set

up a

nd h

osts

con

figur

atio

ns

LAN

exp

erim

ents

Hos

ts C

onfig

urat

ions

LAN

Req

uest

/re

spon

se

WA

N25

6MB

Pen

tium

II

350

MH

zLi

nux-

Ker

nel 2

.5.3

1

LAN

&W

AN

256M

BP

entiu

m II

I 75

0 M

Hz

Win

dow

s X

P1

LAN

512M

BP

entiu

m

IV 1

.5

GH

z

Linu

x R

edH

at7.

220

Usa

ge

Mem

ory

Pro

cess

orO

S ty

pe#

of

node

s

WA

N e

xper

imen

ts

Rem

ote

Pee

rR

ende

zvou

s/R

elay

Loca

l Pee

r

LAN

Req

uest

/re

spon

se

Page 32: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

32/3

6

Res

ults

: R

ound

Trip

Tim

e LA

N

Com

mun

icat

ion

Tim

ing

on a

LAN

0

1000

2000

3000

4000

5000

6000

1050

01k

2k10

k50

k10

0k50

0k1M

Mes

sage

Siz

e (B

ytes

)

Time (ms)2

Pee

rs5

Pee

rs10

Pee

rs20

Pee

rs

App

licat

ion

peer

pus

hes

a re

spon

se u

sing

AR

C

20 c

lient

pee

rs a

ckno

wle

dge

the

resp

onse

usi

ng A

MS

The

diffe

renc

e be

twee

n 2

peer

s an

d 20

pee

rs re

mai

ns

cons

iste

nt o

ver t

he v

aryi

ng

mes

sage

siz

es e

valu

ated

The

syst

em is

sca

labl

e

Page 33: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

33/3

6

Res

ults

: Res

pons

e to

load

Com

parin

g co

re

JXTA

rend

ezvo

us to

P

awn

Ren

dezv

ous

usin

g M

essa

ge

Que

ues

Res

ults

sho

w th

at

JXTA

dro

ps

mes

sage

s w

hen

rece

ivin

g ov

er 1

00

sim

ulta

neou

s m

essa

ges

Paw

n us

es a

que

ue

to s

tore

and

sen

d m

essa

ges

Ren

dezv

ous

load

test

in L

AN

0

0.2

0.4

0.6

0.81

1.2

20

40

60

80

100

120

140

160

Num

ber

of M

essa

ges

Ratio of messages receivedJX

TAre

ndez

vous

PAW

Nre

ndez

vous

Page 34: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

34/3

6

Res

ults

: JX

TA p

ipe

and

Paw

n R

emot

e M

etho

d C

all

Paw

n R

emot

e M

etho

d C

all f

unct

iona

lity

adds

ov

erhe

ad to

cor

e JX

TA

pipe

s

This

tim

e ov

erhe

ad is

as

soci

ated

to th

e tim

e sp

ent i

n th

e re

mot

e ca

ll an

d th

e tim

e to

mar

shal

an

d un

mar

shal

the

invo

ked

mes

sage

s.

Ove

rhea

d of

PAW

N fo

r syn

chro

nous

co

mm

unic

atio

n

0

1000

2000

3000

4000

510

1520

2530

Num

ber o

f Syn

chro

nous

M

essa

ges

Round Trip Time (ms)

JXTA

Pip

es

PA

WN

Rem

ote

Met

hod

Cal

l

Page 35: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

35/3

6

Res

ults

: Mem

ory

Add

ition

al s

ervi

ces

do n

ot a

dd s

ever

e ov

erhe

ad

com

pare

d to

cor

e JX

TA lo

ad in

m

emor

y

Not

e th

at C

lient

ov

erhe

ad is

due

to

load

ing

the

porta

l gr

aphi

cal

com

pone

nts

JXTA

+PAW

N m

emor

y re

quire

men

ts

2525

3035

45

05101520253035404550

Peer

Typ

e

Size (MB)JX

TA C

ore

Rend

ezV

ous

Peer

PAW

N Ip

ars

Fact

ory

[Rem

ote

Met

hod

Call]

PAW

N A

ppSe

rver

[AEX

,Rem

ote

Met

hod

Call]

PAW

N Cl

ient

[AM

S,A

RC,C

olla

bora

tion]

Page 36: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

36/3

6

Con

clus

ions

and

futu

re w

ork

Col

labo

rato

ries

requ

ire P

2P m

essa

ging

in o

rder

to

sca

le a

nd b

e tru

ly d

ynam

icP

awn

is a

p2p

mes

sagi

ng th

at p

rovi

des

inte

ract

ion

for m

onito

ring

and

stee

ring

Pre

sent

ed d

esig

n re

quire

men

ts in

term

s of

se

rvic

es a

nd m

echa

nism

sP

rese

nted

the

use

of P

awn

for t

he o

il re

serv

oir

optim

izat

ion

proc

ess

We

are

look

ing

at e

xten

ding

this

initi

al e

ffort

tow

ards

an

auto

nom

ic c

ompu

ting

fram

ewor

k

Page 37: Pawn: Enabling Peer-to-Peer Interactions on the Grid The ... · Pawn: Enabling Peer-to-Peer Interactions on the Grid Vincent Matossian Spring 2003 The Applied Software Systems Laboratory.

Vin

cent

Mat

ossi

an 2

003

37/3

6

web

link

s

Paw

n’s

web

pag

e ht

tp://

ww

w.c

aip.

rutg

ers.

edu/

~vin

cent

m/P

awn

Pro

ject

JX

TAht

tp://

ww

w.jx

ta.o

rgO

’Rei

lly p

2p w

eb s

iteht

tp://

ww

w.o

penp

2p.c

omB

rend

onW

ilson

’s b

ook

on J

XTA

http

://w

ww

.bre

ndon

wils

on.c

om