Interoperability Architecture for Grid Networks Monitoring Systems

94
www.cs.agh.edu.pl Interoperability Architecture for Grid Networks Monitoring Systems Need for interoperability in grid networks monitoring systems: Monitored data interchange between clusters and monitoring applications running in different platforms (UNIX, Windows), Exposing one common interface and physical address where data can be obtained. Introducti on •SOAP Gateway concept •Design and configurati on •Performanc e •Conclusion •References Kazimierz Bałos Cracow Grid Workshop 2003

description

Interoperability Architecture for Grid Networks Monitoring Systems. Need for interoperability in grid networks monitoring systems: Monitored data interchange between clusters and monitoring applications running in different platforms (UNIX, Windows), - PowerPoint PPT Presentation

Transcript of Interoperability Architecture for Grid Networks Monitoring Systems

Page 1: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Interoperability Architecture for Grid Networks Monitoring Systems

Need for interoperability in grid networks monitoring systems:

• Monitored data interchange between clusters andmonitoring applications running in different platforms (UNIX, Windows),

• Exposing one common interface and physical address where data can be obtained.

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Kazimierz Bałos

Cracow Grid Workshop

2003

Page 2: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Possible solution – access through RMI

GRID NETWORK JIMS – JMX Infrastructure Monitoring System WORKER NODE – cluster computing element DOMAIN NODE – cluster user interface

WORKER NODE

JIMS

WORKER NODE

JIMS

WORKER NODE

JIMS

CLUSTER

RMI RMI RMI

WORKER NODE

JIMS

WORKER NODE

JIMS

WORKER NODE

JIMS

CLUSTER

RMI RMI RMI

LA

N N

ET

WO

RK

LA

YE

R

CL

IEN

T

LA

YE

R

CLIENT APPLICATION

RMI CLIENT

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 3: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Adding interoperability layer, SOAP Gateway

GRID NETWORK JIMS – JMX Infrastructure Monitoring System WORKER NODE – cluster computing element DOMAIN NODE – cluster user interface

WORKER NODE

JIMS

WORKER NODE

JIMS

WORKER NODE

JIMS

DOMAIN NODE

SOAP GATEWAY

CLUSTER

RMI RMI RMI

WORKER NODE

JIMS

WORKER NODE

JIMS

WORKER NODE

JIMS

DOMAIN NODE

SOAP GATEWAY

CLUSTER

RMI RMI RMI

INT

ER

OP

ER

AB

ILIT

Y L

AY

ER

L

AN

NE

TW

OR

K L

AY

ER

C

LIE

NT

L

AY

ER

CLIENT APPLICATION

SOAP GATEWAY CLIENT

SOAP SOAP

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 4: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

SOAP Gateway design

EMBEDDED MBEAN SERVER

SOAP GATEWAY

l EMBEDDED MBEAN SERVER

DISCOVERY CLIENT (ACTIVE DISCOVERY)

MBEAN SERVERS MANAGER

ACTIVE DISCOVERY THREAD

REMOTE MBEAN SERVER

DISCOVERY RESPONDER (ACTIVE DISCOVERY)

IMPLEMENTATION: 1. SOAP GATEWAY - WEB SERVICE 2. EMBEDDED MBS - JMX MBEAN SERVER 3. DISCOVERY - JMX BASED DISCOVERY MECHANISM 4. MBS MANAGER - PERSISTENT JAVA OBJECT FOR REMOTE MBEAN SERVERS REGISTERING

SOAP GATEWAY WEB SERVICE

SOAP GATEWAY SERIALIZER

SYSTINET WASP SERVER (WEB SERVICES CONTAINER

SYSTEM INFORMATION MBEAN

SNMP MONITOR MBEAN

REMOTE STATION

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 5: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Design and configuration

Scope of technologies used in SOAP Gateway design:

• JMX MBean servers as proxies for monitored stations, accessing system information data through native interface and network information through SNMP agents,

• Active discovery and Heartbeat mechanisms for dynamic SOAP Gateway configuration,

• WebServices container with SOAP Gateway service acting as proxy between MBean servers in monitored stations and remote clients connecting through SOAP protocol

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 6: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests

Performance tests objectives:

• Identifying bottlenecks,

• Providing design patterns for developers as well as usage patterns for end users to improve performance in cooperating applications.

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 7: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 1

Objective: test all JIMS stations independently•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

JIMS – JMX Infrastructure Monitoring System WORKER NODE – cluster computing element DOMAIN NODE – cluster user interface

WORKER NODE

JIMS

WORKER NODE

JIMS

WORKER NODE

JIMS

DOMAIN NODE

SOAP GATEWAY

CLUSTER

RMI

INTEROPERABILITY LAYER LAN NETWORK LAYER CLIENT LAYER

CLIENT APPLICATION

SOAP GATEWAY CLIENT

SOAP WORKER NODE

JIMS

WORKER NODE

JIMS

WASP SERVER

Page 8: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 1

Objective: test all JIMS stations independently•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

JIMS – JMX Infrastructure Monitoring System WORKER NODE – cluster computing element DOMAIN NODE – cluster user interface

WORKER NODE

JIMS

WORKER NODE

JIMS

WORKER NODE

JIMS

DOMAIN NODE

SOAP GATEWAY

CLUSTER

RMI

INTEROPERABILITY LAYER LAN NETWORK LAYER CLIENT LAYER

CLIENT APPLICATION

SOAP GATEWAY CLIENT

SOAP WORKER NODE

JIMS

WORKER NODE

JIMS

WASP SERVER

Page 9: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 1

Objective: test all JIMS stations independently•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

JIMS – JMX Infrastructure Monitoring System WORKER NODE – cluster computing element DOMAIN NODE – cluster user interface

WORKER NODE

JIMS

WORKER NODE

JIMS

WORKER NODE

JIMS

DOMAIN NODE

SOAP GATEWAY

CLUSTER

RMI

INTEROPERABILITY LAYER LAN NETWORK LAYER CLIENT LAYER

CLIENT APPLICATION

SOAP GATEWAY CLIENT

SOAP WORKER NODE

JIMS

WORKER NODE

JIMS

WASP SERVER

Page 10: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 1

Objective: test all JIMS stations independently•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

JIMS – JMX Infrastructure Monitoring System WORKER NODE – cluster computing element DOMAIN NODE – cluster user interface

WORKER NODE

JIMS

WORKER NODE

JIMS

WORKER NODE

JIMS

DOMAIN NODE

SOAP GATEWAY

CLUSTER

RMI

INTEROPERABILITY LAYER LAN NETWORK LAYER CLIENT LAYER

CLIENT APPLICATION

SOAP GATEWAY CLIENT

SOAP WORKER NODE

JIMS

WORKER NODE

JIMS

WASP SERVER

Page 11: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 1

Objective: test all JIMS stations independently•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

JIMS – JMX Infrastructure Monitoring System WORKER NODE – cluster computing element DOMAIN NODE – cluster user interface

WORKER NODE

JIMS

WORKER NODE

JIMS

WORKER NODE

JIMS

DOMAIN NODE

SOAP GATEWAY

CLUSTER

RMI

INTEROPERABILITY LAYER LAN NETWORK LAYER CLIENT LAYER

CLIENT APPLICATION

SOAP GATEWAY CLIENT

SOAP WORKER NODE

JIMS

WORKER NODE

JIMS

WASP SERVER

Page 12: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 1

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 13: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 2

Objective: test all JIMS stations independently, repeating request 1 ... 100times

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

JIMS – JMX Infrastructure Monitoring System WORKER NODE – cluster computing element DOMAIN NODE – cluster user interface

WORKER NODE

JIMS

WORKER NODE

JIMS

WORKER NODE

JIMS

DOMAIN NODE

SOAP GATEWAY

CLUSTER

RMI

INTEROPERABILITY LAYER LAN NETWORK LAYER CLIENT LAYER

CLIENT APPLICATION

SOAP GATEWAY CLIENT

SOAP WORKER NODE

JIMS

WORKER NODE

JIMS

WASP SERVER x 1 ... 100

x 1 ... 100

Page 14: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 2

Objective: test all JIMS stations independently, repeating request 1 ... 100times

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

JIMS – JMX Infrastructure Monitoring System WORKER NODE – cluster computing element DOMAIN NODE – cluster user interface

WORKER NODE

JIMS

WORKER NODE

JIMS

WORKER NODE

JIMS

DOMAIN NODE

SOAP GATEWAY

CLUSTER

RMI

INTEROPERABILITY LAYER LAN NETWORK LAYER CLIENT LAYER

CLIENT APPLICATION

SOAP GATEWAY CLIENT

SOAP WORKER NODE

JIMS

WORKER NODE

JIMS

WASP SERVER x 1 ... 100

x 1 ... 100

Page 15: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 2

Objective: test all JIMS stations independently, repeating request 1 ... 100times

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

JIMS – JMX Infrastructure Monitoring System WORKER NODE – cluster computing element DOMAIN NODE – cluster user interface

WORKER NODE

JIMS

WORKER NODE

JIMS

WORKER NODE

JIMS

DOMAIN NODE

SOAP GATEWAY

CLUSTER

RMI

INTEROPERABILITY LAYER LAN NETWORK LAYER CLIENT LAYER

CLIENT APPLICATION

SOAP GATEWAY CLIENT

SOAP

WORKER NODE

JIMS

WORKER NODE

JIMS

WASP SERVER

x 1 ... 100

x 1 ... 100

Page 16: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 2

Objective: test all JIMS stations independently, repeating request 1 ... 100times

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

JIMS – JMX Infrastructure Monitoring System WORKER NODE – cluster computing element DOMAIN NODE – cluster user interface

WORKER NODE

JIMS

WORKER NODE

JIMS

WORKER NODE

JIMS

DOMAIN NODE

SOAP GATEWAY

CLUSTER

RMI

INTEROPERABILITY LAYER LAN NETWORK LAYER CLIENT LAYER

CLIENT APPLICATION

SOAP GATEWAY CLIENT

SOAP

WORKER NODE

JIMS

WORKER NODE

JIMS

WASP SERVER

x 1 ... 100

x 1 ... 100

Page 17: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 2

Objective: test all JIMS stations independently, repeating request 1 ... 100times

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

JIMS – JMX Infrastructure Monitoring System WORKER NODE – cluster computing element DOMAIN NODE – cluster user interface

WORKER NODE

JIMS

WORKER NODE

JIMS

WORKER NODE

JIMS

DOMAIN NODE

SOAP GATEWAY

CLUSTER

RMI

INTEROPERABILITY LAYER LAN NETWORK LAYER CLIENT LAYER

CLIENT APPLICATION

SOAP GATEWAY CLIENT

SOAP

WORKER NODE

JIMS

WORKER NODE

JIMS

WASP SERVER

x 1 ... 100

x 1 ... 100

Page 18: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 2

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

MBS 1

Page 19: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 2

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

MBS 2

Page 20: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 2

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

MBS 3

Page 21: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 2

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

MBS 4

Page 22: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 2

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

MBS 5

Page 23: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 2

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

MBS 6

Page 24: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 2

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

MBS 7

Page 25: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 2

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

MBS 8

Page 26: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 2

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

MBS 9

Page 27: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 2

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

MBS 10

Page 28: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 2

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

MBS 11

Page 29: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 2

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

MBS 12

Page 30: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 2

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

MBS 13

Page 31: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 2

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

MBS 14

Page 32: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 2

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Average time

Page 33: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 3

Objective: test all JIMS stations independently, increasing attributes count from 1 ... 28 ( 28 – all attributes for SystemInformation MBean)

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

JIMS – JMX Infrastructure Monitoring System WORKER NODE – cluster computing element DOMAIN NODE – cluster user interface

WORKER NODE

JIMS

WORKER NODE

JIMS

WORKER NODE

JIMS

DOMAIN NODE

SOAP GATEWAY

CLUSTER

RMI

INTEROPERABILITY LAYER LAN NETWORK LAYER CLIENT LAYER

CLIENT APPLICATION

SOAP GATEWAY CLIENT

SOAP WORKER NODE

JIMS

WORKER NODE

JIMS

WASP SERVER 1...28 attributes

1...28 attributes

Page 34: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 3

Objective: test all JIMS stations independently, increasing attributes count from 1 ... 28 ( 28 – all attributes for SystemInformation Mbean)

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

JIMS – JMX Infrastructure Monitoring System WORKER NODE – cluster computing element DOMAIN NODE – cluster user interface

WORKER NODE

JIMS

WORKER NODE

JIMS

WORKER NODE

JIMS

DOMAIN NODE

SOAP GATEWAY

CLUSTER

RMI

INTEROPERABILITY LAYER LAN NETWORK LAYER CLIENT LAYER

CLIENT APPLICATION

SOAP GATEWAY CLIENT

SOAP WORKER NODE

JIMS

WORKER NODE

JIMS

WASP SERVER 1...28 attributes

1...28 attributes

Page 35: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 3

Objective: test all JIMS stations independently, increasing attributes count from 1 ... 28 ( 28 – all attributes for SystemInformation Mbean)

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

JIMS – JMX Infrastructure Monitoring System WORKER NODE – cluster computing element DOMAIN NODE – cluster user interface

WORKER NODE

JIMS

WORKER NODE

JIMS

WORKER NODE

JIMS

DOMAIN NODE

SOAP GATEWAY

CLUSTER

RMI

INTEROPERABILITY LAYER LAN NETWORK LAYER CLIENT LAYER

CLIENT APPLICATION

SOAP GATEWAY CLIENT

SOAP WORKER NODE

JIMS

WORKER NODE

JIMS

WASP SERVER 1...28 attributes

1...28 attributes

Page 36: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 3

Objective: test all JIMS stations independently, increasing attributes count from 1 ... 28 ( 28 – all attributes for SystemInformation Mbean)

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

JIMS – JMX Infrastructure Monitoring System WORKER NODE – cluster computing element DOMAIN NODE – cluster user interface

WORKER NODE

JIMS

WORKER NODE

JIMS

WORKER NODE

JIMS

DOMAIN NODE

SOAP GATEWAY

CLUSTER

RMI

INTEROPERABILITY LAYER LAN NETWORK LAYER CLIENT LAYER

CLIENT APPLICATION

SOAP GATEWAY CLIENT

SOAP WORKER NODE

JIMS

WORKER NODE

JIMS

WASP SERVER 1...28 attributes

1...28 attributes

Page 37: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 3

Objective: test all JIMS stations independently, increasing attributes count from 1 ... 28 ( 28 – all attributes for SystemInformation Mbean)

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

JIMS – JMX Infrastructure Monitoring System WORKER NODE – cluster computing element DOMAIN NODE – cluster user interface

WORKER NODE

JIMS

WORKER NODE

JIMS

WORKER NODE

JIMS

DOMAIN NODE

SOAP GATEWAY

CLUSTER

RMI

INTEROPERABILITY LAYER LAN NETWORK LAYER CLIENT LAYER

CLIENT APPLICATION

SOAP GATEWAY CLIENT

SOAP WORKER NODE

JIMS

WORKER NODE

JIMS

WASP SERVER 1...28 attributes

1...28 attributes

Page 38: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 3

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

MBS 1

Page 39: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 3

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

MBS 2

Page 40: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 3

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

MBS 3

Page 41: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 3

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

MBS 4

Page 42: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 3

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

MBS 5

Page 43: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 3

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

MBS 6

Page 44: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 3

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

MBS 7

Page 45: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 3

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

MBS 8

Page 46: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 3

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

MBS 9

Page 47: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 3

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

MBS 10

Page 48: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 3

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

MBS 11

Page 49: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 3

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

MBS 12

Page 50: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 3

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

MBS 13

Page 51: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 3

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

MBS 14

Page 52: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 3

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Average time

Page 53: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 4

Objective: test all JIMS stations with many threads accessing different MBean servers

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

JIMS – JMX Infrastructure Monitoring System WORKER NODE – cluster computing element DOMAIN NODE – cluster user interface

WORKER NODE

JIMS

WORKER NODE

JIMS

WORKER NODE

JIMS

DOMAIN NODE

SOAP GATEWAY

CLUSTER

RMI

INTEROPERABILITY LAYER LAN NETWORK LAYER CLIENT LAYER

CLIENT APPLICATION

SOAP GATEWAY CLIENT

SOAP WORKER NODE

JIMS

WORKER NODE

JIMS

WASP SERVER

Page 54: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 4

Objective: test all JIMS stations with many threads accessing different MBean servers

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

JIMS – JMX Infrastructure Monitoring System WORKER NODE – cluster computing element DOMAIN NODE – cluster user interface

WORKER NODE

JIMS

WORKER NODE

JIMS

WORKER NODE

JIMS

DOMAIN NODE

SOAP GATEWAY

CLUSTER

RMI

INTEROPERABILITY LAYER LAN NETWORK LAYER CLIENT LAYER

CLIENT APPLICATION

SOAP GATEWAY CLIENT

SOAP WORKER NODE

JIMS

WORKER NODE

JIMS

WASP SERVER

Page 55: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 4

Objective: test all JIMS stations with many threads accessing different MBean servers

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

JIMS – JMX Infrastructure Monitoring System WORKER NODE – cluster computing element DOMAIN NODE – cluster user interface

WORKER NODE

JIMS

WORKER NODE

JIMS

WORKER NODE

JIMS

DOMAIN NODE

SOAP GATEWAY

CLUSTER

RMI

INTEROPERABILITY LAYER LAN NETWORK LAYER CLIENT LAYER

CLIENT APPLICATION

SOAP GATEWAY CLIENT

SOAP WORKER NODE

JIMS

WORKER NODE

JIMS

WASP SERVER

Page 56: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 4

Objective: test all JIMS stations with many threads accessing different MBean servers

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

JIMS – JMX Infrastructure Monitoring System WORKER NODE – cluster computing element DOMAIN NODE – cluster user interface

WORKER NODE

JIMS

WORKER NODE

JIMS

WORKER NODE

JIMS

DOMAIN NODE

SOAP GATEWAY

CLUSTER

RMI

INTEROPERABILITY LAYER LAN NETWORK LAYER CLIENT LAYER

CLIENT APPLICATION

SOAP GATEWAY CLIENT

SOAP WORKER NODE

JIMS

WORKER NODE

JIMS

WASP SERVER

Page 57: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 4

Objective: test all JIMS stations with many threads accessing different MBean servers

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

JIMS – JMX Infrastructure Monitoring System WORKER NODE – cluster computing element DOMAIN NODE – cluster user interface

WORKER NODE

JIMS

WORKER NODE

JIMS

WORKER NODE

JIMS

DOMAIN NODE

SOAP GATEWAY

CLUSTER

RMI

INTEROPERABILITY LAYER LAN NETWORK LAYER CLIENT LAYER

CLIENT APPLICATION

SOAP GATEWAY CLIENT

SOAP WORKER NODE

JIMS

WORKER NODE

JIMS

WASP SERVER

Page 58: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 4

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 59: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 4

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 60: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 4

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 61: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 4

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 62: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 4

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 63: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 4

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 64: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 4

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 65: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 4

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 66: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 4

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 67: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 4

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 68: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 4

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 69: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 4

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 70: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 4

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 71: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 4

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 72: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 4

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Access time for oneMBean server

Page 73: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 5

Objective: test all JIMS stations with many threads accessing the same MBean server

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

JIMS – JMX Infrastructure Monitoring System WORKER NODE – cluster computing element DOMAIN NODE – cluster user interface

WORKER NODE

JIMS

WORKER NODE

JIMS

WORKER NODE

JIMS

DOMAIN NODE

SOAP GATEWAY

CLUSTER

RMI

INTEROPERABILITY LAYER LAN NETWORK LAYER CLIENT LAYER

CLIENT APPLICATION

SOAP GATEWAY CLIENT

SOAP WORKER NODE

JIMS

WORKER NODE

JIMS

WASP SERVER

Page 74: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 5

Objective: test all JIMS stations with many threads accessing the same MBean server

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

JIMS – JMX Infrastructure Monitoring System WORKER NODE – cluster computing element DOMAIN NODE – cluster user interface

WORKER NODE

JIMS

WORKER NODE

JIMS

WORKER NODE

JIMS

DOMAIN NODE

SOAP GATEWAY

CLUSTER

RMI

INTEROPERABILITY LAYER LAN NETWORK LAYER CLIENT LAYER

CLIENT APPLICATION

SOAP GATEWAY CLIENT

SOAP WORKER NODE

JIMS

WORKER NODE

JIMS

WASP SERVER

Page 75: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 5

Objective: test all JIMS stations with many threads accessing the same MBean server

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

JIMS – JMX Infrastructure Monitoring System WORKER NODE – cluster computing element DOMAIN NODE – cluster user interface

WORKER NODE

JIMS

WORKER NODE

JIMS

WORKER NODE

JIMS

DOMAIN NODE

SOAP GATEWAY

CLUSTER

RMI

INTEROPERABILITY LAYER LAN NETWORK LAYER CLIENT LAYER

CLIENT APPLICATION

SOAP GATEWAY CLIENT

SOAP WORKER NODE

JIMS

WORKER NODE

JIMS

WASP SERVER

Page 76: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 5

Objective: test all JIMS stations with many threads accessing the same MBean server

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

JIMS – JMX Infrastructure Monitoring System WORKER NODE – cluster computing element DOMAIN NODE – cluster user interface

WORKER NODE

JIMS

WORKER NODE

JIMS

WORKER NODE

JIMS

DOMAIN NODE

SOAP GATEWAY

CLUSTER

RMI

INTEROPERABILITY LAYER LAN NETWORK LAYER CLIENT LAYER

CLIENT APPLICATION

SOAP GATEWAY CLIENT

SOAP WORKER NODE

JIMS

WORKER NODE

JIMS

WASP SERVER

Page 77: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 5

Objective: test all JIMS stations with many threads accessing the same MBean server

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

JIMS – JMX Infrastructure Monitoring System WORKER NODE – cluster computing element DOMAIN NODE – cluster user interface

WORKER NODE

JIMS

WORKER NODE

JIMS

WORKER NODE

JIMS

DOMAIN NODE

SOAP GATEWAY

CLUSTER

RMI

INTEROPERABILITY LAYER LAN NETWORK LAYER CLIENT LAYER

CLIENT APPLICATION

SOAP GATEWAY CLIENT

SOAP WORKER NODE

JIMS

WORKER NODE

JIMS

WASP SERVER

Page 78: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 5

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 79: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 5

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 80: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 5

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 81: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 5

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 82: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 5

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 83: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 5

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 84: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 5

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 85: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 5

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 86: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 5

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 87: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 5

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 88: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 5

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 89: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 5

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 90: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 5

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 91: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 5

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 92: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Performance tests – test scenario nr 5

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Access time for oneMBean server

Page 93: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

Conclusion

Designed architecture and performed tests assure that:

• Layer of interoperability doesn’t become a bottleneck in distributed environment with acceptable overhead comparing to RMI access

• Layer with gateways using SOAP protocol is suitable for WAN networks, where there should be used one, standardized and efficient protocol for applications written in Java and other languages, including C, C++ and Perl.

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References

Page 94: Interoperability Architecture for Grid Networks Monitoring Systems

www.cs.agh.edu.pl

References

1. Leszek Bizon, Michał Rozenau, Zastosowanie Web Services w integracji systemów informatycznych, Kraków, czerwiec 2003

2. Visible Progress Technologies Limited , Software Performance Testing Considerations, http://www.visibleprogress.com/software_performance_t esting.htm

3. David H Bailey , Performance Metrics: Out of the Dark Ages, Berkeley Lab

4. Jae II Jung, Grid Network Monitoring, Multimedia Networking Laboratories, Hanyang University, KRnet 2003

5. Sun Microsystems, JMX Specification, version 1,26. Sun Microsystems, JMX Remote Api Specification,

version 1.27. Sun Microsystems, J2EE Core Patterns

•Introduction

•SOAP Gateway concept

•Design and configuration

•Performance

•Conclusion

•References