Download - Active Monitoring in GRID environments using Mobile Agent technology Orazio Tomarchio Andrea Calvagna Dipartimento di Ingegneria Informatica e delle Telecomunicazioni.

Transcript

Active Monitoring in GRID environments using

Mobile Agent technology

Orazio Tomarchio

Andrea CalvagnaDipartimento di Ingegneria Informatica e delle Telecomunicazioni

Università di Catania (ITALY)

[email protected]

[email protected]

Outline

Monitoring Grid systems Mobile agents paradigms Mobile agents and monitoring MAP: a mobile agents platform Architecture description Conclusions

Grid Monitoring

The capability of monitoring distributed computational resources effectively is a crucial factor for high-performance distributed computation

As distributed systems become bigger, and more widely distributed, automating the operations of monitoring becomes very important.

Grid Monitoring

Why is monitoring important?

to find the cause of performance problems for tuning systems parameters in order to optimize

resource usage fault detection to build prediction models of performance

(used by sophisticated scheduling algorithms) for billing and accounting

Grid Monitoring

What are the problems to deal with?

Wasting of resources dedicated to monitoring purposes

ScalabilityPossibility to start monitoring application on-demandPossibility to customize monitoring strategiesDifferent metrics of measurement data

Grid Monitoring with Agents

Mobile code and agents: basic assumptions and characteristics

Key issues for using mobile agents technology in the monitoring context

Mobile Code

The basic idea is allowing to move code to remote sites and execute transferred code there

problems arising from mobility, e.g. heterogeneity of systems security (as more parties are involved)

Programming paradigms based on mobile code can be divided according to initiator of code transfer

Programming paradigms based on code mobility

Client Server

Client/server

local resources

Client Server

Code on Demand Mobile Agents

local resources

local resources

Client Server

Remote evaluation

local resources

Mobile AgentsMobile Agents are program instances that are able

move within a network under their own controlmobile agents consist of:

code data state (i.e. variables) execution state (i.e. stack)

Some basic capabilities: able to autonomously migrate between places able to communicate to each other some agents offer services or interfaces to legacy

applications

Application Areas for Mobile Agents

Distributed Information RetrievalMobile computingDistributed Network ManagementCollaborative and workflow applicationsActive networksElectronic commerce

• Grid monitoring (?)

Grid Monitoring with agents: key issues

Customizable algorithms of data analysis dinamically executed on-demand by the user

Reduction of network loadFiltering of monitoring data at several abstraction

level without high overheads for the systemAsynchronous and indipendent execution of task Integration of heterogeneous resource monitoring

toolsOn-demand enabling of necessary services

MAP: a Mobile Agent Platformhttp://sun195.iit.unict.it/MAP/

MAP is a software platform for the development and the management of mobile agents.

Its main characteristics are: It provides an environment in which agents can execute,

stop and resume their execution, communicate among them, move on other nodes on the network

It is entirely developed using the Java language, which provides total architecture independence

The platform also provides different programming paradigms for distributed systems, such as remote evaluation and code on demand

In the latest version it has been made MASIF compliant

MAP architecture

MAPServer

MAPServer

RegionRegistrator

Region

MAPServer

MAPServer

RegionRegistrator

Region

DynamicNetwork

Class Loading

CommunicationInterface

Context

Agents

Graphic interface for agents’ control and management

Main features of MAP

Key features of MAP relevant for Grid systems are:

security interoperability with different agents’ systems

Monitoring with agents: System Architecture

DirectoryService

Agent CacheRepository

PerformanceData Repository

Other Agents

MonitoringApplication

Resource

LocalMonitoringApplication

High-LevelMonitoring Agents

HLMAgents

Sensor Agents

Low-Level SensorsLLSensors

LLSManager

Monitoring with agents: Basic components

Low-Level sensors (LLSensors)SensorAgentsHigh-Level Monitoring Agents (HLMAgents)

Low-Level Sensor Manager (LLSManager)Directory ServicePerformance Data RepositoryAgent Cache Repository

Monitoring with agents: Basic components

Low-Level sensors (LLSensors)

they are not agents (in general) specific for each resourcedirectly interfaced with resources

The Low-Level Sensor Manager deals with their registration in the Directory Service

Monitoring with agents: Basic components

Sensor AgentsThey use the data supplied by the LLSensors for

providing uniform informations about the state of a resource

Resources taken into account include: hosts network storage process/applications

Monitoring with agents: Basic components

High-Level Monitoring Agents (HLMAgents)

Their task is gathering significant information relying on all the agents present in the system

user or application initiated(e.g. CollectSensorAgent, AggregateAgent)

event-initiated(e.g. TrapAgent)

Monitoring with agents: Basic components

Directory Service

Basically the Directory Service maintains informations on what kind of Sensors are available for the different resources.

Monitoring with agents: Basic components

Performance Data Repository to store the events and data recorded by LLSensors and

SensorAgents

Agent Cache Repository a repository of agents that have been executed within the

region

Piano temporale attività

People 2 persone al 30%

• Orazio Tomarchio

• Andrea Calvagna

Piano temporale attivitàTasks

task 1 M0-M1 Evaluation of mobile agent technology for Grid network

monitoring

task 2 M0-M2 Use and testing of MAP (Mobile Agent Platform) in a Grid environment (eventually adapt it to new requirements imposed by geographically dispersed environment)

task 3 M1-M4 Definition of a base architecture for monitoring networks using mobile agents

Piano temporale attivitàTasks

task 4 M2-M3 Evaluation of this approach against more traditional approach

task 5 M4-M9 Integration/Interfacing the agent platform with existing low-level tools for gathering network informations.

task 6 M4-M12 Implementation of the proposed approach and experimental measurements and validations.