Active Monitoring in GRID environments using
Mobile Agent technology
Orazio Tomarchio
Andrea CalvagnaDipartimento di Ingegneria Informatica e delle Telecomunicazioni
Università di Catania (ITALY)
Outline
Monitoring Grid systems Mobile agents paradigms Mobile agents and monitoring MAP: a mobile agents platform Architecture description Conclusions
Grid Monitoring
The capability of monitoring distributed computational resources effectively is a crucial factor for high-performance distributed computation
As distributed systems become bigger, and more widely distributed, automating the operations of monitoring becomes very important.
Grid Monitoring
Why is monitoring important?
to find the cause of performance problems for tuning systems parameters in order to optimize
resource usage fault detection to build prediction models of performance
(used by sophisticated scheduling algorithms) for billing and accounting
Grid Monitoring
What are the problems to deal with?
Wasting of resources dedicated to monitoring purposes
ScalabilityPossibility to start monitoring application on-demandPossibility to customize monitoring strategiesDifferent metrics of measurement data
Grid Monitoring with Agents
Mobile code and agents: basic assumptions and characteristics
Key issues for using mobile agents technology in the monitoring context
Mobile Code
The basic idea is allowing to move code to remote sites and execute transferred code there
problems arising from mobility, e.g. heterogeneity of systems security (as more parties are involved)
Programming paradigms based on mobile code can be divided according to initiator of code transfer
Programming paradigms based on code mobility
Client Server
Client/server
local resources
Client Server
Code on Demand Mobile Agents
local resources
local resources
Client Server
Remote evaluation
local resources
Mobile AgentsMobile Agents are program instances that are able
move within a network under their own controlmobile agents consist of:
code data state (i.e. variables) execution state (i.e. stack)
Some basic capabilities: able to autonomously migrate between places able to communicate to each other some agents offer services or interfaces to legacy
applications
Application Areas for Mobile Agents
Distributed Information RetrievalMobile computingDistributed Network ManagementCollaborative and workflow applicationsActive networksElectronic commerce
• Grid monitoring (?)
Grid Monitoring with agents: key issues
Customizable algorithms of data analysis dinamically executed on-demand by the user
Reduction of network loadFiltering of monitoring data at several abstraction
level without high overheads for the systemAsynchronous and indipendent execution of task Integration of heterogeneous resource monitoring
toolsOn-demand enabling of necessary services
MAP: a Mobile Agent Platformhttp://sun195.iit.unict.it/MAP/
MAP is a software platform for the development and the management of mobile agents.
Its main characteristics are: It provides an environment in which agents can execute,
stop and resume their execution, communicate among them, move on other nodes on the network
It is entirely developed using the Java language, which provides total architecture independence
The platform also provides different programming paradigms for distributed systems, such as remote evaluation and code on demand
In the latest version it has been made MASIF compliant
MAP architecture
MAPServer
MAPServer
RegionRegistrator
Region
MAPServer
MAPServer
RegionRegistrator
Region
DynamicNetwork
Class Loading
CommunicationInterface
Context
Agents
Main features of MAP
Key features of MAP relevant for Grid systems are:
security interoperability with different agents’ systems
Monitoring with agents: System Architecture
DirectoryService
Agent CacheRepository
PerformanceData Repository
Other Agents
MonitoringApplication
Resource
LocalMonitoringApplication
High-LevelMonitoring Agents
HLMAgents
Sensor Agents
Low-Level SensorsLLSensors
LLSManager
Monitoring with agents: Basic components
Low-Level sensors (LLSensors)SensorAgentsHigh-Level Monitoring Agents (HLMAgents)
Low-Level Sensor Manager (LLSManager)Directory ServicePerformance Data RepositoryAgent Cache Repository
Monitoring with agents: Basic components
Low-Level sensors (LLSensors)
they are not agents (in general) specific for each resourcedirectly interfaced with resources
The Low-Level Sensor Manager deals with their registration in the Directory Service
Monitoring with agents: Basic components
Sensor AgentsThey use the data supplied by the LLSensors for
providing uniform informations about the state of a resource
Resources taken into account include: hosts network storage process/applications
Monitoring with agents: Basic components
High-Level Monitoring Agents (HLMAgents)
Their task is gathering significant information relying on all the agents present in the system
user or application initiated(e.g. CollectSensorAgent, AggregateAgent)
event-initiated(e.g. TrapAgent)
Monitoring with agents: Basic components
Directory Service
Basically the Directory Service maintains informations on what kind of Sensors are available for the different resources.
Monitoring with agents: Basic components
Performance Data Repository to store the events and data recorded by LLSensors and
SensorAgents
Agent Cache Repository a repository of agents that have been executed within the
region
Piano temporale attivitàTasks
task 1 M0-M1 Evaluation of mobile agent technology for Grid network
monitoring
task 2 M0-M2 Use and testing of MAP (Mobile Agent Platform) in a Grid environment (eventually adapt it to new requirements imposed by geographically dispersed environment)
task 3 M1-M4 Definition of a base architecture for monitoring networks using mobile agents
Piano temporale attivitàTasks
task 4 M2-M3 Evaluation of this approach against more traditional approach
task 5 M4-M9 Integration/Interfacing the agent platform with existing low-level tools for gathering network informations.
task 6 M4-M12 Implementation of the proposed approach and experimental measurements and validations.
Top Related