KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis
description
Transcript of KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis
![Page 1: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/1.jpg)
KARMA with ProActive Parallel Suite12/01/2009
Air France, Sophia Antipolis
Solutions and Services for Accelerating your Applications
![Page 2: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/2.jpg)
ProActive Parallel Suite
Speed-up applications by distributing them over a set of resources
The result of 9 years of R&D at INRIA
![Page 3: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/3.jpg)
KARMA performances constraints• KARMA processes computation needs refer to :
- HEAVY PROCESS (Batch long time)- LIGHT PROCESS (Interactive short time)
• Processes are expressed according to the following features:- Triggering mode (start and kill)- Parallelization capability (functional / technical) - Re-run ability (fault tolerance / recovery)- Performance (elapse time)- Type (interactive, schedule, event, exceptional, administrative)- Data volume (light, medium, heavy)
• Manage resources consumption- Availability- Resources optimization (CPU, Core, Memory)- Strategy / Policy (Arbitration resources and tasks request prioritization )- Fault error management
• Open system- Interoperability (upper and lower stream)- API (language, completeness, reliability)- Tools (friendliness, eclipse integration ability,..)
• Parallelization- Multiple processes capability (functional)- Parallelization programming capability (technical).
![Page 4: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/4.jpg)
ProActive Technology Integration
Simple and Seamless integration
Installation : one directory Deployment : one XML file (GCM Deployment)
Possible automated agent-based deployment
Support for common standards Connection/Acquisition: Ssh, Rsh, LSF, PBS, SGE,… Communication: RMI, RMI/SSH, HTTP, Ibis,… Export any activity as a WebService J2EE (in and out)
Validated on common JDKs 1.5, 1.6 and 1.7
Activities are monitored through standard JMX Compliant with common monitoring tools (TIBCO Hawk)
![Page 5: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/5.jpg)
KARMA performances constraints• KARMA processes computation needs refer to :
- HEAVY PROCESS (Batch long time)- LIGHT PROCESS (Interactive short time)
• Processes are expressed according to the following features:- Triggering mode (start and kill)- Parallelization capability (functional / technical) - Re-run ability (fault tolerance / recovery)- Performance (elapse time)- Type (interactive, schedule, event, exceptional, administrative)- Data volume (light, medium, heavy)
• Manage resources consumption- Availability- Resources optimization (CPU, Core, Memory)- Strategy / Policy (Arbitration resources and tasks request prioritization )- Fault error management
• Open system- Interoperability (upper and lower stream)- API (language, completeness, reliability)- Tools (friendliness, eclipse integration ability,..)
• Parallelization- Multiple processes capability (functional)- Parallelization programming capability (technical).
![Page 6: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/6.jpg)
KARMA performances constraints• KARMA processes computation needs refer to :
- HEAVY PROCESS (Batch long time)- LIGHT PROCESS (Interactive short time)
• Processes are expressed according to the following features:- Triggering mode (start and kill)- Parallelization capability (functional / technical) - Re-run ability (fault tolerance / recovery)- Performance (elapse time)- Type (interactive, schedule, event, exceptional, administrative) - Data volume (light, medium, heavy)
• Manage resources consumption- Availability- Resources optimization (CPU, Core, Memory)- Strategy / Policy (Arbitration resources and tasks request prioritization )- Fault error management
• Open system Interoperability (upper and lower stream)- API (language, completeness, reliability)- Tools (friendliness, eclipse integration ability,..)
• Parallelization- Multiple processes capability (functional)- Parallelization programming capability (technical).
![Page 7: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/7.jpg)
ProActive Scheduling
Managed environment for distributed computation
![Page 8: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/8.jpg)
Scheduler / Resource Manager Overview
• Multi-platform Graphical Client (RCP)
• File-based or LDAP authentication
• Static Workflow Job Scheduling, Native and Java tasks, Retry on Error, Priority Policy, Configuration Scripts,…
• Dynamic and Static node sources, Resource Selection by script, Monitoring and Control GUI,…
• ProActive Deployment capabilities : Desktops, Clusters, ProActive P2P,…
![Page 9: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/9.jpg)
KARMA performances constraints• KARMA processes computation needs refer to :
- HEAVY PROCESS (Batch long time)- LIGHT PROCESS (Interactive short time)
• Processes are expressed according to the following features:- Triggering mode (start and kill)- Parallelization capability (functional / technical) - Re-run ability (fault tolerance / recovery)- Performance (elapse time)- Type (interactive, schedule, event, exceptional, administrative) - Data volume (light, medium, heavy)
• Manage resources consumption- Availability- Resources optimization (CPU, Core, Memory)- Strategy / Policy (Arbitration resources and tasks request prioritization )- Fault error management
• Open system Interoperability (upper and lower stream)- API (language, completeness, reliability)- Tools (friendliness, eclipse integration ability,..)
• Parallelization- Multiple processes capability (functional)- Parallelization programming capability (technical).
![Page 10: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/10.jpg)
KARMA performances constraints• KARMA processes computation needs refer to :
- HEAVY PROCESS (Batch long time)- LIGHT PROCESS (Interactive short time)
• Processes are expressed according to the following features:- Triggering mode (start and kill)- Parallelization capability (functional / technical) - Re-run ability (fault tolerance / recovery)- Performance (elapse time)- Type (interactive, schedule, event, exceptional, administrative) - Data volume (light, medium, heavy)
• Manage resources consumption- Availability- Resources optimization (CPU, Core, Memory)- Strategy / Policy (Arbitration resources and tasks request prioritization )- Fault error management
• Open system Interoperability (upper and lower stream)- API (language, completeness, reliability) Tools (friendliness, eclipse integration ability,..)
• Parallelization- Multiple processes capability (functional)- Parallelization programming capability (technical).
![Page 11: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/11.jpg)
Parallelism with ProActive Scheduling
Task 1(input 1) Task 2(input 2)
Task 3(res1,res2)
res1 res2
Task 1(input 1) Task 2(input 2) Task N(input N)…
Task 1(input 1)
Functional // Technical //
Computations are defined as Jobs made of Tasks
Bag of Tasks
Tasks Flow
ProActive application
![Page 12: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/12.jpg)
KARMA performances constraints• KARMA processes computation needs refer to :
- HEAVY PROCESS (Batch long time)- LIGHT PROCESS (Interactive short time)
• Processes are expressed according to the following features:- Triggering mode (start and kill)- Parallelization capability (functional / technical) - Re-run ability (fault tolerance / recovery)- Performance (elapse time)- Type (interactive, schedule, event, exceptional, administrative) - Data volume (light, medium, heavy)
• Manage resources consumption- Availability- Resources optimization (CPU, Core, Memory)- Strategy / Policy (Arbitration resources and tasks request prioritization )- Fault error management
• Open system Interoperability (upper and lower stream)- API (language, completeness, reliability) Tools (friendliness, eclipse integration ability,..)
• Parallelization- Multiple processes capability (functional)- Parallelization programming capability (technical).
![Page 13: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/13.jpg)
KARMA performances constraints• KARMA processes computation needs refer to :
- HEAVY PROCESS (Batch long time)- LIGHT PROCESS (Interactive short time)
• Processes are expressed according to the following features:- Triggering mode (start and kill) Parallelization capability (functional / technical) - Re-run ability (fault tolerance / recovery)- Performance (elapse time)- Type (interactive, schedule, event, exceptional, administrative) - Data volume (light, medium, heavy)
• Manage resources consumption- Availability- Resources optimization (CPU, Core, Memory)- Strategy / Policy (Arbitration resources and tasks request prioritization )- Fault error management
• Open system Interoperability (upper and lower stream)- API (language, completeness, reliability) Tools (friendliness, eclipse integration ability,..)
• Parallelization Multiple processes capability (functional) Parallelization programming capability (technical).
![Page 14: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/14.jpg)
Tasks can be defined in Java or as Native Application
Dynamic Task creation through Java APIJavaTask aTask = new JavaTask();aTask.setName("task 1");aTask.setRerunnable(2);aTask.setRestartOnError(RestartMode.ELSEWHERE);aTask.addArgument("foo",new Boolean(true));aTask.setExecClassName("com.activeeon.Compute");aTask.setPreScript("/path/to/script_file");
Can attach pre/post script to a task Any JSR-223 supported language (JS, Python, Ruby,…) Used for configuration and data transfer
Data are handled separately
Defining Tasks
![Page 15: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/15.jpg)
Jobs can be defined in Java or XML
Dynamic job creation through Java APITaskFlowJob job = new TaskFlowJob();
job.setName("job_name");job.setPriority(JobPriority.NORMAL);job.setCancelOnError(true);job.addTask(new NativeTask(cmd));
Can easily develop tools that generate and submit jobs Specialized Automated
Static description in XML descriptor Can be defined by any non specialized user
Defining Jobs
![Page 16: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/16.jpg)
KARMA performances constraints• KARMA processes computation needs refer to :
- HEAVY PROCESS (Batch long time)- LIGHT PROCESS (Interactive short time)
• Processes are expressed according to the following features:- Triggering mode (start and kill) Parallelization capability (functional / technical) - Re-run ability (fault tolerance / recovery)- Performance (elapse time)- Type (interactive, schedule, event, exceptional, administrative) - Data volume (light, medium, heavy)
• Manage resources consumption- Availability- Resources optimization (CPU, Core, Memory)- Strategy / Policy (Arbitration resources and tasks request prioritization )- Fault error management
• Open system Interoperability (upper and lower stream)- API (language, completeness, reliability) Tools (friendliness, eclipse integration ability,..)
• Parallelization Multiple processes capability (functional) Parallelization programming capability (technical).
![Page 17: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/17.jpg)
KARMA performances constraints• KARMA processes computation needs refer to :
HEAVY PROCESS (Batch long time) LIGHT PROCESS (Interactive short time)
• Processes are expressed according to the following features:- Triggering mode (start and kill) Parallelization capability (functional / technical) - Re-run ability (fault tolerance / recovery)- Performance (elapse time)- Type (interactive, schedule, event, exceptional, administrative) Data volume (light, medium, heavy)
• Manage resources consumption- Availability- Resources optimization (CPU, Core, Memory)- Strategy / Policy (Arbitration resources and tasks request prioritization )- Fault error management
• Open system Interoperability (upper and lower stream) API (language, completeness, reliability) Tools (friendliness, eclipse integration ability,..)
• Parallelization Multiple processes capability (functional) Parallelization programming capability (technical).
![Page 18: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/18.jpg)
Executing Jobs
Submission through… Java API Graphical interface Command line
Recovery is fully configurable with User/System level distinction
1. Host failure : automatically re-dispatched with needed input Number of retries bounded by the administrator
2. Task failure : can be either… Automatically re-dispatched with needed input
Number of retries bounded by the user Aborted (Task) : exception is transmitted as task result Aborted (Job) : job is fully canceled
Scheduler itself is recoverable from underlying database
![Page 19: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/19.jpg)
KARMA performances constraints• KARMA processes computation needs refer to :
HEAVY PROCESS (Batch long time) LIGHT PROCESS (Interactive short time)
• Processes are expressed according to the following features:- Triggering mode (start and kill) Parallelization capability (functional / technical) - Re-run ability (fault tolerance / recovery)- Performance (elapse time)- Type (interactive, schedule, event, exceptional, administrative) Data volume (light, medium, heavy)
• Manage resources consumption- Availability- Resources optimization (CPU, Core, Memory)- Strategy / Policy (Arbitration resources and tasks request prioritization )- Fault error management
• Open system Interoperability (upper and lower stream) API (language, completeness, reliability) Tools (friendliness, eclipse integration ability,..)
• Parallelization Multiple processes capability (functional) Parallelization programming capability (technical).
![Page 20: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/20.jpg)
KARMA performances constraints• KARMA processes computation needs refer to :
HEAVY PROCESS (Batch long time) LIGHT PROCESS (Interactive short time)
• Processes are expressed according to the following features: Triggering mode (start and kill) Parallelization capability (functional / technical) Re-run ability (fault tolerance / recovery)- Performance (elapse time)- Type (interactive, schedule, event, exceptional, administrative) Data volume (light, medium, heavy)
• Manage resources consumption- Availability- Resources optimization (CPU, Core, Memory)- Strategy / Policy (Arbitration resources and tasks request prioritization ) Fault error management
• Open system Interoperability (upper and lower stream) API (language, completeness, reliability) Tools (friendliness, eclipse integration ability,..)
• Parallelization Multiple processes capability (functional) Parallelization programming capability (technical).
![Page 21: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/21.jpg)
Monitoring Jobs
System and ProActive level monitoring Through standard JMX Provide generic tool for monitoring and reporting Compliant with common monitoring tool
![Page 22: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/22.jpg)
Monitoring Jobs
System and ProActive level monitoring Through standard JMX Provide generic tool for monitoring and reporting Compliant with common monitoring tool
Scheduler level monitoring On-going porting from MVC to JMX
![Page 23: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/23.jpg)
KARMA performances constraints• KARMA processes computation needs refer to :
HEAVY PROCESS (Batch long time) LIGHT PROCESS (Interactive short time)
• Processes are expressed according to the following features: Triggering mode (start and kill) Parallelization capability (functional / technical) Re-run ability (fault tolerance / recovery)- Performance (elapse time)- Type (interactive, schedule, event, exceptional, administrative) Data volume (light, medium, heavy)
• Manage resources consumption- Availability- Resources optimization (CPU, Core, Memory)- Strategy / Policy (Arbitration resources and tasks request prioritization ) Fault error management
• Open system Interoperability (upper and lower stream) API (language, completeness, reliability) Tools (friendliness, eclipse integration ability,..)
• Parallelization Multiple processes capability (functional) Parallelization programming capability (technical).
![Page 24: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/24.jpg)
KARMA performances constraints• KARMA processes computation needs refer to :
HEAVY PROCESS (Batch long time) LIGHT PROCESS (Interactive short time)
• Processes are expressed according to the following features: Triggering mode (start and kill) Parallelization capability (functional / technical) Re-run ability (fault tolerance / recovery) Performance (elapse time)- Type (interactive, schedule, event, exceptional, administrative) Data volume (light, medium, heavy)
• Manage resources consumption- Availability- Resources optimization (CPU, Core, Memory)- Strategy / Policy (Arbitration resources and tasks request prioritization ) Fault error management
• Open system Interoperability (upper and lower stream) API (language, completeness, reliability) Tools (friendliness, eclipse integration ability,..)
• Parallelization Multiple processes capability (functional) Parallelization programming capability (technical).
![Page 25: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/25.jpg)
Controlling Jobs Fine grain control through GUI and API
Job level (User)
Scheduler level(Admin)
![Page 26: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/26.jpg)
KARMA performances constraints• KARMA processes computation needs refer to :
HEAVY PROCESS (Batch long time) LIGHT PROCESS (Interactive short time)
• Processes are expressed according to the following features: Triggering mode (start and kill) Parallelization capability (functional / technical) Re-run ability (fault tolerance / recovery) Performance (elapse time)- Type (interactive, schedule, event, exceptional, administrative) Data volume (light, medium, heavy)
• Manage resources consumption- Availability- Resources optimization (CPU, Core, Memory)- Strategy / Policy (Arbitration resources and tasks request prioritization ) Fault error management
• Open system Interoperability (upper and lower stream) API (language, completeness, reliability) Tools (friendliness, eclipse integration ability,..)
• Parallelization Multiple processes capability (functional) Parallelization programming capability (technical).
![Page 27: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/27.jpg)
KARMA performances constraints• KARMA processes computation needs refer to :
HEAVY PROCESS (Batch long time) LIGHT PROCESS (Interactive short time)
• Processes are expressed according to the following features: Triggering mode (start and kill) Parallelization capability (functional / technical) Re-run ability (fault tolerance / recovery) Performance (elapse time)- Type (interactive, schedule, event, exceptional, administrative) Data volume (light, medium, heavy)
• Manage resources consumption- Availability- Resources optimization (CPU, Core, Memory) Strategy / Policy (Arbitration resources and tasks request prioritization ) Fault error management
• Open system Interoperability (upper and lower stream) API (language, completeness, reliability) Tools (friendliness, eclipse integration ability,..)
• Parallelization Multiple processes capability (functional) Parallelization programming capability (technical).
![Page 28: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/28.jpg)
Specializing the Scheduler
Business Level specialization and automation
ActiveEon provides business specific interface for the Scheduler Bio-technology (Gold, MapRead) Finance MatLab/Scilab
![Page 29: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/29.jpg)
Specializing the Scheduler
Business Level specialization and automation
ActiveEon provides business specific interface for the Scheduler Bio-technology (Gold, MapRead) Finance MatLab/Scilab
User-level hooks to (very) easily specialize the Scheduler
Plug-in for RCP client e.g. ActiveEon’s Gold module
Result preview mechanism Can preview result in the scheduler GUI (textual/graphical) Can attach any external application to a task for result display
![Page 30: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/30.jpg)
Specializing the Scheduler
Business Level specialization and automation
ActiveEon provides business specific interface for the Scheduler Bio-technology (Gold, MapRead) Finance MatLab/Scilab
User-level hooks to (very) easily specialize the Scheduler
Plugin for RCP client e.g. ActiveEon’s Gold module
Result preview mechanism Can preview result in the scheduler GUI (textual/graphical) Can attach any external application to a task for result display
![Page 31: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/31.jpg)
KARMA performances constraints• KARMA processes computation needs refer to :
HEAVY PROCESS (Batch long time) LIGHT PROCESS (Interactive short time)
• Processes are expressed according to the following features: Triggering mode (start and kill) Parallelization capability (functional / technical) Re-run ability (fault tolerance / recovery) Performance (elapse time)- Type (interactive, schedule, event, exceptional, administrative) Data volume (light, medium, heavy)
• Manage resources consumption- Availability- Resources optimization (CPU, Core, Memory) Strategy / Policy (Arbitration resources and tasks request prioritization ) Fault error management
• Open system Interoperability (upper and lower stream) API (language, completeness, reliability) Tools (friendliness, eclipse integration ability,..)
• Parallelization Multiple processes capability (functional) Parallelization programming capability (technical).
![Page 32: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/32.jpg)
KARMA performances constraints• KARMA processes computation needs refer to :
HEAVY PROCESS (Batch long time) LIGHT PROCESS (Interactive short time)
• Processes are expressed according to the following features: Triggering mode (start and kill) Parallelization capability (functional / technical) Re-run ability (fault tolerance / recovery) Performance (elapse time) Type (interactive, schedule, event, exceptional, administrative) Data volume (light, medium, heavy)
• Manage resources consumption- Availability- Resources optimization (CPU, Core, Memory) Strategy / Policy (Arbitration resources and tasks request prioritization ) Fault error management
• Open system Interoperability (upper and lower stream) API (language, completeness, reliability) Tools (friendliness, eclipse integration ability,..)
• Parallelization Multiple processes capability (functional) Parallelization programming capability (technical).
![Page 33: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/33.jpg)
ProActive Resource Manager
Rely on ProActive Programming features GCM deployment standard Agent based deployment Support for many LAN / WAN / Grid / Cloud standards…
MultiCPU/Core Cluster
Desktop Grid
Clusters / Grille Clouds / RAS
Straightforward Upgrade
![Page 34: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/34.jpg)
ProActive Resource Manager
Rely on ProActive Programming features GCM deployment standard Agent based deployment Support for many LAN / WAN / Grid / Cloud standards…
Deal with resources heterogeneity with Selection Scripts User defined : no need for system reconfiguration Any JSR-223 supported language (JS, Python, Ruby,…)
Can rely on dynamic decision or on static host description Optimized (probabilistic selection of candidates)
![Page 35: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/35.jpg)
KARMA performances constraints• KARMA processes computation needs refer to :
HEAVY PROCESS (Batch long time) LIGHT PROCESS (Interactive short time)
• Processes are expressed according to the following features: Triggering mode (start and kill) Parallelization capability (functional / technical) Re-run ability (fault tolerance / recovery) Performance (elapse time) Type (interactive, schedule, event, exceptional, administrative) Data volume (light, medium, heavy)
• Manage resources consumption- Availability- Resources optimization (CPU, Core, Memory) Strategy / Policy (Arbitration resources and tasks request prioritization ) Fault error management
• Open system Interoperability (upper and lower stream) API (language, completeness, reliability) Tools (friendliness, eclipse integration ability,..)
• Parallelization Multiple processes capability (functional) Parallelization programming capability (technical).
![Page 36: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/36.jpg)
KARMA performances constraints• KARMA processes computation needs refer to :
HEAVY PROCESS (Batch long time) LIGHT PROCESS (Interactive short time)
• Processes are expressed according to the following features: Triggering mode (start and kill) Parallelization capability (functional / technical) Re-run ability (fault tolerance / recovery) Performance (elapse time) Type (interactive, schedule, event, exceptional, administrative) Data volume (light, medium, heavy)
• Manage resources consumption Availability Resources optimization (CPU, Core, Memory) Strategy / Policy (Arbitration resources and tasks request prioritization ) Fault error management
• Open system Interoperability (upper and lower stream) API (language, completeness, reliability) Tools (friendliness, eclipse integration ability,..)
• Parallelization Multiple processes capability (functional) Parallelization programming capability (technical).
![Page 37: KARMA with ProActive Parallel Suite 12/01/2009 Air France, Sophia Antipolis](https://reader036.fdocuments.in/reader036/viewer/2022070500/568168b5550346895ddf8c02/html5/thumbnails/37.jpg)
Thank you for your attention
Demo