18 Mars 2010

Jean-Marc Menaud, Ecole des Mines de NantesBenoit Pelletier, BullFrédéric Dang Tran, Orange Labs

SelfXL projectAutonomic management of PaaS

cloud infrastructure with JASMINe

This research is supported by the french Agence Nationale de la Recherche with the ANR-08-SEGI-017

2© OW2 Consortium 2010 http://selfxl.gforge.inria.fr

SelfXL

Self-management of compleX and Large scale systems Acquire new processes in the field of the

autonomic computing

3© OW2 Consortium 2010 http://selfxl.gforge.inria.fr

PartnersBull

Open Source Java EE Middleware R&D Virtualization system expertise

France Telecom / Orange Labs R&D expertise in distributed systems architecture,

management of virtual IT infrastructuresMines de Nantes

Virtualization and constraint programming expertise.

IRIT Meta-modelisation expertise.

LIG Data mediation

ScalAgent Mediation system

4© OW2 Consortium 2010 http://selfxl.gforge.inria.fr

Cloud Computing at France Telecom

Context: Large-scale datacenters (+40,000 x86 servers) JavaEE JOnAS middleware stack: +250 applications,

+1000 application server instances Static server consolidation (12/1) through virtualization:

• Utilization level increased from 20% to 75%Next step: migration to a Cloud model

On-demand JavaEE server provisioning according to demand fluctuations

Automation of the management of virtualized JavaEE clusters: deployment, update, auto-scaling etc.

Open (source) cloud management stacks alternatives to proprietary solutions (IaaS/PaaS)

5© OW2 Consortium 2010 http://selfxl.gforge.inria.fr

Self-sizing for Java EE PaaS

Goal : improve the platform efficiency (performance, energy cost)

Challenges Cluster growth/shrink capabilities according to

the load Datacenter multi-tenancy with limited

capacities requires arbitration policies Datacenter placement for minimizing the

energy consumption

6© OW2 Consortium 2010 http://selfxl.gforge.inria.fr

Architecture for self-sizing

VM placement

VM provisioning

Scale up/down

7© OW2 Consortium 2010 http://selfxl.gforge.inria.fr

JASMINe

Management tools for SOA platformOW2 Open Source project (license LGPL,

Leadership Bull)Cross-platform (JOnAS AS prime target)Four main features (Design, Deploy,

Monitoring, Self-*)

8© OW2 Consortium 2010 http://selfxl.gforge.inria.fr

JASMINe & MAPE loop

Monitor JMX probes (JavaEE,

Hypervisor) Mediation bus Graphs console

Analyse/Plan Rules engine

Execute Reconfiguration load-balancer

API JASMINe Virtual Machine

Management (VMM) for VM provisioning & deployment

9© OW2 Consortium 2010 http://selfxl.gforge.inria.fr

CLIF is a load injection framework

CLIF is a software framework for load testing load injectors (workload generation and response time

measurement) and probes (resources usage monitoring) open, adaptable/extensible, independent from:

• System Under Test (protocols, probes/observed resources)• workload definition mode• user interfaces (Java/Swing, Eclipse, command line...)

distributed infrastructure designed for high level workloads 100% Java (+ specific or native code for system probes) based on OW2's Fractal component model (fractal.ow2.org)

10© OW2 Consortium 2010 http://selfxl.gforge.inria.fr

CLIF: Self-benchmarking of JavaEE applications

load injector 1

load injector 2

load injector n

automatic control

probes

probes

measures

feedback

saturation criteria definition/choice

PerformancepredictionResponse

time

workload

2 JOnAS VM

1 JOnAS VM

3 JOnAS VM

11© OW2 Consortium 2010 http://selfxl.gforge.inria.fr

JASMINe Virtual Machine Management (VMM)

Support for the following hypervisors: Open-source Xen and

KVM Citrix XenServer VMware virtualCenter 2.x Microsoft Hyper-V

12© OW2 Consortium 2010 http://selfxl.gforge.inria.fr

Entropy: Architecture

Entropy is a virtual machine (VM) manager for 

clusters and acts as an infinite control loop, which 

performs a globally optimized dynamic VM 

placement without downtime according to 

cluster resource usage and scheduler objectives

13© OW2 Consortium 2010 http://selfxl.gforge.inria.fr

Entropy: Dynamic consolidation

Our first result focuses on the dynamic consolidation issue.

 Entropy observes the current CPU and memory requirements of each VM and computes a globally optimized placement of 

them that satisfy all their requirements while using a minimum number of hosts.

14© OW2 Consortium 2010 http://selfxl.gforge.inria.fr

Entropy in Action

Without Entropy With Entropy

4 s

erv

ers

4 t

ask

sC

on

su

mp

tion

is redu

ced

by 25%

4 Ta

sks, 3 or 4 servers

15© OW2 Consortium 2010 http://selfxl.gforge.inria.fr

To concludeConclusion

Self-management of compleX and Large scale systems

Toward an Open Cloud platformFuture Work

Domain Specific Langage • Shell Console adminstration

Coordination between levelsPointers:

ANR SelfXL project: selfxl.gforge.inria.fr JASMINe: jasmine.ow2.org Entropy: entropy.gforge.inria.fr CLIF: clif.ow2.org