AUVERGRID

Matthieu Reichstadt CNRS/IN2P3

ACGRID School,

Hanoi (Vietnam) November 5th, 2007

Credits: PL Reichstadt, E Medernach, JC Chevaleyre, P. Leroy

Research fields

• Applied science:– Physics– biology– Earth sciences– …

• needs for data processing– Computer system– dedicated software

applications

• Needy software– Processing resource– data storageResource sizing problem

• Used by a large community– Mutualisable pour différentes organisations– Located in differents geographics part of the world.

• Collaborative work– Software sharing– Data sharingResource sizing problem

Situation

Auvergrid for Auvergne

• goals– Enable the partners to use important computing resources,

large data storage capabilities, by gridifying their equipments– Put the regional grid as a node of the european grid EGEE

• Plan of action– Deploy grid nodes over the auvergne– User assistance – Develop grid compliant software. Port existing software on

the grid.

Computing resources of Auvergrid

GridifiedStandalone

Grid nodes Computing resources Storage space equipments

CIRI 40 bi-pro 50 Toctets Onduleurs,climatisation

LPC 200 bi-pro20 bi-pro au Biopôle

60 To

500Go au Biopôle

Onduleurs,climatisation

CEMAGREF 54 bi-pro 1To

Pôle Chimie 13 bi-pro 1To

LaMI 28 bi-pro 500 GO

OPGC 28 bi-pro 400 GO Onduleur,climatisation

Pôle Santé 5 bi-pro

IUT Aurillac 20 bi-pro 500 GO Onduleur,climatisation

IUT Le Puy 10 bi-pro 200 GO Onduleur,climatisation

LIMOS/ISIMA – Pôle modélisation

10 bi-pro 500GO

IUT Clermont (LLAIC1) 10 bi-pro 200 GO

TOTAL 438 bi-pro soit 1050 ksi2k

114,8Teraoctets

AUVERGRID 2008

AUVERGRID

Nœud 43 calcul et applications

Nœud 03calcul et applications

Nœuds 63calcul et applications

LPC et CIRICalcul, donnéeset applicationsAUVERDATA

Nœud 15 calcul et applications

Cluster OPGC 28 biprocessors

Cluster of IUT Aurillac 20 biprocessors

Storage at CIRI 50To

LPC node cluster 200 biprocessors

Management

2 Computing Eléments

X345 2,8 Ghz

98 Workers Nodes

Bi-Xeons 3.02Ghz/ 1 Go RamCatalyst 3750

7 x 1 Gb

1 Gb/s

1 Gb/s

Catalyst 3750

98 Workers Nodes

Bi-Xeons 3.2 Ghz/ 2 Go Ram

7 x 1 Gb/sManagement

1 Gb/s

1 Gb/s2 Computing Eléments

X346 3,2 Ghz / 2Go Ram

Catalyst 2970

J-C Chevaleyre – E. Medernach – P-L Reichstadt

2 configurations like this one

} 56 Disks SATA 500 Go

DS4800 – 2 controllers→} 2 Servers X345

Complete Interconnections in FC/AL

→ 1 Storage Elément X345 2.8Ghz

→ 2nd Storage Elément X345 2.8Ghz / 600 Go

I

Storage at LPC 60To

Equipment LPC

Auvergrid provides

• access to the grid made simple• Some useful resources

– Restricted access to local users– VO distributed services

Administration of the Auvergrid VO at LPC Administration of the data replication service at LPC Resources administration in Annecy and Orsay

– By 09/01/07: > 50 registered users

• Accessibility to the grid resources deployed by the VO of EGEE– Involved in international projects

2%

2%

5%5%

5%

8%

8%

10%14%

17%

24%

Europe Centrale

Allemagne,Suisse

Asie Pacifique

Europe du Nord

Russie

Italie

France hors Auvergne

Auvergne

Europe du sud-ouest

Europe du sud-est

Irlande,Royaume-Uni

LPC+Auvergrid

050000

100000150000200000250000300000350000400000

janv-06

Feb06

mars-06

Apr06

May06

juin-06

juil-06

Aug06

sept-06

oct-06

ops

lhcb

dzero

dteam

biomed

auvergrid

atlas

alice

Exploitation result for 2006

• Biomed

• 15% local resources used by health science’s software.

• 10% of the ressources involved in the

data challenge (sur la grippe aviaire)

Research and auvergrid

• algorithmics– Structures computing (UBP) – Discrete radioactive effects

(UA)– Monte-Carlo experiment(UBP)

• Scientific applications:– Life science (UA, UBP)– physics for health science

(UBP, CJP)– Physics of particules (UBP)– Environment (CEMAGREF)– Chemistry (UBP)

• 4 PhD and 3 postdoctoral positions

Searching drugs against avianflu

• goals: – Study the impact of the

mutation of neuraminidase N1 on the efficiency of today’s drug (Tamiflu)

– Identify new drugs

• Method:– Computer calculation of the

docking probability of molecules on several mutation of neuraminidase

• An international project: – Academica Sinica Taïwan– ITB-CNR Italie – LPC Clermont-Ferrand

N1H5

Credit: Y-T Wu

Auvergne impact

• Identify the scientific goal• Preparation of the large scale

deployment• Coordination of the

deployment on 3 grids: Auvergrid, EGEE, TWGrid

0

2000

4000

6000

8000

10000

12000

14000

16000

18000

20000

Tem

ps C

PU

(en

heu

res)

11 12 13 14 15 16 17 18 19 20 21semaines

Phase de préparation

Phase de calculs

Credit: J. Salzemann, E. Medernach, M. Reichstadt

Computer calculation for the avianfluData challenge: 2006

2%

2%

5%5%

5%

8%

8%

10%

14%

17%

24%

Europe Centrale Allemagne,Suisse Asie PacifiqueEurope du Nord RussieItalie France hors AuvergneAuvergneEurope du sud-ouest Europe du sud-est Irlande,Royaume-Uni

World repartition of the used resources for 100 years/CPU

Auvergrid

Auvergrid, in the middle of an european dynamic

Embrace (2005-2009)Intégration des données biologiques et des

Outils d’analyse sur grilleRéseau d’excellence FP6

European Bioinformatics Institute (International)

EGEE-II (2006-2008)Infrastructure de grille européenne

Infrastructure FP6CERN (international)

BioinfoGRID (2006-2007)Recherche de nouveaux médicaments sur grille

Action Spécifique FP6CNR (Italie)

SHARE (2006–2007)Grilles pour la santé Action spécifique FP6

Healthgrid (Clermont-Ferrand)

ACGT (2005-2009)Intégration de données biologiques et médicales

pour la recherche sur le cancerProjet intégré FP6

2 engineers

3 engineers 1 PhD

1 PhD 3 engineers

8 engineers and 2 PhDin Auvergne onEuropean projects

Software development for life science

• BLAST – Grid (multisequence) / Cluster (monosequence)– Web portal

• RepeatMasker– Grid, Cluster

• HMMPfam– Grid

• Est2Genome– Grid, Cluster– Web portal

• Secured Bl2Seq – Web portal

• Secured Readseq

Software development for life science

• To use a grid tool provided by Auvergrid you need:– A grid certificate– An account on a UI (User Interface)– To be registered to a VO (virtual organisation)

• Most softwares are availables for download

• More informations: www.auvergrid.fr

Auvergrid and Lifegrid

• 3 goals to develop life science in the Auvergne– Creation of elementary information systems– Creation of a regional information system based on Auvergrid– Development of analysis tools

• Auvergrid’s role– Share human resources and skills

Lifegrid’s “technical team” helps the scientists Integration of biological data

– Computing resources and data storage

• Example : TriAnnotPipelineGrid (P. Leroy, INRA)

Auvergrid and Lifegrid

Auvergrid and Lifegrid

Thank you