Migration of a computation cluster to Debian
-
Upload
logilab -
Category
Technology
-
view
575 -
download
0
description
Transcript of Migration of a computation cluster to Debian
Migration of a computation cluster to Debian
Julien Cristau
November 25th, 2012
Mini-Debconf Paris 2012
Outline
Context
Hardware
Existing software
Solution
0/5
Context
Institut de Genetique et Microbiologie (IGM):
I joint lab, CNRS & Universite Paris Sud
I cluster part of the eBio platform, providing resources forscientists
Logilab:
I software services
I python specialist, Debian-based
I scientific computing / simulation
1/5
Hardware
Existing:
I 10 compute nodes
I 1 frontend
I 1 separate assembly node(lots of RAM and storage)
I 24-port 1Gb ethernetswitch
New:
I 2 hosts for virtualizationand storage
I 2 more storage bays
2/5
Existing software
I Based on RHEL5
I Sun Grid Engine (SGE) batch scheduler
I No shared storage
I No central management
3/5
Solution
SAS
SAS
SAS
WEBGalaxyGanglia/Munin
MasterCondor/OAR/SGE
StorageNFSZFS
Provision.DHCP/tFTP/PXE/FAISalt
SA
N
AD
MIN
CLUSTER
KVM hostPub
lic n
etw
ork
SAS
SAS
Compute Node
Compute Node
Compute Node
Compute Node
Compute Node*for BLAST assembly
4/5
Solution (2)
I One storage node using ZFS on Linux
I VM hosts for all services: provisioning, monitoring, frontend(submission host), databases, web server, . . .
I Nodes reinstalled with FAI(http://www.fai-project.org/)
I Configuration/deployment with Salt(http://www.saltstack.org/)
5/5