Post on 27-Dec-2015
Hungarian Supercomputing GRID
http://www.iif.hu/mszgrid
General InformationGeneral Information
• Co-ordinator:– Office for National Information Infrastructure
Development (NIIFI)
• Consortium members:– Computer and Automation Research Institute Hungarian
Academy of Sciences (MTA SZTAKI)– BUTE Dept. Control Engineering and Information
Technology– ELTE Network Service Center– BUTE Center of Information Systems– BUTE Intitute of Nuclear Technics– Compaq Computer Hungary Ltd.
Research area: Research area: Grid Grid systemssystems
Interconnected, geographically distributed, and high performance or large number of resources to solve complex problems
Internet
Hungarian and international GRID projects
CERN LHC Grid
VISSZKI-Globus test-Condor test
DemoGrid - file system - monitoring- applications
SuperGrid - P-GRADE- portal- security- accounting
Condor
EU DataGrid
EU COSTSIMBEX
APART-2
EUGridLab
Cactus
InfrasInfrastructure oftructure of thethe HungarianHungarian SupercomputingSupercomputing Grid Grid
P-GRADE
PVM MW
Condor-G
Globus
SUN HPC
Compaq AlphaServer
Compaq AlphaServer
Grid middleware
Grid fabric
High-level parallel development layer
Grid level job management
Condor, SGE
MPI
GRID portal
Web based GRID access
Condor, SGE
GRID application
GRID application
Low-levelparallel development
Layers of Hungarian Supercomputing GRID
Condor, SGEClusters
Condor, SGE
Distributed supercomputing: P-GRADEDistributed supercomputing: P-GRADE
• P-GRADE (Parallel Grid Run-time and Application Development Environment)
• A highly integrated parallel Grid application development system
• Support for programming of GRID: Parallel, supercomputing programming Fast and efficient development Observation and visualization Fault and performance analysis
• Further development in the: – Hungarian Supercomputing Grid project– Hungarian Chemistry Grid project– Hungarian Jini Grid project
Hierarchical design layers of P-GRADEHierarchical design layers of P-GRADE
Pre-defined Communication TemplatesPre-defined Communication TemplatesMeshMesh
Workflow interpretation of Workflow interpretation of P-GRADE applicationsP-GRADE applications
1st job
2nd job 3rd job 4th job
5th job
Features of Features of P-GRADEP-GRADE
Designed for non-specialist programmers Enables fast reengineering of sequential
programs for parallel computers and Grid systems
Unified graphical support in program design, debugging and performance analysis
Portability on supercomputers heterogeneous clusters components of the Grid
Two execution modes: Interactive mode Job mode
Condor/P-GRADE on various Condor/P-GRADE on various parallel and distributed systemsparallel and distributed systems
Super-computers
2100 2100 2100 2100
2100 2100 2100 2100
Clusters Grid
GFlops
Mainframes
P-GRADE
Condor
P-GRADE
Condor
P-GRADE
Condor flocking
P-GRADE Interactive ModeP-GRADE Interactive Mode
P-GRADEInteractive
mode
Design/Edit
Compile
Map Debug
Monitor
VisualizeDevelopment cycle
Typical usage on dedicated supercomputers or clusters
P-GRADE Job Mode with CondorP-GRADE Job Mode with Condor
P-GRADEand
Condor
Compile
Design/Edit
CondorMap
Attach
Detach
Submit job
Typical usage on clusters or in the Grid
Berlin CCGrid Grid Demo workshop: Berlin CCGrid Grid Demo workshop: Flocking of P-GRADEFlocking of P-GRADE programs by Condorprograms by Condor
m0 m1
P-GRADEBudapest
Budapest
n0 n1
Madison
p0 p1
Westminster
P-GRADE program runs at the Madison cluster
P-GRADE program runs at the Budapest cluster
P-GRADE program runs at the Westminster cluster