Bank of America Merrill Lynch Health Care Conferene May 16 2013
Ingrid Conferene, Ischia, April 9-11 2008 1 Stefan Heinzel, DEISA DEISA Towards a European HPC...
-
Upload
chance-flinders -
Category
Documents
-
view
213 -
download
0
Transcript of Ingrid Conferene, Ischia, April 9-11 2008 1 Stefan Heinzel, DEISA DEISA Towards a European HPC...
Ingrid Conferene, Ischia, April 9-11 20081
Stefan Heinzel, DEISA
DEISA Towards a European HPC Infrastructure
(www.deisa.eu)
TopicsVision
The DEISA/eDEISA Infrastructure
The DEISA2, the European HPC infrastructure
Ingrid Conferene, Ischia, April 9-11 20082
Stefan Heinzel, DEISA
Status of the European HPC Infrastructure
Vision of the European DEISA/eDEISA projects in FP6
To enhance Europe’s capability computing and science by the integration of Europe’s most powerful supercomputing systems Tier-1 in a European HPC e-infrastructure
DEISA built a European Supercomputing Service on top of existing national services. This service is based on the deployment and operation of a persistent, production quality, distributed supercomputing environment with continental scope
Vision of the European Strategy Forum on Research Infrastructures (ESFRI)
Delivering a turnkey operational solution for a future persistent European HPC ecosystem integrating national Tier-1 centres and the new European Tier-0 centres
Ingrid Conferene, Ischia, April 9-11 20083
Stefan Heinzel, DEISA
Vision of a European HPC Ecosystem in FP7
T-0: future shared European PetaFLOP systemsT-1: leading national supercomputing systems
…
PRACEBuilding a world-class pan-European High Performance HPC
Ecosystemwhich is operated under the umbrella of an European Legal Entity
adopting operational and technological concepts and servicesdesigned and approved by DEISA2.
Enhancing the performance
DEISA2 - The Infrastructure for the European HPC Ecosystem
Deep operational and technological integration of European HPC (T-0 and T-1) centres and systems providing efficient seamless access to shared HPC resources and large data repositories designing and approving an operational model for a large European Virtual HPC Centre.
Providing scientists access to a large distributed HPC environment via integrated services.
T-1 T-1 T-1T-1 T-0 T-0T-0 T-1
DEISA is paving the way to the efficient operation of the T-0 and T-1 ecosystem
Ingrid Conferene, Ischia, April 9-11 20084
Stefan Heinzel, DEISA
Towards a European HPC Infrastructure – DEISA2
ObjectivesEnhancing the existing distributed European HPC environment (DEISA) to a turnkey operational infrastructure
National HPCCenter
(T1)National HPC
Center(T1)
National HPCCenter
(T1)
National DataCenter
(T1)National DataCenter
National HPCCenter
(T1)
National HPCCenter
(T1)
Advancing the computational sciences in Europe by supporting user communities and extreme computing projects
Enhancing the service provision by offering a complete variety of options of interaction with computational resources
FusionCommunity
CosmologyCommunity
Climate Community
Material SciencesCommunity
Weather forecastCommunities
IndustryCommunities
European Petascale Center(T0)
European Petascale Center(T0)
European Petascale Center(T0)
Integration of T1 and T0 centres The Petascale Systems need a transparent access from and into the national data repositories
DEISA2 – The Virtual European HPC CenterOperation - Technology - Application
USATeraGrid,DoE
JapanNAREGI
ChineseAcademy
RussianAcademy
DEISA2
Bridging worldwide HPC projects
Ingrid Conferene, Ischia, April 9-11 20085
Stefan Heinzel, DEISA
DEISA Partners
DEISA2: May 1st, 2008 – April 30th, 2011
Three new partners joined June 2005 (eDEISA)
DEISA: May 1st, 2004 – April 30th, 2008
Ingrid Conferene, Ischia, April 9-11 20086
Stefan Heinzel, DEISA
Partners/ Associate Partners
BSC Barcelona Supercomputing Centre Spain
CINECA Consortio Interuniversitario per il Calcolo Automatico Italy
CSC Finnish Information Technology Centre for Science Finland
EPCC University of Edinburgh and CCLRC UK
ECMWF European Centre for Medium-Range Weather Forecast UK (int)
FZJ Research Centre Juelich Germany
HLRS High Performance Computing Centre Stuttgart Germany
IDRIS Institut du Développement et des Ressources France
en Informatique Scientifique - CNRS
LRZ Leibniz Rechenzentrum Munich Germany
RZG Rechenzentrum Garching of the Max Planck Society Germany
SARA Dutch National High Performance Computing Netherlands
KTH Kungliga Tekniska Högskolan Sweden
CSCS Swiss National Supercomputing Centre Switzerland
JSCC Joint Supercomputer Center of the Russian Russia
Academy of Sciences
Ingrid Conferene, Ischia, April 9-11 20087
Stefan Heinzel, DEISA
The basic DEISA infrastructures and services
Dedicated high speed network infrastructure
Common AAA infrastructure
Global data management infrastructure
Integrating distributed data with distributed computing platforms, including hierarchical storage management and databases. Major highlights are:
High performace remote I/O and data sharing with global file systems, using full network bandwidth
High performance transfers of large data sets, using full network bandwidth DCPE (Distributed Common Production Environment)
The job management serviceThe science gateways (portals) to supercomputing resources
Common Operational Environment Common monitoring and Information systemsCommon system operationCommon help desk
Global Application Support
Ingrid Conferene, Ischia, April 9-11 20088
Stefan Heinzel, DEISA
DEISA network infrastructure
RENATER
FUNETSURFnet
GÉANT
DFN
GARR
UKERNA
RedIris 1 Gb/s GRE tunnel
10 Gb/s wavelength
10 Gb/s routed
10 Gb/s switched
Ingrid Conferene, Ischia, April 9-11 20089
Stefan Heinzel, DEISA
DEISA 1GE site ECMWF via GEANT2 GRE tunnel
GARR
CINECA-Net: 130.186.27.0/24
ECMWF-Net: 136.156.48.0/24
Ingrid Conferene, Ischia, April 9-11 200810
Stefan Heinzel, DEISA
Linux SGI
SARA (NL)
LRZ (DE)LRZ (DE)
DEISA Data Services - Global File System(based on IBM’s GPFS)
CINECA (IT)FZJ (DE)
ECMWF (UK) IDRIS (FR)
AIX IBM domain
RZG (DE)
BSC (ES)
LINUX Power-PC
CSC (FI)
HPC Common Global File System similar architectures / operation systems
High bandwidth (10 Gbit/s)
High Peformance Common Global File System various architectures / operating systems
High bandwidth (up to10 Gbit/s)
Ingrid Conferene, Ischia, April 9-11 200811
Stefan Heinzel, DEISA
Workflow simulations using UNICORE
UNICORE supports complex simulations that are pipelined over several heterogeneous platforms (workflows).
UNICORE handles workflows asa unique job and transparently moves the output – input data along the pipeline.
UNICORE clients that monitorthe application can run in laptops.
UNICORE has a user friendly graphical interface. DEISA has developed a command line interface for UNICORE.
Ingrid Conferene, Ischia, April 9-11 200812
Stefan Heinzel, DEISA
Site NSite 2Site 1
Network
Computing
AAA
User
Integration
Data
Deputy
Network
Computing
AAA
User
Integration
Data
Deputy
Network
Computing
AAA
User
Integration
Data
Deputy
Operational Model
Ingrid Conferene, Ischia, April 9-11 200813
Stefan Heinzel, DEISA
Enabling Science
The basic service providing model for scientific users is the Extreme Computing Initiative (see www.deisa.org)
Identification, deployment and operation of a number of « flagship » applications requiring the infrastructure services, in selected areas of science and technology.
European Call for proposals in May-June every year. Applications are selected on the basis of scientific excellence, innovation potential and relevance criteria, with the collaboration of the HPC national evaluation committees.
Supported by the Applications Task Force (ATASKF)
Hyperscaling of huge parallel applications, data oriented applications
Workflows and coupled applications
Production of an European Benchmark Suite for HPC systems
Ingrid Conferene, Ischia, April 9-11 200814
Stefan Heinzel, DEISA
DEISA Extreme Computing Initiative
DECI call 2005 51 proposals, 12 European countries involved30 mio cpu-h requested29 proposals accepted, 12 mio cpu-h (standardized of P4 Jülich)
DECI call 2006
41 proposals, 12 European countries involved28 mio cpu-h requested23 proposals accepted, 12 mio cpu-h
DECI call 200763 proposals, 14 European countries involved(US, Canada, Brazil, Israel)30 mio cpu-h requested
Ingrid Conferene, Ischia, April 9-11 200815
Stefan Heinzel, DEISA
DEISA Extreme Computing Initiative
15 European countries so far involved in DECI:
Austria Finland France GermanyGreece Hungary Italy Netherlands Poland Portugal Russia SpainSweden Switzerland UK
Ingrid Conferene, Ischia, April 9-11 200816
Stefan Heinzel, DEISA
DECI Projects – Publications
Benedict J. Reynwar, Gregoria Illya, Vagelis A. Harmandaris, Martin M. Müller, Kurt Kremer & Markus Deserno:Aggregation and vesiculation of membrane proteins by curvature mediated interactions, NATURE Vol 447|24 May 2007| doi:10.1038/nature05840
Cover story of Nature May 24, 2007
DECI project POLYRES
26 publications so far, among themNATURE, Phys Rev B, Phys Rev Lett, PNAS
Ingrid Conferene, Ischia, April 9-11 200817
Stefan Heinzel, DEISA
The purpose of the DEISA2
Consolidation of the existing DEISA infrastructure
Guaranteeing the continuity of those activities and services that currently contribute to
the effective support of world-leading computational science in Europe
DEISA2 providing a lean and reliable turnkey operational solution for a
persistent European HPC ecosystem
Evolvement this European infrastructure towards a robust and persistent
European HPC ecosystem
Enhancing the existing services, by deploying new services including
support for European Virtual Communities, and by cooperating and
collaborating with new European initiatives, especially PRACE that will enable shared
European PetaFlop/s supercomputer systems
DEISA2 as the vector for the integration of Tier-0 and Tier-1 systems in Europe
Ingrid Conferene, Ischia, April 9-11 200818
Stefan Heinzel, DEISA
The purpose of DEISA2
DEISA2 advancing computational sciences in EuropeDEISA2 will provide a consistent infrastructure for virtual organisations as
the European Fusion Development Agreement (EFDA) supporting ITER, the Climate Modelling Community, the Cosmology Consortium VIRGO, Material Sciences projects/communities, Life Science projects/communities
DEISA2 as an extended partnership DEISA2 targets the integration of further national Tier-1 partners
DEISA2 bridging worldwide HPC projectsInteroperation in a Grid context worldwide is seen as an important step for
supporting international science communities which acquire computing time traversing existing political boundaries
Ingrid Conferene, Ischia, April 9-11 200819
Stefan Heinzel, DEISA
Integrated Tier-1 Systems
Participant short name Architecture TF/s[1] #Cores[2] Memory in TB[3]
MPG-RZG IBM BlueGene P 27.0 8,192 4.0
IBM Power6 120.0 6,400 20.0
BAdW-LRZ SGI-AltixItanium
62.3 9,728 39.0
BSC IBM PowerPC 94.2 10240 20.0
CINECA IBM Blade Center 26.6 5120 10.0
IBM Power5 3.9 512 1.0
CSC Cray XT4 dc 10.1 2,024 2.0
Cray XT4 qc 70.0 6,736 7.8
FZJ IBM BlueGene P 223.0 65,536 32.0
IBM p690 cluster JUMP 8.9 1,312 5.0
JUMPsuccessor
> 50 n/a n/a
IDRIS-CNRS IBM p690+Cluster
6.7 1800 10
IBM p690+ successor > 40 n/a n/a
SARA IBM Power5+ 14.6 1920 7.7
IBM Power6 60.2 3328 15.6
UEdin-EPCC Cray XT4 65.0 11,520 35.0
UStutt-HLRS NEC SX-8 13.0 576 9.0
Ingrid Conferene, Ischia, April 9-11 200820
Stefan Heinzel, DEISA
Site, Project, Community Short Description
CLARIN The pan-European Common Language Resources and Technology Infrastructure is committed to enabling eHumanities.
COSMOS The COSMOS Network gathers 20 institutions from 6 different European countries involved in the climate research.
DANTE DANTE (Delivery of Advanced Network Technology to Europe) is a non-profit organisation owned by a group of National Research and Education Networks (NRENs).
EFDA/ITER The European Fusion Development Agreement is interested in a strong support for the theoretical fusion science community.
EGI The consortium of EGI aims at establishing a sustainable Grid infrastructure in Europe, coordinating national Grid initiatives.
ENES The European Network for Earth System Modelling expects a strong support for the earth science virtual community in a pan-European context by DEISA2.
European Psi-k Network in Material Science Psi-k Network will collaborate with DEISA2 in improving the support for the European Virtual Scientific Communities in the field of Material Science.
EuroPhysiome A European biomedical research project.
HPC-Europa Pan-European Research Infrastructure on HPC providing HPC access and scientific support to researchers.
ITESM The computing department of the Instituto Tecnológico y de Estudios Superiores de Monterrey, Campus Estado de provides a wide range of Grid infrastructures for Latin America.
Joint Supercomputer Center of the Russian Academy of Sciences
The Joint Supercomputer Center JSCC represents HPC in the Russian Academy of Sciences. They are considered an Associate Partner.
Meraka The African Advanced Institute for Information and Communications Technology is the leading HPC centre in South Africa and is deeply involved in the South African e-infrastructure.
NAREGI The National Research Grid Initiative is the leading Japanese HPC infrastructure project.
OMII-Europe OMII-Europe is the interoperability project in Europe providing open standards based interoperability components.
PACE Partnership for Advanced Computing in Europe is aiming at installing leadership class supercomputers in Europe.
SSC The Shanghai Supercomputer Center is currently the most powerful HPC centre in China.
Supercomputing Center of the Chinese Academy of Sciences
The Supercomputing Center SCCAS represents HPC in the Chinese Academy of Sciences.
TeraGrid TeraGrid is an open scientific discovery infrastructure in the US, combining leadership class resources at nine partner sites to create an integrated, persistent computational resource.
Collaboration with other EU Projects, Institutions,…
Ingrid Conferene, Ischia, April 9-11 200821
Stefan Heinzel, DEISA
DEISA Towards a European HPC Infrastructure
TopicsVision
The DEISA/eDEISA Infrastructure
The DEISA2, the European HPC infrastructure
Ingrid Conferene, Ischia, April 9-11 200822
Stefan Heinzel, DEISA
WP4 - Technologies
WP3 - Operations
WP6/WP6/WP7/WP9 – Applications and user
support
Offer new service or
upgrade existing ones
Offer new service or
upgrade existing ones
Answer
AnswerRequest for new/upgraded services
Request for new/upgraded services
Relationship of the WPs in DEISA2 (except management, dissemination and one “real” JRA)
Ingrid Conferene, Ischia, April 9-11 200823
Stefan Heinzel, DEISA
Management Structure
Project Management
Project Management Team
Project Coordinator
Technical Board
Work Package Leaders
Technical Coordinator
Advisory Science Committee
Representatives of Science Communities
DEISA Executive Committee
Principal Partners Representative of Associate Partners
Extended DEC
Associate PartnersPrincipal Partners
rep
ort
s de
cid
es
ad
vice
Quality AssuranceCoordinator
Ingrid Conferene, Ischia, April 9-11 200824
Stefan Heinzel, DEISA
DEISA2
WP1 Management
WP2 Dissemination, External Relations
WP3 Operations
WP4 Technologies
WP5 Applications enabling
WP6 Environment, User Related Application Services, and
Training
WP7 DECI Computing Projects and Benchmark Suite
WP8 (JRA) Integrated DEISA Development Environment
WP9 (JRA) Enhancing Scalability
Ingrid Conferene, Ischia, April 9-11 200825
Stefan Heinzel, DEISA
DEISA Partners
DEISA Start on 1st of May 2004Three new partners joined with eDEISA June 2005
DEISA2 should start 1st of May 2008 with 3 new Associate Partners for 3 years