PRACE | In Service to HPC
Transcript of PRACE | In Service to HPC
1 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
PRACE | In Service to HPC
Chair of the PRACE Council
Thomas Lippert
2 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
OVERVIEW
3 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
PRACE | Services▶ Open access to leadership HPC systems for EU researchers
▶ Peer Review at European level – science led (SSC)
▶ Operation of a unified set of services
▶ Architectural variety meeting all sorts of algorithmic needs
▶ Support of Industry on European HPC systems (… SHAPE)
▶ Training by PTCs, Seasonal Schools, SoHPC, etc
▶ Application Enabling by HLSTs, Preparatory Access, support for CoEs
▶ Market Watch on HPC procurement/prototyping, infrastructure workshops
4 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
Who is Servicing HPC ?
5 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
MareNostrum: IBMBSC, Barcelona, Spain#25 Top 500
JUWELS (Module 1): Bull Sequana
GAUSS @ FZJ, Jülich, Germany #26 Top 500
JOLIOT CURIE : Bull SequanaGENCI/CEA, Bruyères-le-Châtel, France #40 Top 500
NEW ENTRY 2018/2019SuperMUC NG : Lenovo cluster GAUSS @ LRZ, Garching, Germany #8Top 500
Hazel Hen: Cray GAUSS/HLRS,
Stuttgart, Germany#30 Top 500
MARCONI: LenovoCINECA, Bologna, Italy#19 Top 500
Piz Daint: Cray XC50CSCS, Lugano, Switzerland#5 Top 500
PRACE | Tier-0 Systems 2018
NEW ENTRY 2018
NEW ENTRY 2018
Close to 110 Pflops cumulatedpeak performance
Close to 110 Petaflops cumulated peak
performance
6 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
The European HPC Systems Map (t.b.p.)26 PRACEMembers
BelgiumBulgariaCyprusCzech RepublicDenmarkFinlandGreeceHungaryIrelandIsraelLuxembourgNetherlandsNorwayPolandPortugalSlovakiaSloveniaSwedenTurkeyUnited Kingdom
FranceGermanyItalySpainSwitzerland
7 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
European Provisioning Pyramid
EUTier-0
NationalTier1
RegionalTier-2
8 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
▶ Ancestor 2002 – DEISA Project (Victor Alessandrini, F)
▶ First Ideas 2003 – HPC-Euro Interest Group (Hugh Pilcher Clayton, UK)
▶ Closing in 2006 – HPC in Europe Task Force (HET) (Kimmo Koski, FL)
▶ ESFRI 2006 – HPC on the Roadmap
▶ PRACE MoU 2007 (Alain Lichnewsky, F, Achim Bachem, D)
▶ PRACE Signature 2010 (Achim Bachem, D)
▶ PRACE II 2016 (Anwar Osseyran, NL)
PRACE | Milestones
9 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
PRACE | Implementation Projects
▶ PRACE-IP projects accelerate the implementation of the PRACE RI
▶ IP Projects supported by EC with >100 Million €
2008
PRACE RI
2009 2010 2011 2012
PRACE Initiative
PRACE-PP PRACE-1IP PRACE-3IP
PRACE-2IP
20142013 2015 2016 2017 2018PCP
PRACE-4IPPRACE-5IP
2019
10 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
PRACE | Achievements
▶ 688 scientific projects enabled
▶ 110 Petaflops of peak performance on 7 Tier-0 systems
▶ >21 billion since 2010 - 63% led by PI not from HM
▶ >50 companies supported
▶ >12 000 people trained through PRACE Training
11 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
HIGHLIGHTS
12 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
▶ Identification of gravitational wave signals
from merging black holes
▶ Model signals across the parameter space of
plausible binary mergers ≧ 7 dimensions!
▶ Model Input: solutions of Einstein’s Equations
▶ 1 point in parameter space ~ O(105) CPU hours
▶ Templates for analysis: LIGO/Virgo detectors
Modelling GravitationalWave Signals
Lead Institution: UIB (Spain) - collaborators from UK, Germany, India; 33 Mio Core hrs
Modelsfor Nobles
13 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
Mare Nostrum @ BSC – 2017
OPAMare
Nostrum2016
p9+Volta
Mare Nostrum
6480Skylake
3456 nodes394 TB RAM, 830 TB SSD
14 PB disktape storage n/a
14 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
▶ Excitonic Insulator Phase: instability of a zero gap semiconductor against tendency of mutually attracting electrons and holes to form bound pairs
▶ Idea: W. Kohn in 1968, but observation of EIP still elusive▶ Finally Proved on CINECA systems by ab initio simulations
(QMC): below a critical temperature the exciton phase is present theoretically, EIP is realized in zero gap carbon nanotubes (CNT)
Carbon Nanotubes as Excitonic Insulators
Carbon nanotubes as excitonic insulators, D. Varsano, S. Sorella, D. Sangalli, M. Barborini, S. Corni, E. Molinari and M. Rontani NatureCommunications8, 1461 (2017)
ForefrontSimulation
15 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
Marconi @ CINECA – 2017
OPA
Marconi4608
Shkylake
Marconi3600KNL
Marconi1440
Broadwell
6600 server nodes560 TB memory
15 PB disk60 PB tape storage
16 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
▶ Convection needs km-scale resolution
▶ Significant improvements in representation of diurnal cycle, heavy precipitation and clouds
▶ COSMO model scales to 5300 GPU accelerated nodes, runs 2-3x faster than on TaihuLight(present #1 on Top500)
Convection ResolvingClimate Simulations
World Record inCode Acceleration
PI: Christoph Schaer, ETH, Convection-resolving Climate on GPUs (gpuCLIMATE), 170 Million core-hours
17 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
Piz Daint @ CSCS – 2016
Cray Aries
Piz Daint5320
Haswell + Tesla
6751 server nodes600 TB memory
10 PB disktape storage
Piz Daint2862
Broadwell
18 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
▶ Renault: New optimization methods based on 20 million d.o.f. finite elements mesheswith 200 different parameters
▶ Anticipate new security rules (EuroNCAP6)▶ Impossible with existing Renault R&D facilities
▶ World premiere:
5 years lead for
Biggest Crash Optimization Ever
42 million core hours allocated on the CURIE Tier-0 (GENCI)
Push Competitivenessof European Industry
19 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
Curie @ GENCI – 2013
Mellanox IB QDRCurie188
Westmere + Tesla
Curie1440
Nehalem
Curie10080
Sandy Bridge
5588 server nodes360 TB memory
6 PB disk10 PB tape storage
20 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
HPC Welding- A SHAPE Project
SHAPE: SME HPC Adoption Programme in Europe
PRACE Brings SMEs to HPC
▶ Simulation of multi-layered welding lines▶ Close collaboration with office of welding
and DYNAmore supporting LS-DYNA▶ The SME gained significant
knowledge and experience in HPC▶ The SME sees high
commercial benefit as to better cost estimates
21 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
Hazel Hen @ HLRS – 2015
Cray Aries
Hazel Hen15424Haswell
7712 server nodes964 TB memory
10 PB disktape storage
22 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
▶ Solving an 80 year old riddle▶ Understanding the mass difference
of proton and neutron by simulation of the fundamental theory, QCD
▶ 80 years after the experimental detection: simulation on JUQUEEN
Daß ich erkenne, was die Welt, imInnersten zusammenhält
PI: Zoltán Fodor, Ab inition calculation of the neutron-proton mass difference, Science 347 (2015) 1452-1455, 150 Mio core hours.
Results for Textbooks
That I may understand whatever,Binds world’s inner core togetherFaust, J. W. Goethe
23 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
JUQUEEN @ JSC – 2012
BGQ 5D Torus
JUQUEEN28672
Power BQC
28672 nodes448 TB memory
18 PB disk75 PB tape storage
24 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
▶ How to evaluate the black hole EHT data?
▶ Simulate about 60 k magneto-hydro-dynamical models of the space around the event horizon
▶ Highly efficient, well parallelized numerical implementation on SuperMUC
▶ Essential to understand physics separated from background
Black Hole Simulations EnablingBreakthroughObservations
25 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
SuperMUC @ LRZ – 2015
MellanoxIB QDR
SuperMuc360
KNL
SzperMUC210752Haswell
SuperMUC19252
Sandy Bridge
15062 server nodes537 TB memory
15 PB disk30 PB tape storage
MellanoxIB FDR
MellanoxIB FDR
26 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
PRACE | Scientific Case 2018“Future Infrastructures and operations will need to be much more diverse to support HPC, Data Science and different types of accelerators - but we also need to avoid fragmentation.”
PRACE Scientific Case PRACE SSC
27 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
PRACE | Scientific Case 2018▶ Scientific applications demand
▶ by factors more compute cycles▶ augmented memory bandwidth & I/O
▶ New methods grow exponentially ▶ scaling by ensembles, deep learning, stat. models
▶ Software & algorithms ▶ PRACE & Europe need most ambitious strategy to
develop the SW part of next-generation computing
28 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
PRACE | EuroHPC
29 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
PRACE in the EuroHPC EraPosition Paper
▶ Status Analysis▶ Impact Analysis▶ PRACE in the EuroHPC Era
− Creating synergies− Evolution of PRACE Services− Towards a partnership
▶ http://www.prace-ri.eu/prace-eurohpc-positionpaper/Published 7 January, 2019
30 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
Consultations are starting▶ PRACE & EuroHPC Consultations starting▶ PRACE SSC has met EuroHPC INFRAG yesterday▶ High-level meeting of EuroHPC and PRACE planned in June▶ Formation of Working Groups▶ Topics
▶ Access▶ Training▶ Applications▶ Funding▶ and more
31 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE
www.prace-ri.eu