EESI FP7 Support Action - European Exascale Software Initiative DG Information Society and the unit e-Infrastructures
Inves&ga&on of Exis&ng HPC Ini&a&ves
EESI Deliverable 2.2 Mark Parsons, Lorna Smith, Xu Guo – EPCC Damien Lecarpentier, Per Oster – CSC
EESI FP7 Support Action - European Exascale Software Initiative DG Information Society and the unit e-Infrastructures
Inves&ga&on of Exis&ng HPC Ini&a&ves
EESI Deliverable 2.2 Mark Parsons, Lorna Smith, Xu Guo – EPCC Damien Lecarpentier, Per Oster – CSC
EESI
p Investigation of existing large scale HPC initiatives n Particularly focused on the US, Asia and Europe n Initial report (Sept 2010), final report (Aug 2011) n Excellent input from the community – many thanks
p Objectives n Provide details of large-scale HPC initiatives in the US, Asia and
Europe; n Examine trends and future developments in this area; n Understand Europe’s current position in the International HPC
landscape; n Provide a baseline and guide for the EESI road map activity
Overview
3
EESI
p Americas n US (by far the largest consumer of HPC in this region) n Canada and Brazil also notable systems and activities
p Asia n China, Japan, South Korea, India
p Europe n EESI partners: UK, France, Germany,
Spain, Italy, Finland, Netherlands n Switzerland and Sweden
p Russia p The best of the rest..
n Australia, South Africa and the Square Kilometre Array
p Cross country/continent funding
Coverage
4
EESI
p All extremely large consumers / producers of HPC n Separate reports and updates from each of
these countries provided by other speakers
n Better able to explain than I!
p However an outsider’s view of the most exciting initiatives worthwhile n Will keep it concise
p Main focus will be on other countries and cross country/continent initiatives
US, China and Japan
5
EESI Americas – the US
6
EESI
p Multi-petaflop systems expected in 2012 n Imminent release of BlueGene/Q
p Sequoia (LLNL) anticipated ~20PFLOPS peak p Mira (ANL) anticipated ~10PFLOPS peak
n Cray system at ORNL anticipated in 2012 p Titan, ~20 PFLOPS anticipated
n Upgrades to Pleiades (NASA Ames) also reported p Blue Waters
n NCSA still expect to obtain a petaflop system
US
7
n Continues to be a dominant HPC player n Five current petascale systems in the TOP500 n Jaguar, Ceilo, Pleiades, Hopper and
Roadrunner
EESI
p President Obama’s 2012 budget provided $126M for the development of an exascale system, through the DoE
p DoE’s Exascale Software Center (ESC) and the associated Co-Design centres n Exciting and progressive plans n developing an “exascale-capable system software stack built
around the co-design process”
p Note the recent request for information by “E7” n To assist the planning of the DoE’s exascale program n E7 – 7 DoE laboratories
US
8
EESI
n Japan n China n South Korea n India
Asia
9
EESI
p Japan’s representation in the TOP500 has increased significantly n 8PFLOP Next Generation System (K Computer, at RIKEN AICS, Kobe) n More powerful than the next 5 systems combined n TSUBAME 2.0 (Tokyo Institute of Technology), at No5 n Announcements of TSUBAME 3.0 have also been made (aiming for
30PFLOPS, 2014-2015) p In the future
n Various speakers noted the 4th Science and Technology Basic Plan will contain plans to develop exaflop class HPC technology
Japan
10
n “Japan Reclaims Top Ranking on Latest TOP500 List of World’s Supercomputers” – www.top500.org
EESI
n Considerable investment in exploitation of these systems p 5 strategic programs have been created to encourage research in
critical areas for Japan n Innovative High Performance Computing Infrastructure (HPCI)
p Desire to place more emphasis on the user point of view p Aims to establish a heirarchical organisation of the NGS with other
supercomputers n The Post-Peta HPC technologies program
p Software oriented program preparing the way towards exascale ($5M for 5 years)
p First round of proposal’s already accepted n Public-private initiatives also notable in Japan
p Exascale Application and Data Initiative (EADI) p Led by Fujitsu
Japan
11
EESI
p 62 systems in the TOP500 p 2 systems with sustained petaflop performance p Tianhe-1A
n 2.56 PFLOPS sustained, 4.70 PFLOPS peak p Nebulae
n 1.27 PFLOPS sustained, 2.98 PFLOPS peak
China
12
n China has grown to an international HPC leader over the last few years
EESI
p Has a growing set of domestic manufacturers n Dawning, Lenovo, NUDT, Inspur n Provided 45% of top100 Chinese HPC systems (2009)
p Note China’s on-going commitment to HPC n Previous IESP talk noted the 12th Five year plan is committed to
many petaflop systems + 1 50-100 PFLOPS system
p Chinese speakers previously noted the small number of large-scale applications n Investment addressing this issue
China
13
EESI
Korea’s National Supercomputing Promotion Act
n Approved April 2011 n aims to increase investment in the HPC ecosystem n June 2011 saw a significant increase in HPC systems
p Korea’s Meteorological Administration hosts No20 and No21
p KISTI hosts No 26
South Korea and India
14
India has a small presence in the TOP500
n Choosing to invest in small/medium HPC centres
p EKA at No 58 n However C-DAC currently
building a petaflop system p Due 2012 p Based on PARAM series
n Media reports suggest $3.5 billion budget
p to develop an indigenous exascale system by 2017
EESI
n EESI Partners p UK p Finland p France p Germany p Spain p Italy p Netherlands
n Also p Sweden p Switzerland
Europe
15
EESI
n The European Commission p Significant HPC funding under the FP7 capacities program p In addition to national funding sources
n Europe hosts a significant proportion of the TOP500 p 125 systems, slightly larger than Asia
n Smaller indigenous HPC manufacturing industry p BULL system in the top 10 systems
n Excels at software development n Notable for public-private partnerships in Exascale technologies
Europe
16
n Europe benefits from a strong overarching body in the European Commission
EESI European Commission – Key Projects
17
European Commission SigniCicant Investment under FP7 capacities program
EESI Building a European Exascale Software
RoadMap
Exascale Computing Projects
CRESTA, DEEP, Mont Blanc
Computing Systems 15 projects.
Breakthroughs in transition to multi-‐
core
TEXT New programming models for Exascale
PRACE Building a world-‐class European HPC capability
EESI
n EESI p Building a European Software Roadmap
§ 8 core partners, 17 associate partners, wide spread engagement
§ Series of working groups and conferences § Looking at Europe’s strengths and weaknesses,
prioritising actions
n EU Computing Systems p 45M€, 15 projects p Aims to re-enforce European excellence in multi-core
architectures, software and tools
EESI and EU compuAng systems call
18
EESI
n PRACE p Building a world-class HPC capacity for Europe p Strengthening Europe’s scientific and industrial
competitiveness p 21 countries p 2 x PFLOP systems (France and Germany), more anticipated p 1IP (20M€), 2IP (35M€), additional 400M€ from national
funding
n TEXT p New parallel programming models for Exascale p Focused on StarSS from Barcelona p 9 partners
PRACE and TEXT
19
EESI
n EU objective to develop a small number of advanced computing platforms
p 25M€, three projects selected n CRESTA
p Developing Exascale Systemware in a co-design process with key European applications
p Systemware spans full software stack n Mont-Blanc
p First generation system built from energy efficient embedded technology
p Design next generation system capable of 200PFLOPS peak n DEEP
p Developing a novel exascale enabling platform together with and optimised set of applications
p Proof-of-concept Cluster Booster Architecture
EU Exascale Projects
20
EESI
n European excellence in public private partnerships targeted at Exascale
EU Public Private Partnerships
21
Exascale Innovation Centre Germany FZG, IBM
ExaCluster Laboratory Germany
FZG, Intel, ParTec
Exascale Computing Research Centre
France CEA, GENCI, UVSQ, INTEL
Flanders ExaScience Lab
Belgium Intel, Imec, U of Antwerp, Ghent and Hasselt, KUL,
VUB
Exascale Stream Computing Collaboratory
Ireland IBM, TCD, Tyndall, NUIG, UCC, IRCSET, IRCSET
Exascale Technology Centre UK
Cray*, EPCC
*Part of a wider Cray Exascale initiative including CSCS and Allinea
EESI
n 28M€ investment in 2010 to develop HPC technologies n Lomonosov (Moscow State University)
p No 13 in the TOP500, holds the No1 spot in the GRAPH500 ranking p Manufactured by T-Platforms
n T-Platforms - Leading Russian HPC manufacturer p Established in 2002, has installed over 200 HPC systems p Chosen to provide HPC resources to Russian companies ($6M) p RSC (est in 2009), developing advanced liquid cooling systems
Russia
22
n Russia has recently increased its spending to become a major player in the HPC market
EESI
n A number of national programs and partnerships p SKIF GRID fostering technology development in the HPC and Grid
field n Interest in HPC in Russia is growing
p Nationwide Russian “Supercomputers” magazine published § Circulation of 5000, quarterly
p Has its own TOP50, started in 2004 n Supercomputing Consortium of Russian Universities
p Aimed at the effective use of existing potential to develop supercomputing technologies
p Over 50 full and associate members n SCRU is responsible for the “Supercomputing Education” project
p To incorporate supercomputing technologies into the higher education system
Russia
23
EESI
p Two projects selected: APOS and HOPSA p APOS
n Developing optimised scientific and industrial codes, scalable across heterogeneous and homogeneous architectures
p HOPSA n Investigating the interplay between system and application
performance and addressing the challenges of these two requirements
EU Russia CollaboraAon
24
Joint EU Russia call launched in 2009, 6M€ project
EESI
p IESP p G8 Research Council Initiative p The Square Kilometre Array
The Best of the Rest..
25
EESI
p International Exascale Software Project
p International initiative to define a comprehensive roadmap for Exascale software
p Series of workshops
p Roadmap recently published in the Journal of High Performance Computing Applications
IESP
26
EESI
Application Software towards Exascale Computing for Global Scale Issues -10M€
G8 Research Council IniAaAve
27
ExArch RAL (UK), CMCC (Italy), Princeton (USA), IPSL (France), DKRZ (Germany), STFC (UK), UoT (Canada), UoC (USA)
a software management infrastructure to scale to the multi-‐exabyte archives of climate data
Seismic Imaging
Princeton, (USA), Pau & Toulouse (France), UoT (Canada).
using modern numerical methods and computers to improve images of earthquakes and the Earth's interior
ECS UoI (USA), INRIA (France), NCAR (USA), TIoT (Japan), BSC (Spain), UoV (Canada), UoI (USA).
international collaboration to identify roadblocks and test initial solutions for the execution of climate codes at extreme scale
ICOMEX DW (Germany), EP (France), MPI for A (Germany), UoH (Germany), UoEx (UK), RIGC (Japan)
preparing state-‐of-‐the-‐art Earth system models (ESMs) based onicosahedral grids for future application on exascale computing platforms
INGENIOUS RIKEN (Japan), Aston (UK), UoC (UK), MINS (Russia), Osaka (Japan)
a new efCicient theoretical and computational framework for hybrid molecular dynamics
NuFuSE UoE (UK), Tsukuba (Japan), TUM (Germany), KIAM (Russia), CEA France, MPIfP (Germany), Princeton (USA)
Exascale computations of key plasma physics and materials science processes to speed up the realisation of fusion power plants
EESI
p Volume of data to be processed will be huge n ~20GB per second, generally accepted exaflop systems will be required
p The location of the telescope (and HPC system) is not yet decided p Bids from:
n Australia and New Zealand n South Africa + 8 African countries
The Square Kilometre Array
28
n Will be the world’s largest and sensitive radio telescope
n To be built by 2024, 1.5B€ project, over 20 countries
EESI
p Australia n Invested 80M AUD (58M€) in the Pawsey Supercomputing Centre n Hosts an 87TFLOPS system, stage 2 plans for a petascale resource
p South Africa n Strengthening facilities through the Centre for HPC (CHPC) n “In the process of upgrading its capacity … to cement SA’s position in the
TOP500 list” n Partnership with Intel South Africa to evaluate Intel technologies to
process the enormous amount of data produced
The Square Kilometre Array
29
EESI
p Tracked current major HPC initiatives world-wide n Particularly US, Asia and Europe
p Significant investment world-wide in next generation HPC systems and software
p US, China and Japan are investing the largest amounts in HPC n However investment in other counties also substantial
p Some cross country/continent projects exist n E.g. IESP, G8 Exascale call
p Further details available in the report n See the EESI web site n See: http://www.eesi-project.eu/
Conclusions
30
Top Related