EESI FP7 Support Action - European Exascale Software Initiative DG Information Society and the unit e-Infrastructures

Inves&ga&on  of  Exis&ng  HPC  Ini&a&ves  

EESI  Deliverable  2.2    Mark  Parsons,  Lorna  Smith,  Xu  Guo  –  EPCC  Damien  Lecarpentier,  Per  Oster  –  CSC    

EESI FP7 Support Action - European Exascale Software Initiative DG Information Society and the unit e-Infrastructures

Inves&ga&on  of  Exis&ng  HPC  Ini&a&ves  

EESI  Deliverable  2.2    Mark  Parsons,  Lorna  Smith,  Xu  Guo  –  EPCC  Damien  Lecarpentier,  Per  Oster  –  CSC    

EESI

p  Investigation of existing large scale HPC initiatives n  Particularly focused on the US, Asia and Europe n  Initial report (Sept 2010), final report (Aug 2011) n  Excellent input from the community – many thanks

p  Objectives n  Provide details of large-scale HPC initiatives in the US, Asia and

Europe; n  Examine trends and future developments in this area; n  Understand Europe’s current position in the International HPC

landscape; n  Provide a baseline and guide for the EESI road map activity

Overview  

3

EESI

p  Americas n  US (by far the largest consumer of HPC in this region) n  Canada and Brazil also notable systems and activities

p  Asia n  China, Japan, South Korea, India

p  Europe n  EESI partners: UK, France, Germany,

Spain, Italy, Finland, Netherlands n  Switzerland and Sweden

p  Russia p  The best of the rest..

n  Australia, South Africa and the Square Kilometre Array

p  Cross country/continent funding

Coverage  

4

EESI

p  All extremely large consumers / producers of HPC n  Separate reports and updates from each of

these countries provided by other speakers

n  Better able to explain than I!

p  However an outsider’s view of the most exciting initiatives worthwhile n  Will keep it concise

p  Main focus will be on other countries and cross country/continent initiatives

US,  China  and  Japan  

5

EESI Americas  –  the  US  

6

EESI

p  Multi-petaflop systems expected in 2012 n  Imminent release of BlueGene/Q

p  Sequoia (LLNL) anticipated ~20PFLOPS peak p  Mira (ANL) anticipated ~10PFLOPS peak

n  Cray system at ORNL anticipated in 2012 p  Titan, ~20 PFLOPS anticipated

n  Upgrades to Pleiades (NASA Ames) also reported p  Blue Waters

n  NCSA still expect to obtain a petaflop system

US  

7

n  Continues to be a dominant HPC player n  Five current petascale systems in the TOP500 n  Jaguar, Ceilo, Pleiades, Hopper and

Roadrunner

EESI

p  President Obama’s 2012 budget provided $126M for the development of an exascale system, through the DoE

p  DoE’s Exascale Software Center (ESC) and the associated Co-Design centres n  Exciting and progressive plans n  developing an “exascale-capable system software stack built

around the co-design process”

p  Note the recent request for information by “E7” n  To assist the planning of the DoE’s exascale program n  E7 – 7 DoE laboratories

US  

8

EESI

n  Japan n  China n  South Korea n  India

Asia  

9

EESI

p  Japan’s representation in the TOP500 has increased significantly n  8PFLOP Next Generation System (K Computer, at RIKEN AICS, Kobe) n  More powerful than the next 5 systems combined n  TSUBAME 2.0 (Tokyo Institute of Technology), at No5 n  Announcements of TSUBAME 3.0 have also been made (aiming for

30PFLOPS, 2014-2015) p  In the future

n  Various speakers noted the 4th Science and Technology Basic Plan will contain plans to develop exaflop class HPC technology

Japan  

10

n  “Japan Reclaims Top Ranking on Latest TOP500 List of World’s Supercomputers” – www.top500.org

EESI

n  Considerable investment in exploitation of these systems p  5 strategic programs have been created to encourage research in

critical areas for Japan n  Innovative High Performance Computing Infrastructure (HPCI)

p  Desire to place more emphasis on the user point of view p  Aims to establish a heirarchical organisation of the NGS with other

supercomputers n  The Post-Peta HPC technologies program

p  Software oriented program preparing the way towards exascale ($5M for 5 years)

p  First round of proposal’s already accepted n  Public-private initiatives also notable in Japan

p  Exascale Application and Data Initiative (EADI) p  Led by Fujitsu

Japan  

11

EESI

p  62 systems in the TOP500 p  2 systems with sustained petaflop performance p  Tianhe-1A

n  2.56 PFLOPS sustained, 4.70 PFLOPS peak p  Nebulae

n  1.27 PFLOPS sustained, 2.98 PFLOPS peak

China  

12

n  China has grown to an international HPC leader over the last few years

EESI

p  Has a growing set of domestic manufacturers n  Dawning, Lenovo, NUDT, Inspur n  Provided 45% of top100 Chinese HPC systems (2009)

p  Note China’s on-going commitment to HPC n  Previous IESP talk noted the 12th Five year plan is committed to

many petaflop systems + 1 50-100 PFLOPS system

p  Chinese speakers previously noted the small number of large-scale applications n  Investment addressing this issue

China  

13

EESI

Korea’s National Supercomputing Promotion Act

n Approved April 2011 n aims to increase investment in the HPC ecosystem n June 2011 saw a significant increase in HPC systems

p  Korea’s Meteorological Administration hosts No20 and No21

p  KISTI hosts No 26

South  Korea  and  India  

14

India has a small presence in the TOP500

n  Choosing to invest in small/medium HPC centres

p  EKA at No 58 n  However C-DAC currently

building a petaflop system p  Due 2012 p  Based on PARAM series

n  Media reports suggest $3.5 billion budget

p  to develop an indigenous exascale system by 2017

EESI

n  EESI Partners p  UK p  Finland p  France p  Germany p  Spain p  Italy p  Netherlands

n  Also p  Sweden p  Switzerland

Europe  

15

EESI

n  The European Commission p  Significant HPC funding under the FP7 capacities program p  In addition to national funding sources

n  Europe hosts a significant proportion of the TOP500 p  125 systems, slightly larger than Asia

n  Smaller indigenous HPC manufacturing industry p  BULL system in the top 10 systems

n  Excels at software development n  Notable for public-private partnerships in Exascale technologies

Europe  

16

n  Europe benefits from a strong overarching body in the European Commission

EESI European  Commission  –  Key  Projects    

17

European  Commission  SigniCicant  Investment  under  FP7  capacities  program  

EESI  Building  a  European  Exascale  Software  

RoadMap  

Exascale  Computing  Projects  

CRESTA,  DEEP,  Mont  Blanc  

Computing  Systems    15  projects.  

Breakthroughs  in  transition  to  multi-­‐

core  

TEXT  New  programming  models  for  Exascale  

PRACE  Building  a  world-­‐class  European  HPC  capability  

EESI

n  EESI p  Building a European Software Roadmap

§  8 core partners, 17 associate partners, wide spread engagement

§  Series of working groups and conferences §  Looking at Europe’s strengths and weaknesses,

prioritising actions

n  EU Computing Systems p  45M€, 15 projects p  Aims to re-enforce European excellence in multi-core

architectures, software and tools

EESI  and  EU  compuAng  systems  call  

18

EESI

n  PRACE p  Building a world-class HPC capacity for Europe p  Strengthening Europe’s scientific and industrial

competitiveness p  21 countries p  2 x PFLOP systems (France and Germany), more anticipated p  1IP (20M€), 2IP (35M€), additional 400M€ from national

funding

n  TEXT p  New parallel programming models for Exascale p  Focused on StarSS from Barcelona p  9 partners

PRACE  and  TEXT  

19

EESI

n  EU objective to develop a small number of advanced computing platforms

p  25M€, three projects selected n  CRESTA

p  Developing Exascale Systemware in a co-design process with key European applications

p  Systemware spans full software stack n  Mont-Blanc

p  First generation system built from energy efficient embedded technology

p  Design next generation system capable of 200PFLOPS peak n  DEEP

p  Developing a novel exascale enabling platform together with and optimised set of applications

p  Proof-of-concept Cluster Booster Architecture

EU  Exascale  Projects  

20

EESI

n  European excellence in public private partnerships targeted at Exascale

EU  Public  Private  Partnerships  

21

Exascale  Innovation  Centre  Germany  FZG,  IBM  

ExaCluster  Laboratory  Germany  

FZG,  Intel,  ParTec  

Exascale  Computing  Research  Centre  

France  CEA,  GENCI,  UVSQ,  INTEL  

 Flanders  ExaScience  Lab  

Belgium  Intel,  Imec,  U  of  Antwerp,  Ghent  and  Hasselt,  KUL,  

VUB    

Exascale  Stream  Computing  Collaboratory  

Ireland  IBM,  TCD,  Tyndall,  NUIG,  UCC,  IRCSET,  IRCSET  

Exascale  Technology  Centre  UK  

Cray*,  EPCC    

*Part of a wider Cray Exascale initiative including CSCS and Allinea

EESI

n  28M€ investment in 2010 to develop HPC technologies n  Lomonosov (Moscow State University)

p  No 13 in the TOP500, holds the No1 spot in the GRAPH500 ranking p  Manufactured by T-Platforms

n  T-Platforms - Leading Russian HPC manufacturer p  Established in 2002, has installed over 200 HPC systems p  Chosen to provide HPC resources to Russian companies ($6M) p  RSC (est in 2009), developing advanced liquid cooling systems

Russia  

22

n  Russia has recently increased its spending to become a major player in the HPC market

EESI

n  A number of national programs and partnerships p  SKIF GRID fostering technology development in the HPC and Grid

field n  Interest in HPC in Russia is growing

p  Nationwide Russian “Supercomputers” magazine published §  Circulation of 5000, quarterly

p  Has its own TOP50, started in 2004 n  Supercomputing Consortium of Russian Universities

p  Aimed at the effective use of existing potential to develop supercomputing technologies

p  Over 50 full and associate members n  SCRU is responsible for the “Supercomputing Education” project

p  To incorporate supercomputing technologies into the higher education system

Russia  

23

EESI

p  Two projects selected: APOS and HOPSA p  APOS

n  Developing optimised scientific and industrial codes, scalable across heterogeneous and homogeneous architectures

p  HOPSA n  Investigating the interplay between system and application

performance and addressing the challenges of these two requirements

EU  Russia  CollaboraAon  

24

Joint EU Russia call launched in 2009, 6M€ project

EESI

p  IESP p  G8 Research Council Initiative p  The Square Kilometre Array

The  Best  of  the  Rest..  

25

EESI

p  International Exascale Software Project

p  International initiative to define a comprehensive roadmap for Exascale software

p  Series of workshops

p  Roadmap recently published in the Journal of High Performance Computing Applications

IESP  

26

EESI

Application Software towards Exascale Computing for Global Scale Issues -10M€

G8  Research  Council  IniAaAve  

27

ExArch   RAL  (UK),  CMCC  (Italy),  Princeton  (USA),  IPSL  (France),  DKRZ  (Germany),  STFC  (UK),  UoT  (Canada),  UoC  (USA)

a  software  management  infrastructure  to  scale  to  the  multi-­‐exabyte  archives  of  climate  data      

Seismic  Imaging    

Princeton,  (USA),  Pau  &  Toulouse  (France),  UoT  (Canada).    

using  modern  numerical  methods  and  computers  to  improve  images  of  earthquakes  and  the  Earth's  interior  

ECS UoI  (USA),  INRIA  (France),  NCAR  (USA),  TIoT  (Japan),  BSC  (Spain),  UoV  (Canada),  UoI  (USA).

international  collaboration  to  identify  roadblocks  and  test  initial  solutions  for  the  execution  of  climate  codes  at  extreme  scale  

ICOMEX DW  (Germany),  EP  (France),  MPI  for  A    (Germany),  UoH  (Germany),  UoEx  (UK),  RIGC  (Japan)

preparing  state-­‐of-­‐the-­‐art  Earth  system  models  (ESMs)  based  onicosahedral  grids  for  future  application  on  exascale  computing  platforms

INGENIOUS RIKEN  (Japan),  Aston  (UK),  UoC  (UK),  MINS  (Russia),  Osaka  (Japan)

a  new  efCicient  theoretical  and  computational  framework  for  hybrid  molecular  dynamics  

NuFuSE   UoE  (UK),  Tsukuba  (Japan),  TUM  (Germany),  KIAM  (Russia),  CEA  France,  MPIfP  (Germany),  Princeton  (USA)

Exascale  computations  of  key  plasma  physics  and  materials  science  processes  to  speed  up  the  realisation  of  fusion  power  plants

EESI

p  Volume of data to be processed will be huge n  ~20GB per second, generally accepted exaflop systems will be required

p  The location of the telescope (and HPC system) is not yet decided p  Bids from:

n  Australia and New Zealand n  South Africa + 8 African countries

The  Square  Kilometre  Array  

28

n  Will be the world’s largest and sensitive radio telescope

n  To be built by 2024, 1.5B€ project, over 20 countries

EESI

p  Australia n  Invested 80M AUD (58M€) in the Pawsey Supercomputing Centre n  Hosts an 87TFLOPS system, stage 2 plans for a petascale resource

p  South Africa n  Strengthening facilities through the Centre for HPC (CHPC) n  “In the process of upgrading its capacity … to cement SA’s position in the

TOP500 list” n  Partnership with Intel South Africa to evaluate Intel technologies to

process the enormous amount of data produced

The  Square  Kilometre  Array  

29

EESI

p  Tracked current major HPC initiatives world-wide n  Particularly US, Asia and Europe

p  Significant investment world-wide in next generation HPC systems and software

p  US, China and Japan are investing the largest amounts in HPC n  However investment in other counties also substantial

p  Some cross country/continent projects exist n  E.g. IESP, G8 Exascale call

p  Further details available in the report n  See the EESI web site n  See: http://www.eesi-project.eu/

Conclusions  

30