BSC Slides v - riscv.org · 5/16/2018  · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72...

16

Transcript of BSC Slides v - riscv.org · 5/16/2018  · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72...

Page 1: BSC Slides v - riscv.org · 5/16/2018  · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores
Page 2: BSC Slides v - riscv.org · 5/16/2018  · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores
Page 3: BSC Slides v - riscv.org · 5/16/2018  · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores

MareNostrum

Sergi Girona Operations Director

May, 2018 Barcelona

Page 4: BSC Slides v - riscv.org · 5/16/2018  · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores

MareNostrum4 Total peak performance: 13,7 Pflops/s

12 times more powerful than MareNostrum 3

80%

Access: prace-ri.eu/hpc_acces

16%

Access: bsc.es/res-intranet

4%

Page 5: BSC Slides v - riscv.org · 5/16/2018  · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores

From MN3 to MN4

Page 6: BSC Slides v - riscv.org · 5/16/2018  · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores

General Purpose for current BSC

workload

11.15 Pflops/s

3,456 nodes of Intel Xeon Platinum

processors

390 Terabytes of Main Memory

14PB storage

Page 7: BSC Slides v - riscv.org · 5/16/2018  · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores

General Purpose for current BSC

workload

11.15 Pflops/s

3,456 nodes of Intel Xeon Platinum

processors

390 Terabytes of Main Memory

14PB storage

Page 8: BSC Slides v - riscv.org · 5/16/2018  · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores

General Purpose for current BSC

workload

11.15 Pflops/s

3,456 nodes of Intel Xeon Platinum

processors

390 Terabytes of Main Memory

14PB storage

Page 9: BSC Slides v - riscv.org · 5/16/2018  · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores

Interconnected with OmniPath

network

Page 10: BSC Slides v - riscv.org · 5/16/2018  · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores

Interconnected with OmniPath

network

Page 11: BSC Slides v - riscv.org · 5/16/2018  · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores

Emerging Technologies, for evaluation

of 2020 Exascale systems

3 systems, each of more than 0,5

Pflops/s with

Power9+NVIDIA, ARMv8, “KNH”

Page 12: BSC Slides v - riscv.org · 5/16/2018  · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores

Total peak performance

13,7 Pflops/s

12 times more powerful than

MareNostrum 3

Page 13: BSC Slides v - riscv.org · 5/16/2018  · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores

3456 nodes

394 TB RAM

48 racks 72 nodes/rack 165 888 cores

3240 thin(2GB/core)

216 fat (8GB/core)

155 520 cores

10 368 cores

830 TB SSD

1.5 Mwatt (not to exceed)

2 x Intel Platinum, 24 cores, 2.1GHz, 32 flops/cycle, 512 AVX

General Purpose Cluster Rpeak: 11.15 Pflops HPL: 6.47 Pflops* (16th) HPCG: 0.122 Pflops* (15th)

Network: OPA, Full fat tree no-contention

Page 14: BSC Slides v - riscv.org · 5/16/2018  · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores

Emerging Technology Cluster, POWER9 Rpeak: 1.57 Pflops

54 nodes

27 TB RAM

3 racks

345 TB NVME

105 Kw*

2 x Power9, 20 cores, 2.0GHz, (2.87GHz Turbo) 4 x Volta GPU, NVLINK 2.0, 16 GiB 2 x NVMe 3.2 TB 512 GB 2 x 1.9 GB SSD

Network: EDR, Full fat tree no-contention

Page 15: BSC Slides v - riscv.org · 5/16/2018  · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores

HPC Storage

Disk storage total usable capacity of 14 PB Write: 126 GB/s Read: 203 GB/s GPFS – Spectrum Scale

7 x ESS GL6 2 x IBM Power System 822L

6 x DCS3700 JBOD expansions

348 x 8 TB NL-SAS , total 19.4 PB raw

2x Metadata block 2 x IBM Power System 822L

2 x Flash System V900

Total 228 TB

Page 16: BSC Slides v - riscv.org · 5/16/2018  · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores

Enjoy MareNostrum and Barcelona

8/05/2018