Building the Greenest production supercomputer in the world
description
Transcript of Building the Greenest production supercomputer in the world
©2009 HP Confidential template rev. 12.10.091©2009 HP Confidential template rev. 12.10.09
Ed TurkelManager, WorldWide HPC Marketing4/7/2011
BUILDING THE GREENEST PRODUCTION
SUPERCOMPUTER IN THE WORLD
©2009 HP Confidential template rev. 12.10.092 ©2009 HP Confidential2
TSUBAME 2.0 – THE GOALS– Achieve 30x performance over Tsubame 1.0– Support diverse research workloads• Weather, informatics, protein modeling, etc.
– Balanced design for scale• Bandwidth to GPUs, CPU and GPU high memory capacity• High-bandwidth, low latency, full bi-section network• Solid state disks for high bandwidth, scalable storage I/O
– Green: stay within power threshold• System estimated to require 1.8 MW with PUE of 1.2
– Density (GPU per CPU footprint) for costs and space– Expand support for Tokyo Tech’s 2000 users; provide dynamic
“cloud-like” provisioning for both Microsoft® Windows® and Linux workloads
©2009 HP Confidential template rev. 12.10.093 ©2009 HP Confidential3
HP PROLIANT SL6500 SERVER
Performance and Flexibility•Mix and match for varying requirements•Multiple compute and storage optimized nodes
Convenient Serviceability•Individually serviceable nodes•Cool aisle cabling and node access•Hot-swap servers, fans, power supplies
Energy Efficiency•Shared power and cooling architecture•Energy efficient fans and power supplies•Common slot power supplies
Advanced Power Management• Power Capping• On/off control• Consumption/utilization logging
Designed for scalable performance and efficiency
©2009 HP Confidential template rev. 12.10.0944 ©2009 HP Confidential
HP ProLiantSL390s G7 1U
HP ProLiantSL390s G7 2U
HP ProLiantSL390s G7 4U
Dense, Fabric heavy with manageability
Dense GPU with heavy fabric,
manageabilityMaximum GPU offloaded HPC
Ideal Application Ideal Application Ideal Application
HPC compute intensiveHighly managed nodes
Balanced GPU & compute intensive HPC Extreme GPU
Eg; real-time trading Eg; general research Eg; seismic analysis
Designed for a broad set of HPC workloadsHP PROLIANT SL390s HPC SERVER
NEW
©2009 HP Confidential template rev. 12.10.0955 ©2009 HP Confidential
QPI
QPI x16 GPGPUGPGPUx16
I/OHub
Riser 2
GPGPUx16Riser 1
Dual IOH for maximum GPGPU bandwidthSL390S 2U SIMPLIFIED ARCHITECTURE
5
DDR3DDR3DDR3
Intel Xeon5500/5600
QPI
x8
x8PCI-e x8 Slot10GbE, QDR
IB
DDR3DDR3DDR3
Intel Xeon5500/5600
I/OHubQPI
Support for NVIDIA Tesla M1060, M2050, M2070, M2070-Q
©2009 HP Confidential template rev. 12.10.096 ©2009 HP Confidential6
6
SL390s s6500
MCS G2
©2009 HP Confidential template rev. 12.10.0977 ©2009 HP Confidential
HP Modular Cooling System G2 Rack enables maximum power densityCOMPUTE RACK BUILDING BLOCK FOR TSUBAME2
42U HP Modular Cooling System G2 rack,containing:
• 30 SL390s G7 2u servers per rack• 60 CPUs and 90 GPGPUs
• 8 chassis with Advanced Power Management
• 1 HP Network Switch for shared console and admin local area network
• 2 Airflow Dam• 4 Voltaire QDR IB 4036 36-port Leaf
Switch• Power distribution units
Power per rack approximately 35 KW
PDU
7
©2009 HP Confidential template rev. 12.10.098 ©2009 HP Confidential8
PULLING IT ALL TOGETHER
©2009 HP Confidential template rev. 12.10.099
2.4 Petaflops, 1440 nodes~50 compute racks + 6 switch
racksTwo Rooms, Total 160m2
1.4MW (Max, Linpack), 0.48MW (Idle)
©2009 HP Confidential template rev. 12.10.091010 ©2009 HP Confidential
The Greenest Production Supercomputer in the
World2
51% Better Performance/Watt2
*1 Nov 2010 TOP500 Results – compared to Tianhe 1A consisting of 7168 Xeon 5170 servers drawing 4.04MW, 4.7PF peak, HP internally estimated price versus 1442 HP SL390S G7 servers with Xeon 5170 processors drawing 1.39 MW, 2.3 Peak, HP Internally Estimated Price - http://www.top500.org/list/2010/11/100 *2 2010 Green 500 Results - http://www.green500.org/lists/2010/11/top/list.php
#4 Supercomputer on TOP5001
142% More TFLOPS/Server1 21% Better Price/Performance1
Tianhe-1A ORNL Jaguar
Nebulae TITECH
First 4 Top500) TFLOPS/$
#1 #2 #3 #4
TFLO
PS /
$
HP
Most TFLOP/$
Innovation on top of industry standards delivers price and power advantagesINDUSTRY LEADING PERFORMANCE/WATT/$$
©2009 HP Confidential template rev. 12.10.0911 ©2009 HP Confidential11
©2009 HP Confidential template rev. 12.10.0912 ©2009 HP Confidential12
EXAMPLE APPLICATIONS– 3D Protein Rigid Docking
(Node 3-D FFT)– ASUCA Weather Forecast
[SC10 Best Student Paper Finalist]
– Multiscale Simulation of Cardiovascular flows [SC10 Gordon Bell Finalist]
– Materials (Dendrite Solidification)
– Earthquake Simulation
©2009 HP Confidential template rev. 12.10.0913
“... Tokyo Tech Tsubame2 is by far the most power dense supercomputer ever built, with unprecedented performance and power capacity per rack.”
Satoshi MatsuokaProfessor, Director of Research InfrastructureGSIC, Tokyo Tech
©2009 HP Confidential template rev. 12.10.0914 ©2009 HP Confidential14
Q&Ahttp://www.gsic.titech.ac.jp/en
http://www.hp.com/go/hpc