05/15/09

Green Data Center ProgramIan Katz

Power Metering, The New Frontier

05/15/09

Progress so far…• Measuring power consumption with existing tools.

– Electrical Engineering Dell Cluster• Graphing with Cricket from UPS Level Data.

– Statistics/Astronomy HP Cluster• Graphing with HP at the Blade Chassis Level.• Benchmarking using the Statistical Package R.

• Selected Power Metering Products– Server Level– Blade Chassis Level– Power Panel Level

• Surveyed Overall Power Usage in Data Center

2

05/15/09

Electrical Engineering Dell Cluster

• 100 Node Cluster

• 5 – 10kVa (8 kW) UPS’s

• Nice Dense Cluster

• Inefficient Power Usage Still…

3

• Consumes 20kW of Power when idle!!!

→ 7% of entire IT load

• Up to 36kW at peak load

→ 13% of entire IT load

Electrical Engineering Dell Cluster

• SNMP Data from UPS • Graphing with Cricket

05/15/094

05/15/09

Statistics/Astronomy HP Cluster• 32 Node Cluster

• Double Dense Blades

– 2 separate machines built into 1 blade

5

• Enclosed cabinet better for air flow and energy efficiency

• Closed door suggests neater cabling

05/15/09

HP Blade Chassis Power Metering

6

• Graphing feature built in to Blade Chassis ILO

• Will incorporate this data into our existing SNMP infrastructure

• This chassis shows lower power usage when idle – 4kW

05/15/09

HPC Power Benchmarking

7

• Graphs created with the statistical package R.

• Test programs written to demonstrate power usage trends across nodes.

• Jobs 238 – sums prime #’s btw 2 and 2,000,000

• Ran on 4 nodes.

• Job 256 – sums prime #’s btw 2 and 15,000,000

• Ran on all 256 nodes.

Selected Power Metering Products• Server Level Metering

– Raritan PDU

• Blade Chassis Metering (also done with ILO)

– Raritan PDU

• Power Panel Metering

– WattNode Meter

– Babel Buster SPX (ModBus to SNMP translator)

05/15/098

Overall Data Center Power Consumption• Main Transfer Switch for IT Load

– 278kW

– 785amps of 1200amp capacity!

• Transfer Switch for HVAC Load

– 85kW

05/15/099

• Plan to install Wattnode meters here so we can poll with SNMP and record data

Thank You NYSERDA!

This work is supported in part by the New York State Energy Research and Development Authority.

05/15/0910

•Facilities, Data Center, Operations•NetDev, NetProj, NFS

•UNIX, WISE•RCS, PM Office

Thanks to many groups around Columbia and within CUIT!