900 kW, Tier 2, Chilled Water, 11650 ft · 11650 ft2 Regional Voltage and Frequency 480V, 60Hz...

7
[Reference Design 8] DESIGN OVERVIEW Data Center IT Capacity 900 kW Adaptable from 200 kW to 2700 kW Target Availability Tier 2 Annualized PUE at 100% Load 1.50 in Miami, FL USA 1.34 in Montreal, Canada 1.41 in St. Louis, MO USA Total Racks and Average Density 130 racks at 6.9 kW/rack IT & Facility Floor Space 11650 ft 2 Regional Voltage and Frequency 480V, 60Hz ABOUT THIS DESIGN Water-cooled chiller with cooling tower architecture Integrated row-based air distribution Energy savings through water- side economizer during favorable outdoor conditions Highly scalable and adaptable 900 kW, Tier 2, Chilled Water, 11650 ft 2 INTRODUCTION The planning process of most projects can be iterative and thereby expensive. Data center projects are burdened with these challenges and can benefit greatly from simplification and time savings. Schneider Electric’s data center reference designs help customers optimize the planning process by providing them with validated, proven, and documented data center physical infrastructure designs. The use of these designs has a positive impact on not just the project itself, but also on the performance, reliability, and efficiency of the data center over its lifetime. Reference Design 8 includes design information for three spaces: IT space, facility power, and facility cooling. Combined together, they comprise the integrated power, cooling and structural systems required to meet the design’s specifications published in this overview d ocument.

Transcript of 900 kW, Tier 2, Chilled Water, 11650 ft · 11650 ft2 Regional Voltage and Frequency 480V, 60Hz...

Page 1: 900 kW, Tier 2, Chilled Water, 11650 ft · 11650 ft2 Regional Voltage and Frequency 480V, 60Hz ABOUT THIS DESIGN Water-cooled chiller with cooling tower architecture Integrated row-based

[Reference Design 8]

DESIGN OVERVIEW

Data Center IT Capacity

900 kW

Adaptable from 200 kW to 2700 kW

Target Availability

Tier 2

Annualized PUE at 100% Load

1.50 in Miami, FL USA

1.34 in Montreal, Canada

1.41 in St. Louis, MO USA

Total Racks and Average Density

130 racks at 6.9 kW/rack

IT & Facility Floor Space

11650 ft2

Regional Voltage and Frequency

480V, 60Hz

ABOUT THIS DESIGN Water-cooled chiller with cooling

tower architecture

Integrated row-based air

distribution

Energy savings through water-

side economizer during favorable

outdoor conditions

Highly scalable and adaptable

900 kW, Tier 2, Chilled Water, 11650 ft2

INTRODUCTION

The planning process of most projects can be iterative and thereby

expensive. Data center projects are burdened with these challenges and can

benefit greatly from simplification and time savings. Schneider Electric’s data

center reference designs help customers optimize the planning process by

providing them with validated, proven, and documented data center physical

infrastructure designs. The use of these designs has a positive impact on not

just the project itself, but also on the performance, reliability, and efficiency of

the data center over its lifetime.

Reference Design 8 includes design information for three spaces: IT space,

facility power, and facility cooling. Combined together, they comprise the

integrated power, cooling and structural systems required to meet the

design’s specifications published in this overview document.

Page 2: 900 kW, Tier 2, Chilled Water, 11650 ft · 11650 ft2 Regional Voltage and Frequency 480V, 60Hz ABOUT THIS DESIGN Water-cooled chiller with cooling tower architecture Integrated row-based

[Reference Design 8] 2

Schneider Electric www.schneider-electric.com

Document Number RD08DS Revision 1

© 2

013 S

chn

eid

er

Ele

ctr

ic.

All

rights

re

serv

ed.

DESIGN OPTIONS

This reference design can be modified as

follows without a significant effect on the

design’s performance attributes:

Add StruxureWare Power Monitoring

Expert

Provision for load bank

Change UPS batteries

Add/change standby generator options:

Location

Tank size

Fuel type

FACILITY POWER BLOCK DIAGRAM

Facility Power

The facility power system supplies power to all of the critical and non-critical

components within the data center. The architecture used in this electrical

design is a single path with N+1 UPS and a generator. Switching between

generator power and utility is achieved using a programmable logic controller

(PLC). A 3200 amp bus feeds PZ4 electrical and mechanical switchboards. In

the electrical room, UPSs are configured down-stream of the switchboards. A

Symmetra MW configured to N+1 redundancy provides 1200 kW of critical

power to the IT room with 6 minutes of runtime. Valve regulated lead acid

(VRLA) batteries are housed in an isolated battery room. A Galaxy 5000 UPS

provides 72 kW of power to the pumps in the facility cooling system. Additional

low-voltage transformers are included in the design to support lighting and other

building loads. The power distribution architecture from the electrical room to

the IT space utilizes a combination of LV panels and InfraStruxure power

distribution units (PDUs). The facility power system is designed to support

additional peripheral devices like fire panels, access control systems, and

environmental monitoring and control devices. Power meters in the electrical

path monitor power quality and allow for predictive maintenance & diagnostics of

the system. These meters also integrate with StruxureWare Power Monitoring

Expert.

Every component in this design is built and tested to the applicable ANSI,

NEMA, UL or IEEE standards.

Further design details and schematics are available in the engineering package.

Name Value Unit

Total amps (main bus) 3200 A

Input voltage (main bus) 480 V

Switchboard kAIC 65 kA

Power path Single

Generator redundancy N

IT space UPS capacity 1200 kW

IT space UPS redundancy N+1

IT space UPS runtime @ rated load 6 minutes

IT space UPS output voltage 480 V

Facility cooling UPS capacity 72 kW

Facility cooling UPS redundancy N

Facility cooling UPS runtime @ rated load 12 minutes

FACILITY POWER ATTRIBUTES Utility

AC G

SSW

LOAD

BANK

1200A, 480V, 65kA

2000A, 480V, 65kA

3200A, 480V, 65kA

10x PDU Feeds to

IT Space

2000A, 480V, 65kA

400A,

480V,

65kA

72 kW

Galaxy

5000

4x CHW Pumps

2x

Cooling

Tower

2x

Chiller

4x Cond.

Water

Pump

SSW

1200kW (N+1)

Symmetra MW

1400kW

Mech.

Panel

(CRAHs,

AHUs, etc.)

Page 3: 900 kW, Tier 2, Chilled Water, 11650 ft · 11650 ft2 Regional Voltage and Frequency 480V, 60Hz ABOUT THIS DESIGN Water-cooled chiller with cooling tower architecture Integrated row-based

[Reference Design 8] 3

Schneider Electric www.schneider-electric.com

Document Number RD08DS Revision 1

© 2

013 S

chn

eid

er

Ele

ctr

ic.

All

rights

re

serv

ed.

FACILITY COOLING BLOCK DIAGRAM

DESIGN OPTIONS This reference design can be modified as

follows without a significant effect on the

design’s performance attributes:

Add StruxureWare Cooling

Monitoring Expert

Facility Cooling

The mechanical design utilizes chilled water as the primary medium for heat

dissipation. The architecture consists of a single chilled water loop. The cooling

system contains two 1196 kW water-cooled chillers in an N+1 redundant

configuration with N+1 pumps. Water-side economization is achieved with a

plate & frame heat exchanger to save energy during favorable outdoor

conditions.

In order to extend availability of chilled water during a power outage, a 7000

gallon water storage tank provides 7 minutes of continuous cooling.

The piping architecture of the mechanical system feeds row-based InRow RC

CRAHs in the IT space. It also feeds room-based CRAHs in the electrical and

battery rooms. More information on the cooling configuration is provided in the

IT space section of this document.

This design is instrumented to work with StruxureWare Cooling Monitoring

Expert.

Further design details such as dimensions, equipment placement, temperature

set points, pipe sizing, flow rates, and pressure drops are available in the

engineering package.

FACILITY COOLING ATTRIBUTES

Name Value Unit

Total cooling capacity 1196 kW

Input voltage 480 V

Heat rejection medium Chilled water

Mechanical redundancy N+1

Outdoor heat exchange Water-cooled chiller with cooling tower

Coolant supply temperature 46 F

Coolant return temperature 56 F

Storage tank size 7000 gallons

Ride-through time 7 minutes

Economizer type Water-side

Primary loop pumps

Tower Tower

VFD

System

bypassVFD

Heat

Exchanger

Thermal Storage

Expansion

tankCity Water

Dirt/air

separator Strainers

CW supply

to IT space

CW return

from IT space

VFD

VFD

Secondary loop

pumps

Chiller

Chiller

VFD

VFD

CW supply

CW return

… 76 units 300mm...

InRow

RC

300

mm

InRow

RC

300

mm

InRow

RC

300

mm

InRow

RC

300

mm

Page 4: 900 kW, Tier 2, Chilled Water, 11650 ft · 11650 ft2 Regional Voltage and Frequency 480V, 60Hz ABOUT THIS DESIGN Water-cooled chiller with cooling tower architecture Integrated row-based

[Reference Design 8] 4

Schneider Electric www.schneider-electric.com

Document Number RD08DS Revision 1

© 2

013 S

chn

eid

er

Ele

ctr

ic.

All

rights

re

serv

ed.

Name Value Unit

IT load 900 kW

Input voltage 480 V

Supply voltage to IT 120 / 208 V

Average density 6.9 kW/rack

Number of racks 130 racks

IT floor space 6350 ft2

Single or dual cord Single

Heat rejection medium Chilled water

CRAC/CRAH type Row-based CRAH

CRAC/CRAH redundancy N+1

Containment type None

DESIGN OPTIONS

This reference design can be modified as

follows without a significant effect on the

design’s performance attributes:

Add environmental and security

management

Change rack options (tall,

wide, deep)

Change power distribution options

Rack PDU type (basic,

switched)

Add StruxureWare Data Center

Expert

IT ROOM ATTRIBUTES

IT Space

The IT capacity of this design is 900 kW. The design is highly scalable and

adaptable; it can be configured to support IT loads within a range. Smaller

starting loads as low as 200 kW can be supported by making adjustments such

as reducing the number of IT pods or decreasing the quantity of UPS modules.

Likewise, this design can be used as a baseline for larger loads as high as 2700

kW by using a step and repeat approach to the design. This flexibility drives

efficiency and defers capital expenditure until needed.

The IT space design specifies all of the physical infrastructure systems, as well

as their physical arrangement/spacing, required to meet the overall design’s

performance attributes. This includes racks, PDUs, rack power distribution,

cooling units, and airflow management systems.

Each pair of rows (pod) within the IT space can be “stepped and repeated” in a

standardized and predictable manner. This enables right-sizing of power and

cooling that scales with IT growth. Each pod supports an average power

density of 6.9 kW per rack. All the pods are outfitted with integrated power and

cooling distribution.

Each pod is powered by floor mount factory-configured power distribution units

(PDUs). Every rack is configured with a metered rack-mount PDU to enable

remote monitoring of the units for efficiency and capacity management.

Each pod is cooled by N+1 redundant chilled water-based InRow RC CRAHs

that control the supply of cool air by monitoring temperature variation at the rack

level.

The security of the room is maintained at multiple points. At the rack level,

access is controlled by a door lock and sensor. At the room level, security

cameras are utilized for monitoring.

BBlock

BBlock

BBlock

BBlock

BBlock

Row S

Row L

Row F

Row D

Row U

Row B

Row KRow J

Row H

Row R

Row N

Row V

Row T

Row E

Row Q

Row C

Row G

Row M

Row P

Row A

RR/R-3/Z9

RR/D-9/Z6

RR/G-7/Z2

RR/B-6/Z6

CC/F-

10/

Z7

RR/N-6/Z4

RR/B-11/Z6

RR/C-9/Z1

CC/

G-8/

Z2

CC/

V-7/

Z10

RR/S-2/Z5

RR/E-9/Z2

RR/K-8/Z8

CC/T-

8/

Z10

CC/J-

8/

Z3

CC/

M-

2/

Z8

RR/E-2/Z2

RR/D-6/Z6

RR/A-6/Z1

CC/

P-5/

Z9

RR/C-3/Z1

CC/

K-

10/

Z8

RR/T-6/Z10

PP/E-12/Z2

RR/M-3/Z8

CC/F-

7/

Z7

CC/

K-5/

Z8

CC/

P-7/

Z9

CC/F-

3/

Z7

RR/P-4/Z9

CC/

R-2/

Z9

RR/H-6/Z7

CC/

N-3/

Z4

RR/L-3/Z3

CC/

R-4/

Z9

CC/

D-2/

Z6

PP/A-12/Z1

RR/M-1/Z8

RR/U-6/Z5

RR/S-9/Z5

CC/L-

5/

Z3

RR/E-5/Z2

CC/

E-4/

Z2

RR/B-7/Z6

RR/P-8/Z9

RR/F-4/Z7

RR/V-5/Z10

RR/H-9/Z7

CC/

R-7/

Z9

CC/

D-7/

Z6

PP/B-1/Z6

RR/K-2/Z8

RR/K-6/Z8

RR/M-5/Z8

RR/V-8/Z10

CC/

B-5/

Z6

CC/

G-

10/

Z2

RR/N-2/Z4

CC/

B-3/

Z6

RR/D-11/Z6

RR/U-7/Z5

CC/

A-4/

Z1

RR/P-6/Z9

RR/R-1/Z9

RR/A-2/Z1

CC/

C-2/

Z1

CC/

B-9/

Z6

RR/U-4/Z5

CC/

U-8/

Z5

CC/

A-8/

Z1

CC/

S-3/

Z5

PP/F-1/Z7

PP/S-12/Z5

RR/F-6/Z7

RR/V-9/Z10

CC/F-

5/

Z7

CC/

U-5/

Z5

RR/E-6/Z2

RR/T-3/Z10

RR/L-7/Z3

PP/N-12/Z4

CC/

D-4/

Z6

CC/

S-7/

Z5

RR/C-6/Z1

CC/J-

10/

Z3

CC/

G-5/

Z2

CC/

Q-2/

Z4

RR/E-11/Z2

RR/N-9/Z4

CC/

E-3/

Z2

CC/

C-

10/

Z1

RR/R-9/Z9

CC/

A-3/

Z1

CC/J-

3/

Z3

RR/C-7/Z1

RR/J-9/Z3

CC/

V-3/

Z10

RR/M-6/Z8

RR/K-9/Z8

RR/J-6/Z3

RR/Q-3/Z4

RR/L-11/Z3

CC/

U-

10/

Z5

RR/V-4/Z10

CC/

Q-5/

Z4

RR/S-6/Z5

CC/

N-

10/

Z4

RR/F-2/Z7

RR/U-3/Z5

RR/U-1/Z5

RR/G-4/Z2

RR/A-11/Z1

RR/V-6/Z10

RR/F-11/Z7

RR/N-5/Z4

RR/E-7/Z2

CC/T-

4/

Z10

RR/C-4/Z1

RR/B-8/Z6

CC/

U-2/

Z5

RR/C-11/Z1

CC/

Q-

10/

Z4

RR/A-5/Z1

RR/G-9/Z2

RR/V-2/Z10

CC/

H-2/

Z7

RR/G-1/Z2

PP/J-12/Z3

RR/R-8/Z9

CC/

A-

10/

Z1

RR/M-9/Z8

CC/L-

10/

Z3

RR/L-1/Z3

CC/

Q-8/

Z4

RR/S-5/Z5

RR/U-11/Z5

RR/B-4/Z6

CC/

D-

10/

Z6

CC/

N-8/

Z4

CC/

M-

4/

Z8

RR/S-8/Z5

RR/J-7/Z3

CC/

E-

10/

Z2

CC/

M-

7/

Z8

RR/T-9/Z10

PP/P-1/Z9

CC/L-

8/

Z3

CC/

P-3/

Z9

RR/L-4/Z3

RR/J-5/Z3

RR/T-5/Z10

RR/K-4/Z8

CC/J-

4/

Z3

RR/R-6/Z9

RR/G-11/Z2

RR/K-11/Z8

RR/J-2/Z3

CC/

B-

10/

Z6

RR/G-6/Z2

RR/H-8/Z7

RR/Q-9/Z4

RR/H-5/Z7

CC/

H-

10/

Z7

RR/D-5/Z6

RR/V-1/Z10

RR/A-7/Z1

CC/

G-2/

Z2

RR/T-2/Z10

PP/T-1/Z10

RR/L-6/Z3

RR/P-9/Z9

RR/B-2/Z6

CC/

S-4/

Z5

RR/D-8/Z6

RR/S-11/Z5

RR/G-3/Z2

CC/

K-7/

Z8

RR/R-11/Z9

RR/Q-6/Z4

RR/L-9/Z3

CC/

S-

10/

Z5

RR/Q-11/Z4

RR/T-7/Z10

RR/D-1/Z6

CC/

P-

10/

Z9

RR/F-8/Z7

RR/H-1/Z7

CC/

E-8/

Z2

RR/M-8/Z8

RR/P-11/Z9

RR/R-5/Z9

RR/D-3/Z6

CC/

R-

10/

Z9

CC/

K-3/

Z8

RR/A-9/Z1

CC/

N-4/

Z4

CC/

M-

10/

Z8

RR/H-3/Z7

RR/J-11/Z3

CC/

C-8/

Z1

RR/N-11/Z4

RR/P-2/Z9

CC/

C-5/

Z1

RR/M-11/Z8

RR/C-1/Z1

RR/Q-4/Z4

RR/U-9/Z5

RR/Q-1/Z4

PP/K-1/Z8

RR/Q-7/Z4

RR/N-7/Z4

RR/F-9/Z7

RR/H-11/Z7

CC/L-

2/

Z3

CC/

H-7/

Z7

CC/

H-4/

Z7

Controller

Page 5: 900 kW, Tier 2, Chilled Water, 11650 ft · 11650 ft2 Regional Voltage and Frequency 480V, 60Hz ABOUT THIS DESIGN Water-cooled chiller with cooling tower architecture Integrated row-based

[Reference Design 8] 5

Schneider Electric www.schneider-electric.com

Document Number RD08DS Revision 1

© 2

013 S

chn

eid

er

Ele

ctr

ic.

All

rights

re

serv

ed.

Design Attributes OVERVIEW Value Unit

Target availability Tier 2 Tier

Annualized PUE at 100% load 1.50 / 1.34 / 1.41

Data center IT capacity 900 kW

IT & facility floor space 11650 ft2

Average density 6.9 kW/rack

FACILITY POWER Value Unit

Total amps (main bus) 3200 A

Input voltage (main bus) 480 V

Switchboard kAIC 65 kA

Power path Single

Generator redundancy N

IT space UPS capacity 1200 kW

IT space UPS redundancy N+1

IT space UPS runtime @ rated load 6 minutes

IT space UPS output voltage 480 V

Facility cooling UPS capacity 72 kW

Facility cooling UPS redundancy N

Facility cooling UPS runtime @ rated load 12 minutes

FACILITY COOLING Value Unit

Total cooling capacity 1196 kW

Input voltage 480 V

Heat rejection medium Chilled water

Mechanical redundancy N+1

Outdoor heat exchange Water-cooled chiller with cooling tower

Coolant supply temperature 46 F

Coolant return temperature 56 F

Storage tank size 7000 gallons

Ride-through time 7 minutes

Economizer type Water-side

IT SPACE Value Unit

IT load 900 kW

Input voltage 480 V

Supply voltage to IT 120 / 208 V

Average density 6.9 kW/rack

Number of racks 130 Racks

IT floor space 6350 ft2

Single or dual cord Single

Heat rejection medium Chilled water

CRAC/CRAH type Row-based CRAH

CRAC/CRAH redundancy N+1

Containment type None

Page 6: 900 kW, Tier 2, Chilled Water, 11650 ft · 11650 ft2 Regional Voltage and Frequency 480V, 60Hz ABOUT THIS DESIGN Water-cooled chiller with cooling tower architecture Integrated row-based

[Reference Design 8] 6

Schneider Electric www.schneider-electric.com

Document Number RD08DS Revision 1

© 2

013 S

chn

eid

er

Ele

ctr

ic.

All

rights

re

serv

ed.

Demo:

Visit www.apc.com/software to learn more about StruxureWare for Data Centers! >

Data center infrastructure management (DCIM)

Good design and quality construction alone do not ensure a highly available &

efficient data center. Data centers require on-going monitoring and management to

ensure the facility lives up to its design intent. StruxureWare for Data Centers is a

software management suite designed to collect and manage data about a data

center’s assets, resource use, and operational status throughout the life cycle of the

facility. This information is then distributed, integrated, and applied in ways that help

managers optimize the data center’s performance and meet IT, business, and

service-oriented goals. From IT assets to racks, rows, rooms and buildings,

StruxureWare for Data Centers delivers the right information to the right users at the

right time.

Control level: Experts, on site or remotely, can control process performance and

ensure business continuity in real time, while tracking energy consumption in a highly

critical and secure environment.

Operations level: Functional managers can optimize operations, energy, and assets

through smart analytical tools, often spanning multiple sites.

Enterprise level: C-level executives can drive their sustainability strategy efficiently,

choosing the best scenario that meets their business objective to conserve

enterprise-wide resources.

StruxureWare for Data Centers allows for flexibility when requirements and

implementation strategies change over time. StruxureWare software applications

and suites simplify integration time, improve reliability, enhance visibility to energy

information, and streamline operational efficiency.

Page 7: 900 kW, Tier 2, Chilled Water, 11650 ft · 11650 ft2 Regional Voltage and Frequency 480V, 60Hz ABOUT THIS DESIGN Water-cooled chiller with cooling tower architecture Integrated row-based

[Reference Design 8] 7

Schneider Electric www.schneider-electric.com

Document Number RD08DS Revision 1

© 2

013 S

chn

eid

er

Ele

ctr

ic.

All

rights

re

serv

ed.

Click here to register to receive the Engineering Package for this design, or email

[email protected]. >

3D spatial views Floor layouts

One-line schematics

Bill of materials

Get more information for this design:

Engineering Package

Every reference design is built with technical documentation

for engineers and project managers. This includes

engineering schematics (CAD, PDF), floor layouts,

equipment lists containing all the components used in the

design and 3D images showing real world illustrations of our

reference designs.

Documentation is available in multiple formats to suit the

needs of both engineers and managers working on data

center projects.

Team of over 7,000 trained specialists covering every phase and system in the data center Standardized, documented, and validated methodology leveraging automation tools and repeatable processes developed over 45 years Complete portfolio of services to solve your technical or business challenge, simplify your life, and reduce costs

Schneider Electric Life-Cycle Services