DHCPv6 Redundancy Considerations Redundancy Proposals in RFC 6853.
Optimizing Today's Critical Data Center...
44
Air traffic Data center redundancy High speed Training Costs High-speed pipes Guy with Training Design Liquid cooling Terrorism Guy with a wrench Special localized cooling cooling Fire Applications, Migration Power di t ib ti Communications and Network Backup power Migration Virtualization distr ibution Redundant power grids Natural Disasters Security Operations Center Governance
Transcript of Optimizing Today's Critical Data Center...
Air traffic
Data center redundancy
High speed Training
Costs
High-speed pipes
Guy with
TrainingDesign
Liquid cooling
TerrorismGuy with a wrench
Special localized cooling
coolingFire
Applications, Migration
Power di t ib ti
Communications and Network
Backup power
MigrationVirtualization
distribution
Redundant power grids Natural Disasters
SecurityOperations
Center
Governance
Tech Target, NYC g ,Optimizing Today's Critical Data Center Environments
Kfir L Godrich, VP & CTHP Technology Services gy
AgendaTrends
Strategy
Optimization
Summary
T dTrends
Th i B k V bl Thorstein Bunke Veblen Invention is the mother of necessity
CIO Focus Shift: Cost Efficiency Resource ProductivityProductivity
Source: Gartner
IT evolutionExisting Evolving intoTwo or several (typically high availability) Data C t t d i l l t ith
Multiple distributed Data Centers (typically l il bilit )Centers connected in a complex plant with
direct geo‐interdependencies.lower availability).
O d d i d i O d d i i i i i lOwned, outsourced or mixed environments at constantly growing budget.
Owned or outsourced ‐minimum initial investment based on variable services cost models.
Must be cost efficient to succeed. Must run an optimized “transfer function” (ROI or equivalent) to succeed.
Industrialized IT
Technology Interest per Industrygy p y
Cloud Computing
Service users
Th l d i b hi h l b l l hi hl
Service providers
The cloud is a means by which global class, highly scalable and flexible services can be delivered and
consumed over the internet through an as-needed, pay-per use business model per-use business model.
Cloud Computing RationaleProvisioning, growth Commerce platforms Unified g, g
and cost benefitsp
and social networkscommunication
Massive Scale-out and the CloudEnterprise Class Global class
On‐premise Hybrid/off‐premiseOn premise Hybrid/off premise
100s ‐1000s of nodes 10,000+ nodes
Proprietary Commodity
HW resiliency SW resiliency
Max performance Max efficiency
Silo’ed Resources Shared ResourcesSilo ed Resources Shared Resources
Clusters Grids/Cloud
Value/Static Elastic
10
Cost‐CenterValue/
Revenue‐CenterShared storage Replicated storage
Facility costs PUE
P bl PiPablo PicassoComputers are useless. They can only give you answers.
Tomorrow’s business will be built on CI
ServersStorage
Power & cooling Network
Management software12
CI architecture basicsInfrastructure operating environment
E bl h d i tFlex fabric
Wire-once, dynamic assembly,
Enables shared-service management
Adaptive resource pools
Virtualized compute memory
Wire once, dynamic assembly, always predictable
Virtualized compute, memory, storage & networkData center smart gridIntelligent energy management Intelligent energy management across systems and facilities13
Energy Efficiency and Sustainability
Need a holistic approach
Focus on ROI and TCO
Th l approach Data center energy spending can Many
Thermal mappingPower throttlingPower cappingThe PUE race p g
reach into $millions per year.
ycompanies will spend more on
Three metrics for data center cost-of-ownership i t i bl ld
pp gThe PUE race
.y
energy than on hardware. Reducing the Energy
demand is more
in a sustainable world: Efficiency, CO2 emissions, and energy loss demand is more
effective than reducing the cost per KW
loss
Global Carbon Emissions2%
IT industry98%All Others
IT industry98%
St tStrategy
Information technology is the most powerful asset we have to address the energy issue…
Transparent Efficient Light
AnalyticsM i b th bManaging by the numbers…
Tools to manage power: Data Center, PCs
Tools to measure carbon: Data Center, Printing
U ili i M i l i Utilities: Metering solutions for monitoring energy use
Transparent…
PCs, Printers, Data CentersblMore sustainable…
Printers, PCs: Recycled materials and packaging, eco-label standards
“Skinless” servers; Automation and virtualization technologies
N S i bl D CNext: Sustainable Data Centers:Least energy, least materials
Efficient…
NanotechnologyM i t lli tMore intelligent…
Memristor: Fourth element of electronic circuitry proven by HP Labs
Real-time data analysis with low-cost, self-powered sensors
N Wi l I d S Next: Wireless Integrated Sensor Networks might get a different direction
Efficient…
PhotonicsC h ’ dCopper that’s never mined…
2012: ServersAnnual savings: 13 TeraWatt-hours of electricity
2017: Servers + ChipsAnnual savings: 110 TWh of electricity
Reduce the need to mine, smelt copper
Light…
Hallmarks of a “Green” DC (1)Based on industry design criteria and best practicesp
Climate and geography leveraged to minimize GHG emissions
Facility responds to site constraints and advantages
d h l b ldDesigned using rigorous whole-building energy modeling
Hallmarks of a “Green” DC (2)Optimization of energy and water use
Life cycle approach used in decision making
Thorough and transparent reporting of energy use
Early Planning Yields Best ResultsEarly Planning Yields Best Results
25
Data Center Energy StrategyAir Management Objective: Increase air & chw set points- Minimize Negative flow and Bypassg yp- Minimize Recirculation- Match demand Air- Segregate Hot/Cold air
IT Server:(> Efficient)(> Utilisation)> T (& RH) range
Mechanical- Free Cooling (air or chw)- Plant / system optimize
Chillers> T (& RH) range - Chillers- CRACs- Humidifiers, etc
ElectricElectric- UPS- Gen heaters - Lights
Renewable power (mains /on-site)- Mains (wind, hydro)- Site (solar, wind, sustainable bio-fuel)
Results of 22 AnalysesResults of 22 Analyses
27
Improve the PUEUpgrade DCiE PUE Rating Cumulative1 Cost Simple payback2 Upgrade DCiE PUE Rating Cumulative Cost Simple payback
(years)
Current 0.52 1.94 D
I 0.60 1.67 C $300k - $400k 1.7 I $ $
II 0.70 1.43 B $600k - $1M 2.5
II 0.8 1.25 A $2.5M-$3M 5.7
2000000
2500000
3000000
tmen
t ($)
0.50.60.70.80.9
1
DCiE
500000
1000000
1500000
Leve
l of I
nves
t
00.10.20.30.4
5A 5A 4A 4A 4A 4A 4A 4A 4A 4A 4A 4A 4A 4A 3A 3C 2A 2B 1AD
01.93 1.67 1.43 1.25
PUE improvement
Climate Zone
Actual data Poly. (Actual data)
Impacts of Power and Cooling on PUEd d
Max PUE = 1.63
Two system design concepts compared
Average PUE = 1.56
Annual Energy = 49 MKWh
Difference is 5 million kWH($500,000 at $0.10/KWh)
Max PUE = 1.45
Average PUE = 1.41
29
Annual Energy = 44 MKWh
Impacts of Climate on PUEAnalysis of Vancouver BC and Atlanta GA
Vancouver, BC
Analysis of Vancouver, BC and Atlanta, GA
Max PUE = 1.63
Average PUE = 1.57
Annual Energy = 69 MKWh
Difference is 3 million kWH($300 000 at $010/KWh)Atlanta, GA
Max PUE = 1.73
($300,000 at $0.10/KWh)
3013 September 2010
Average PUE = 1.65
Annual Energy = 72 MKWh
Reliability of electrical systemsDescription of RBD MTBF MTTR Availability
Probability of Failure in 5
years
N + 1 UPS system ‐ dual cord loads 32,509 5.97 0.99981626 58.16%y
Distributed Redundant (2‐3) UPS system ‐ dual cord loads
161,646 3.24 0.99997994 7.43%
2N UPS system ‐ dual cord loads 214,182 2.74 0.99998723 6.56%y ,
2(N + 1) UPS system ‐ dual cord loads 305,251 4.03 0.9999868 6.49%
Utility + N + 1 UPS system, ASTSs ‐ dual d l d
65,056 0.12 0.99999821 8.02%cord loads
,
Redundant Reserve (2‐3) UPS System, ASTSs ‐ dual cord loads
257,459 2.43 0.99999058 2.58%
31
Distributed Redundant (2‐3) UPS system, ASTSs ‐ dual cord loads
256,674 2.45 0.99999046 2.72%
2N UPS system, ASTSs ‐ dual cord loads 445,691 0.69 0.99999845 1.12%
On 9sH h i t h?
• Pushing the limits of
How much is too much?
• Pushing the limits of complexity means not only Unavailability but also bad capital investmentinvestment
Building for Tiers Dilemmad f f• Based on 40,000 sf of
Raised Floor Data Center
Tier 2, 3, 4 Costs ($/sf)
$3 500$4,000$4,500$5,000
Tier 4
• Tier level increases, build cost risesC t f ti IV ti II $500
$1,000$1,500$2,000$2,500$3,000$3,500
Tier 3Tier 2Linear (Tier 4)Linear (Tier 3)Linear (Tier 2)
• Costs of tier IV vs tier II are almost double
• Power density increases, Tier 2, 3, 4 Costs ($/kw of Critical Power)
$35 000
$-$500
50 w/sf 100 w/sf 150 w/sf 200 w/sf 250 w/sf 300 w/sf
y$/kW decreases, but again can be almost double the cost tier II –$15,000
$20,000
$25,000
$30,000
$35,000
Tier 4Tier 3Tier 2 double the cost tier II
tier IV 33
13 September 2010
$-
$5,000
$10,000
50 w/sf 100 w/sf 150 w/sf 200 w/sf 250 w/sf 300 w/sf
Comparison: Monolithic vs. Multi-tieredl h d l d h b d dMonolithic design Multi-tiered hybrid design
MEP systems/infrastructure (Tier IV)A side
MEP systems/infrastructure Tier II, A side
MEP systems/infrastructure Tier IV, A side
Pod 1
MEP systems/infrastructure (Tier IV)B side
Pod 1 Pod 2
No B side (saves space)
MEP systems/infrastructure Tier IV, B side
• Provides same operational framework (i.e., Tier level I, II, III, or IV) across all pods
· Allows applications of similar criticality to be deployed in different pods
· MEP infrastructure provides the required operational level to each pod
Solution - Multi-Tiered Hybrid DesignMEP for less-critical applications
Redundant MEP for critical applications
Now unused Now-unused floor space
High-availability pod for highly critical applications
Pod for less-critical applications
35
Energy efficiency and facilities optimizationhighly critical applications
O ti i tiOptimization
Basics of NGDC2
“Industrialized” & Modular
Low cost & Scalable
Energy efficient & lower Reliability
Monitored & Controllable
Adaptable & Global
Performance Index
π=((TCO/KW)/Pf)/1000over t = 5 years period
• Correlates
– Performance
– Energy efficiency
– Cost
E2
Electrical system efficiency89.00%
84.00%
85.00%
86.00%
87.00%
88.00%
Effic
iency
80.00%
81.00%
82.00%
83.00%
E
79.00%N N+1 Block Rednt 2N 2(N+1)
Configuration Legend:
Single Cord Configuration
Dual Cord Configuration
TCO
Total Cost of Ownership (TCO)75 000 000
55 000 000
60,000,000
65,000,000
70,000,000
75,000,000
CO
35 000 000
40,000,000
45,000,000
50,000,000
55,000,000
TC
30,000,000
35,000,000
N N+1 Block Rednt 2N 2(N+1)
Configuration Legend:
Single Cord Configuration
Dual Cord Configuration
9s (through Pf function)( g )
Probability of failure (5 years)
(5 y
ear
s)
40.00%
50.00%
60.00%
lity
of fa
ilure
(
10.00%
20.00%
30.00%
Pro
babi
0.00%N N+1 Block Rednt 2N 2(N+1)
Configuration Legend:
Single Cord Configuration
D l C d C fi iDual Cord Configuration
The Global PicturePerformance Index
60.0
ex
30.0
40.0
50.0
rform
ance Inde
10.0
20.0
Per
0.0N N+1 Block Rednt 2N 2(N+1)
ConfigurationLegend:
Single Cord Configuration
Dual Cord Configuration
Summary
1 Lowering the $/MW is important, operating h MW i h l i ll ithe MWs with less is equally important.
The NGDC must include modularity and 2 The NGDC must include modularity and scalability, learn from others but create your own!
3TCO is almost the ultimate key to the right decision – can you make the next step and decision can you make the next step and optimize it?
Q&AQ&A
Kfir L. Godrich, VP & CTKfir L. Godrich, VP & CTHP Technology ServicesTel: +1.917.952.1970i i i i l@[email protected]
44
