we’re used to. To protect the planet, and your money (i.e ... · 15 years, that’s a lot of...
Transcript of we’re used to. To protect the planet, and your money (i.e ... · 15 years, that’s a lot of...
1
This presentation is about opportunities. And looking for them “outside the box”
we’re used to.
This presentation is about opportunities. And looking for them “outside the box”
we’re used to.
Whether you’re looking at new build, legacy retrofit, fitout of existing space.
Opportunities to do better than the benchmarks we’ve been focused on for the past
10-15 years.
To protect the planet, and your money (i.e. Your business).
At a recent US conference I attended, a LEED Platinum DC from Canada was
honoured, and presented their design.
A question asked was “how much extra did it cost to achieve Platinum?”
The answer – “not as much as we thought it would, once we analysed it fully”
NEA Singapore review in 2010-2012 found:
• DCs could reduce energy use by mainly air management and plant loading
• Small & Medium DCs – payback < 2 years (12% energy reduction)
• Large DCs - payback 4.2 years (16% energy reduction)
2
3
The concept “One Planet Living” is based on the simple proposition that we only have
one planet earth, whereas Ecological Footprinting analysis (Link) shows that if
The concept “One Planet Living” is based on the simple proposition that we only have
one planet earth, whereas Ecological Footprinting analysis (Link) shows that if
everyone on earth lived like the average Australian, we’d need more than 3 planets to
support us (Link1, Link2).
Planets
SG 3.141176
MY 2.858824
TH 1.394118
For Australia, its an extra Planet!!
AU 4.023529
4
5
Zero carbon Making buildings more energy efficient and delivering all energy with
renewable technologies .
Zero carbon Making buildings more energy efficient and delivering all energy with
renewable technologies .
Zero waste Reducing waste, reusing where possible, and ultimately sending zero
waste to landfill .
Sustainable transport Encouraging low carbon modes of transport to reduce
emissions, reducing the need to travel .
Sustainable materials Using sustainable healthy products, with low embodied energy,
sourced locally, made from renewable or waste resources .
Local and sustainable food Choosing low impact, local, seasonal and organic diets
and reducing food waste .
Sustainable water Using water more efficiently in buildings and in the products we
buy; tackling local flooding and water course pollution .
Land use and wildlife Protecting and restoring biodiversity and natural habitats
through appropriate land use and integration into the built environment .
Culture and community Reviving local identity and wisdom; supporting and
participating in the arts .
Equity and local economy Creating bioregional economies that support fair
employment, inclusive communities and international fair trade. 6
LEEDLEED
BREEAM
GreenMark:
Carbon / Energy 83 points
Water 12 points
Sustainable Materials and Waste 2 points (a bit soft though)
Health (IEQ) 8 points
“Other” could include Transport, Land Use, more of above (10 points)
7
Zero carbon Making buildings more energy efficient and delivering all energy with
renewable technologies .
Zero carbon Making buildings more energy efficient and delivering all energy with
renewable technologies .
Renewable Energy Sources – Wind?
And Solar?
Don’t forget that they have to be BUILT somewhere.... And that the land use is a
factor overall. Shared use or co-existent use with natural habitat is a good balance.
8
Zero carbon Making buildings more energy efficient and delivering all energy with
renewable technologies .
Zero carbon Making buildings more energy efficient and delivering all energy with
renewable technologies .
Renewable Energy Sources – Hydro?
Don’t forget the real impact of valleys of forest drowned by dams, and the equipment
manufactured to make it all work.
But it’s still much better than the “baseline” alternatives......
9
Zero carbon Making buildings more energy efficient and delivering all energy with
renewable technologies .
Zero carbon Making buildings more energy efficient and delivering all energy with
renewable technologies .
Mostly we’re stuck with what we can get from the grid. Coal, Oil, gas or whatever it
might be.
So we’ve focused in the past, and will continue to in the foreseeable future, on
Energy (hence Carbon emissions, in most locations). That still matters, and always
will......
10
Zero carbon Making buildings more energy efficient and delivering all energy with
renewable technologies .
Zero carbon Making buildings more energy efficient and delivering all energy with
renewable technologies .
For good reason....
Green, orange, red lines vs Yellow line – IT efficiency impact up the chain.
% losses consistent in all four as we move back towards grid. Look at the impact it
has....
Energy Use & Efficiency
Lighting, Daylighting
Heat recovery
Building Fabric, orientation
You can see, and will already be aware - Cooling system is the biggest non-IT
component DC load (usually).
Let’s look at some cooling opportunities you might not have seen.
11
Indirect Evaporative (or Adiabatic) CoolingIndirect Evaporative (or Adiabatic) Cooling
Air cycle within the Data Centre.
Evaporative system cools the circulating air
Some form of backup coil that can be staged on to supplement cooling from
evaporation.
Works well where water is readily available, and humidity is low. Not so well here in
Singapore (but workable and worthwhile – still better than a water cooled system).
Water use is OK with very low humidity, and can be used with Salt water (in theory).
A variant on this is the Air-Air Heat Exchanger – no evaporation, use outside air temp
to cool recirculating air.
12
How does it work?How does it work?
•Hot aisle containment
•Hot aisle high level coil PLUS back of rack coil
•Close coupled fans
•Adiabatic cooling of condenser water using Fluid Coolers
•CDU with compressor when ambient requires
13
E-Comb - New Builds and Fit-Outs
Up to 50kW per rack
E-Comb - New Builds and Fit-Outs
• Up to 50kW per rack
• Look and feel of traditional facility
• Installed as a modular building or into an existing building utilizing only the
interior components of the pod.
• Rapid density scalability
• Highly flexible and customizable for specific size and IT requirements
Also available as retrofit solution
14
How does it work?How does it work?
•Hot aisle containment
•Hot aisle high level coil PLUS back of rack coil
•Close coupled fans
•Adiabatic cooling of condenser water using Fluid Coolers
•CDU with compressor when ambient requires
•Predicted annualised pPUE in Singapore = 1.12 (peak 1.15).
15
Uses a certain set of assumptions which might not match your scheme. Weighted to
common loadings:
Uses a certain set of assumptions which might not match your scheme. Weighted to
common loadings:
1% of time 25%
40% 50%
45% 75%
12% 100%
16
At a steady 75% loading, the water cooled system performance and Adiabatic
performance is better. Does not make much difference to the Inertech e-Comb
system.
17
Will this be your Data Centre at the end of its life?Will this be your Data Centre at the end of its life?
Materials are scarce, expensive, limited. And can be reused if selected right to start
with.
Waste can be collected
How do we minimise WASTE? And control the selection of materials?
Selection of materials and their embodied energy – steel, concrete – huge energy to
create them. How much sense does this make?
A cubic metre of concrete requires about 240 tons CO2 to produce (and then you
have to transport, mix, and install it.....)
A ton of steel requires about 1.9 tons of CO2 to produce.... And likewise to transport,
treat, install....
18
How do WE minimise WASTE? And control the selection of materials?How do WE minimise WASTE? And control the selection of materials?
How did THEY minimise waste, and control material quality and selection – 100 years
ago
Learn from other industries!
Whether we’re talking about toasters, TVs, or cars...
When there are hundreds, thousands, hundreds of thousands......
19
How do we minimise WASTE?How do we minimise WASTE?
Learn from other industries!
Build Data Centres like we build cars...... They figured it out long ago.
The PRODUCT MENTALITY....
Does it seem expensive? Check Youtube for Fortrust story on “Adopting a Modular
Approach” how they moved from a conventional build facility to complete the fitout
with prefab modules, at lower cost than their original scheme and all the “improved”
schemes they could develop. They knew they could do better.
And they did.
20
A side note.......A side note.......
Another benefit of mass production is DEPENDABLILITY:
• Availability
• Reliability
•Maintainability
• Safety.
But it doesn’t solve some of the biggest Data Centre risks:
• complexity...
<CLICK>
• Promotes risk of HUMAN ERROR
21
How do we minimise WASTE in Energy?How do we minimise WASTE in Energy?
We can co-exist with other industries! And use excess heat to generate power as well
as get “free” cooling.
Use an “industrial Ecology” scheme.
<CLICK>
LNG Distribution Terminals – need heat input to vaporise gas for distribution, and
generate excess cooling.
<CLICK>
Build Data Centres adjacent to source of COLD from industry. Done so far in:
China • 2012: Air separation and liquefaction
Japan • 1977: 1.45 MW expansion turbine - clean power
• 1982-2000: Clean power capacity expands to 14 MW
• 1979: Air separation and liquefaction
• 2000: Cooling for 435 MW co-gen plant
• 2005: Frozen foods, cold warehouse, dry
ice & chemical manufacturing
S. Korea • 2006: Air separation, cryogenic grinding
Taiwan • 1996: 3 MW expansion turbine - clean power
• 2005: Water cooling for aquaculture22
How do we minimise WASTE?How do we minimise WASTE?
Industrial Ecology -Teracool
There’s a location near you waiting for your waste heat.
23
Sustainable water Using water more efficiently in buildings and in the products we
buy; tackling local flooding and water course pollution .
Sustainable water Using water more efficiently in buildings and in the products we
buy; tackling local flooding and water course pollution .
Cooling Towers / Water Cooled systems are not too good for this.
And in some locations, water is a SCARCE resource.
24
Sustainable water Using water more efficiently in buildings and in the products we
buy; tackling local flooding and water course pollution .
Sustainable water Using water more efficiently in buildings and in the products we
buy; tackling local flooding and water course pollution .
Cooling Towers on this site are watered by rainwater collection.
Rainwater off roof, ground water not collected due to possible pollutants. These are
treated by Gross Pullutant Trap in bottom corner.
Rainwater Harvesting manages local runoff in high flow, plus retains site water for
cooling usage.
Future tanks installed when towers and load growth demands.
25
Equity and local economy Creating bioregional economies that support fair employment, inclusive communities and international fair trade.inclusive communities and international fair trade.
Data Centre opportunities?
Local employment
Local industry supply sources
26
Maybe not strictly on topic, but if the Data Centre is going to be an ongoing business, then yes.....then yes.....
Chris Crosby, Compass Data Centres – a US based prefabricated Data Centre developer:
Myth = Size drives out cost.
Truth – product mentality drives out cost
<CLICK>
• Ability to deploy capital on demand
• Adaptable and flexible deployment options
• 140 days from Order to Install vs. traditional custom built 18-36mth time frame
• High resiliency to market and technology trends
• Build once the customer is contracted vs. “build and they will come” mentality
• DC 2.0 software provides greater control over energy consumption and allocation decreasing energy OPEX
27
Land use and wildlife Protecting and restoring biodiversity and natural habitats through appropriate land use and integration into the built environment .through appropriate land use and integration into the built environment .
What’s the existing use?
What’s the possible RE-use opportunity?
What’s the best use for the local economy and community?
28
Sustainable transport Encouraging low carbon modes of transport to reduce
emissions, reducing the need to travel .
Sustainable transport Encouraging low carbon modes of transport to reduce
emissions, reducing the need to travel .
Local and sustainable food Choosing low impact, local, seasonal and organic diets
and reducing food waste .
Culture and community Reviving local identity and wisdom; supporting and
participating in the arts .
What can a Data Centre contribute to these?
Transport
• site selection – near transport links – freight and people
• how much freight movement goes on? For an ENTERPRISE DC we designed
recently, forecast truck movements in stable operation were TWO / week. Over 10-
15 years, that’s a lot of trucks.
Culture and Community
• community connections, Local and sustainable food
• open space?
• share waste heat
• staff facilities?
– waste heat use? It’s been done in Canada, where Bastionhost converted a cold war
nuclear bunker to a DC, uses waste heat for Hydroponics (and as an primary producer,
avoids local fuel taxes!) 29
Culture and community Reviving local identity and wisdom; supporting and participating in Culture and community Reviving local identity and wisdom; supporting and participating in the arts .
Health and happiness Encouraging active, sociable, meaningful lives to promote good health and well being.
When we look at the enviromental impact of Data Centres, its a “too much energy” story.
But there is hardly ever an accounting of the resources SAVED through the use of IT. What’s this guy doing?• saving a trip to the bank across town?• checking on public transport status – bus locations by GPS, timetables?• telecommuting (working)?• ordering a take-away meal? Or anything else online?
All of these activities SAVE resource – significant resource – and save TIME for people.
Disruptive Technologies that are coming, or here (McKinsey Disruptive Technologies: that will transform life, business, and the global economy):
They name 12 – a few of these with major sustainability impacts ENABLED by the DATA CENTRE:•Mobile (above)• The Internet of Things• Automation of Knowledge work• 3D Printing• Autonomous Vehicles
Potential for greater health and happiness, enhanced culture and community. There’s a gap in the social media landscape which to many is disconnecting people, not connecting them. Real time phone-phone Video is one shift that may change that.
30
31
32
33
The uptake of cloud computing is gaining pace. The uptake of cloud computing is gaining pace.
Although the communication between data centre and facilities personnel has much
improved over recent years, the development of cloud computing will place an
increased importance of these teams working together.
This presentation discusses how cloud computing impacts the data centre and
discusses some actions that can be taken to manage these challenges.
1
Although cloud uptake in the Asia Pacific region is not at the levels of some other
parts of the world, the rate of uptake is gaining pace.
Although cloud uptake in the Asia Pacific region is not at the levels of some other
parts of the world, the rate of uptake is gaining pace.
Cloud offers many opportunities to consolidate, reduce energy and provide flexibility
and scalability.
2
Cloud computing is implemented in different data centre environments as follows:Cloud computing is implemented in different data centre environments as follows:
Dedicated custom built mega-data centre
3
Co-location data centre with multiple tenants.Co-location data centre with multiple tenants.
Some tenants may be operating there own private cloud in the data centre
Some tenants may be providing public cloud services out of the data centre
4
Private cloud hosted in an owner occupier data centre.Private cloud hosted in an owner occupier data centre.
These data centres present their own challenges in the transition of conventional IT
infrastructure to a cloud based solution.
This talk focuses mainly on loads within co-location environments although the basic
concepts apply to each of the types of data centre environment.
5
Implementing cloud in an existing data centre is very different to implementing cloud
in a new environment (eg new co-location space)
Implementing cloud in an existing data centre is very different to implementing cloud
in a new environment (eg new co-location space)
This slide shows how these two implementations differ.
Where cloud is implemented in an existing data centre, due to reduced server count
and lower load due to the virtualised environment, infrastructure may now be over-
sized for the load and hence run very inefficiently.
In moving to a co-location environment, control of the power and cooling is with the
data centre operator. This change in operational environment is often one of the
causes of transitional difficulties. Processes have to be adapted to this new model
(particularly from a change management perspective)
6
This slide represents a stylised data centre environment.This slide represents a stylised data centre environment.
The white coloured racks indicate relatively low load with nominally a uniform power
density.
The examples used are provided for demonstration the points and in some cases
represent relatively extreme, yet realistic, cases.
7
Generally, cloud environments will lead to higher rack loads.Generally, cloud environments will lead to higher rack loads.
Red racks indicate higher IT loads.
8
As virtual servers can move across physical servers, the load has the potential to
move around the data centre
As virtual servers can move across physical servers, the load has the potential to
move around the data centre
9
The virtual servers can also move across physical servers in different data halls or
even different data centres.
The virtual servers can also move across physical servers in different data halls or
even different data centres.
10
Due to the ability of the virtual servers to move across physical servers, the load has
the potential to change quickly.
Due to the ability of the virtual servers to move across physical servers, the load has
the potential to change quickly.
11
Load can also grow quickly by public cloud provider winning new contracts.Load can also grow quickly by public cloud provider winning new contracts.
12
This slide summarises how these features of cloud can prove challenges to a data
centre operator.
This slide summarises how these features of cloud can prove challenges to a data
centre operator.
Co-location data centres are designed to average power densities with provision to
service higher loads – generally all scenarios of increased power densities cannot be
modeled prior to the tenant requirements being known.
Data centres are typically optimised around steady load growth. Although the cooling
solutions operate in a more dynamic way than previously, they cannot necessarily
adapt to large load changes whilst maintaining both resilience and energy efficiency
as effectively as many people believe.
Consider whay may happen in a “Cloud” Load growth – a server can be purchased
and installed in 1 week…. whereas if a new generator or UPS is required, the lead
time may be 6 months.
Data centres are designed for long lifecycles. Although flexibility and modularity is
normally built into data centres, some physically constraining factors are likely to
remain. Server refresh cycles are typically 3-5 years with software on even shorter
lifecycles. Hence IT technology changes much faster and the physical data centre
needs to support this.
13
Data centres are typically built for 1500-2000w/m2 average power densityData centres are typically built for 1500-2000w/m2 average power density
Typically no aisle containment is needed at the lower loads although containment will
improve energy efficiency.
Higher power densities (above the designed average power density) can be
supported in localised areas but all scenarios not necessarily modelled when data
centre was designed
Simple A + B distribution is used for the purposes of the examples.
14
If only the capacity allocated to that data hall were to be used, you could just space
the racks out.
If only the capacity allocated to that data hall were to be used, you could just space
the racks out.
This solution could potentially compromise any containment solution and may result
in sub-optimal energy efficiency.
Cooling solutions may also be able to support the higher power density in a
compressed space but power may not be available. In this case, part of the data hall
would be left un-occupied.
15
Spare capacity from other floors or overall spare capacity in the infrastructure could
be utilised.
Spare capacity from other floors or overall spare capacity in the infrastructure could
be utilised.
This would required some infrastructure to be sized for the increased average power
density from day one (such as chilled water pipework).
16
Utilising capacity from other floors may require additional plant space (eg
transformers if distribution is at HV , additional riser space, additional PDU and
Utilising capacity from other floors may require additional plant space (eg
transformers if distribution is at HV , additional riser space, additional PDU and
cooling unit space)
17
As power density increases in an area, different cooling solutions will need to be
implemented.
As power density increases in an area, different cooling solutions will need to be
implemented.
18
Planning of the infrastructure to scale to the maximum power density is vital.Planning of the infrastructure to scale to the maximum power density is vital.
Modelling the environment at different power densities based on the rack layout is
important.
Rack solutions and containment solutions will impact power densities that can be
supported
Environment neutral solutions with direct water cooling reduce load on air-based
cooling solutions.
Understanding the limitations of capacity is essential in business and infrastructure
planning
Performance testing prior to installation of real IT load is recommended to validate
modeling
19
This slide represents a typical data hall with some high density and some low density
racks.
This slide represents a typical data hall with some high density and some low density
racks.
The data hall is fed from four electrical distribution paths.
20
As load moves around the data centre the potential issues are as follows:As load moves around the data centre the potential issues are as follows:
The load control is no longer by physically switching distribution paths (ie the load
migration control has moved from the physical infrastructure to the IT space)
The area to which the load has moved could now be overloaded. Even if the PDUs in
that area are not over-loaded, distribution system A and B could be feeding other
data halls and their total capacity could be exceeded
The area from which the load has moved now has excess cooling and UPS capacity
and is likely to be operating less efficiently.
21
The supplies to racks are generally over-sized (upstream supply capacity is less that
distribution capacity) – ie distribution does not limit the load
The supplies to racks are generally over-sized (upstream supply capacity is less that
distribution capacity) – ie distribution does not limit the load
In this example, the load has migrated across the data centre, but with all distribution
paths operating, the load can still be supported.
However this load migration may cause the redundancy in the distribution system to
be lost such that the load swing caused by the failure of one PDU could mean that the
alternative distribution path would overload.
The load migration has in effect made the PDU a single point of failure without the
total load in the data centre being increased or any distribution paths being physically
switched.
22
A similar scenario can exist when reduced capacity is available due to maintenance
activities – this can be a particular issue when the IT environment is controlled by one
A similar scenario can exist when reduced capacity is available due to maintenance
activities – this can be a particular issue when the IT environment is controlled by one
group (the tenant), the infrastructure is controlled by another group (the co-location
provider), and the change management process (and the contract) is not set up to
cater for this eventuality.
If no link is in place between the IT environment and the infrastructure environment,
the load could be migrated onto part of the distribution system that does not have
the capacity to support it.
23
Whether energy efficiency is important may depend on contract conditions and
service levels (eg if a tenant is paying for power multiplied by a fixed PUE there is no
Whether energy efficiency is important may depend on contract conditions and
service levels (eg if a tenant is paying for power multiplied by a fixed PUE there is no
financial incentive to be energy efficient – although this may be a factor when
contracts are due to be renegotiated)
Load migration limitations can be applied to limit load swing.
Dynamic cooling solutions will maintain better energy efficiency but their
effectiveness will reduce for large load changes.
To maintain resilience, oversized infrastructure could be installed to deal with all
eventualities. This strategy however, would be very costly and would most likely
result in a less energy efficient solution.
The strategies that are more likely to be employed are:
• restricting load migration,
• implementation of DCIM solutions, and
• rigorous change management such that restrictions are placed on load migration
when infrastructure is not available.
The use of shared upstream infrastructure can also mitigate load migration issues
from an overall capacity perspective, but this needs to be carefully managed so as to
avoid single points of failure.
24
DCIM is a very large topic that will not be discussed in detail here.DCIM is a very large topic that will not be discussed in detail here.
The DCIM system is the link from the IT environment to the infrastructure.
The DCIM solution will need to have a link to the Virtual Machine Manager such that
load is not migrated into equipment that does not have capacity available.
Modeling of failure scenarios is available on some solutions but not yet in real time
(i.e. “what if “ scenarios)
25
It is not economical (or energy efficient) to provide the full data centre capacity at day
one.
It is not economical (or energy efficient) to provide the full data centre capacity at day
one.
The above model shows a typical installation designed with an allowance for future
additional power modules.
26
The IT load can scale in a very short time (weeks)The IT load can scale in a very short time (weeks)
The addition of another power module (if not pre-planned) is likely to take several
months.
The infrastructure then has the potential to restrict growth and flexibility.
27
The fully populated facility may look like this – but was it upgraded in time ?The fully populated facility may look like this – but was it upgraded in time ?
28
29
30
The potential to migrate virtual machines across physical machines means that it may
be more cost effective to migrate the IT load across sites rather than provide resilient
The potential to migrate virtual machines across physical machines means that it may
be more cost effective to migrate the IT load across sites rather than provide resilient
infrastructure in one site.
Taking this to the next level, some larger multi-site organisations are removing UPSs
and generators altogether.
Simple sites, designed for specific services, rolled out in a uniform way may provide
other options to reduce infrastructure or challenge the accepted ways of delivering a
data centre
31
32