Eurotech Aurora HPC solutions

EUROTECH

Eurotech company overview and HPC division

Eurotech IntroductionVision

Computers will be increasingly miniaturised and interconnected.

They will merge with the surroundings of everyday life until they become indistinguishable from them, to improve our sensorial

and perceptive capabilities.

Eurotech Introduction

Eurotech is a listed global company (ETH.MI) that integrates hardware, software, services and expertise to deliver embedded computing platforms, sub-systems and high performance computing to leading OEMs, system integrators and enterprise customers for successful and efficient deployment of their products and services

The Eurotech HPC division aims to deliver advanced supercomputers and HPC solutions to enable science, technology and business to reach the excellence that will help the development of the humankind

Imagine. Build. Succeed

Eurotech IntroductionGroup Global Footprint

Eurotech IntroductionSome of our Customers

High Performance Computing Engines

for the CORE

Connectivity Platforms to Build and Connect

the EDGE

Components and Pervasive Devices for REAL WORLD

Applications

Eurotech Value PropositionProducts and Solutions for Core, Infrastructure, Edge

HPC division highlights• The Eurotech HPC division focuses on designing, manufacturing, delivering and

supporting high performance computing solutions• More than 14 years of history of delivering supercomputing systems and solutions to

industry and academia• First worldwide company to market hot water cooled high performance computers. First

hot water cooled HPC in the market delivered in 2009.• R&D capabilities nurtured in house and through collaboration with the best universities

and research centres in Europe: INFN, Julich, Revensburg, Daisy…• Funding member of ETP for HPC

High performance density. We want our customer to decrease time to solution and footprint running their simulations and applications as fast as the latest technology allows.

Energy efficiency and Green. We aspire to develop green, energy efficient products that allow our customer to save energy and leverage sustainability.

RAS. We want enhance design, support readiness, preventive maintenance and quality to to increase the serviceability, availability and reliability of our HPC systems during their lifetime.

Scalability. We aim to propose solutions that scale as linearly as possible and are set to modularly increase from giga to petaflops

Cost effectiveness. We concentrate a lot of our efforts to deliver advanced technology at competitive prices together with a compelling total cost of ownership.

Versatility. With our products and solutions, we want to help our customers to solve a vast variety of computational problems in the most effective way possible

Eurotech HPC Principles

Aurora HPC solutions

Ha

rdw

are

So

ftw

are

Se

rvic

es

CPU ARCHITECTURE

HYBRID ARCHITECTURE

BOOSTER ARCHITECTURE

DRIVERS

OPERATING SYSTEMS

TOOLS AND LIBRARIES

MIDDLEWARE

USER APPLICATIONS

DEPLOYMENT

DESIGN ENGINEERING

SUPPORT& MAINTENANCE

INFRASTRUCTURE

Aurora solutions highlights

High Performance Density

Cooling

High reliability

Networks

End-to-end solutions

Aurora solutions use the latest and fastest technologies available. A high end solution, capable to deliver unparalleled computational power.

Aurora systems are the best in class in terms of computing density per unit rack.

Aurora solutions highlights

High Performance Density

Cooling

High reliability

Networks

End-to-end solutions

Aurora removes component generated heat using water from 18 °C to 50 °C, with no need for air conditioning, in any climate zone. This allows reaching a data center PUE of 1.05.

Direct control of cooling parameters (T, flow rate…) to maximize energy efficiency

Possibilities for thermal energy recovery.

Aurora solutions highlights

High Performance Density

Cooling

High reliability

Networks

End-to-end solutions

Direct liquid cooling limits hot spotsVibration less operations Board temperature control Redundancy of all critical componentsIndependent sensor networksSolid state storage Soldered memoryQuality controls on production Serviceability.

Aurora solutions highlights

High Performance Density

Cooling

High reliability

Networks

End-to-end solutions

An Infiniband switched network coexists with an optional FPGA driven 3D Torus switchless network.

Three independent synchronization networks (system, subdomain and local) preserve efficiency at petascale by guaranteeing that the communication and the scheduling of all nodes are automatically handled..

Aurora solutions highlights

High Performance Density

Cooling

High reliability

Networks

End-to-end solutions

Solution design, from initial need to systems operations:HW and SW solution designCooling infrastructure design and deploymentDelivery, installation and testingSoftware servicesMaintenance and support

AURORA

Hardware systems

Aurora HW architecture

• The chassis is the basic block that is used to form the Aurora supercomputers. It is the minimum unit on sale.

• It can be partially or totally filled by nodes, up to 16 nodes per chassis, with a computational peak power ranging from 6.2 to 25 Tflops, depending on the processor and accelerator used.

• Aurora supercomputers can scale from few Tflops to multiple Petaflops.

The chassis: standalone building block

Root card with the Infiniband switch

Computational nodes

Power Supply

AURORA

CPU based supercomputers

Key Features:

High Performance Density – 4096 processor cores, up to 100 TFlops in just 1.5 m2

Energy efficiency– target datacenter PUE of 1.05, no need for air conditioning, up to 50% less energy  Fast interconnects– Infiniband QDR/FDR, 3D Torus, Latency ~ 1us 

Flexible Liquid Cooling– All components are cooled by water, temperature from 18°C to 52°C and variable flow rates

Reliability– 2 independent sensor networks, soldered memory, uniform cooling, quality controls

The Aurora HPC 10-10A Cutting Edge Highly Powerful Supercomputer

The Aurora HPC 10-10A Cutting Edge Highly Powerful Supercomputer

Specifications:

CONFIGURATION• 2 CPUs per node• 16 nodes per chassis• 16 chassis per rack• 256 nodes, 512 CPUs, 4096 cores per rack

PERFORMANCE• 100 TFlop/s per rack (peak)

CPU• Xeon E5 series

MEMORY• Up to 64GB per node• ECC DDR3 SDRAM 1600 MT/s• Bandwidth: 85.3 GB/s per compute node• Soldered on board

INTERFACES PER NODE• 1 x Infiniband QDR/FDR port (40/56 Gb/s)• 1x Gigabit Ethernet port• 6 (3+3) x 3D Torus interconnects (60+60 Gb/s), ~1us

latency

INTERFACES (I/O) PER CHASSIS• 20 x Infiniband QDR/FDR ports• 17 x Gigabit Ethernet ports

LOCAL STORAGE PER NODE• 1 X 1024 GB 2,5" Sata Disk • 1 X 256 GB 1,8" microSATA SSD

OPERATING SYSTEM• Cent OS, RedHat or Suse

MONITORING• 2 independent sensor networks and power measurement

per computing node

POWER AND COOLING• Aurora Direct Hot Water Cooling• Max power per rack: 100 kW

SOFTWARE• Bright Cluster Manager, ParTec Parastation, PBS

Professional , Intel Cluster Studio, Lustre Parallel File System, Allinea, CAPS

AURORA

Hybrid supercomputers

Key Features:

High Performance Density – 2048 CPU processor cores, 256 accelerators, up to 350 TFlops in just 1.5 m2

Energy efficiency– the Aurora direct cooling target datacenter PUE of 1.05, no need for air conditioning, up to 50% less energy  Power and programmability – A choice of accelerators to suite customer needs, no portability issues with ®Intel Phi 

Flexible Liquid Cooling– All components are cooled by water, temperature from 18°C to 52°C and variable flow rates

Reliability– 3 independent sensor networks, soldered memory, no moving parts, uniform cooling, quality controls

The Aurora TigonUnleash the hybrid power

Specifications:

CONFIGURATION• 2 CPUs per node + 2 Accelerators per node• 16 nodes per chassis• 16 chassis per rack• 256 CPUs and 256 accelerators per rack

PERFORMANCE• Up to 350 TFlop/s per rack (peak)

CPU• Xeon E5 series

ACCELERATORS• 2 x Nvidia Kepler K20 per node OR• 2 x Intel Xeon Phi 5120D per node

MEMORY• Up to 64GB per node• ECC DDR3 SDRAM 1600 MT/s• Bandwidth: 85.3 GB/s per compute node• Soldered on board

INTERFACES PER NODE• 1 x Infiniband QDR/FDR port (40/56 Gb/s)• 1x Gigabit Ethernet port• 6 (3+3) x 3D Torus interconnects (240+240 Gb/s), ~1us

latency

INTERFACES (I/O) PER CHASSIS• 20 x Infiniband QDR/FDR ports• 17 x Gigabit Ethernet ports

LOCAL STORAGE PER NODE• 1 X 1024 GB 2,5" Sata Disk • 1 X 256 GB 1,8" microSATA SSD

OPERATING SYSTEM• Cent OS, RedHat or Suse

POWER AND COOLING• Aurora Direct Hot Water Cooling• Power per rack: 100 kW

SOFTWARE• Bright Cluster Manager, ParTec Parastation, PBS

Professional, Intel Cluster Studio, Lustre Parallel File System, Cuda, Allinea, CAPS

The Aurora TigonUnleash the hybrid power

AURORA

Booster architecture

DEEP project In the DEEP project, the concept a standard Cluster with an InfiniBand® interconnect and Intel® Xeon® nodes is combined with an innovative, highly scalable Booster constructed of Intel® Xeon PhiTM co-processors (BN) and the EXTOLL high-performance 3D torus network. Offloading Applying accelerators at the Cluster level, rather than the node level, means that applications composed of various kernels can run low to medium scalability kernels on the Cluster side, and offload the kernels with high scalability to the Booster side.

The Booster architectureRunning toward exascale

AURORA

Mid range systems

Key Features:

Powerful – Aurora G-Station is able to perform at 6.25 Tflop/s per rack with CPU only and at 20.6 Tflop/s per rack with accelerators. Very fast I/O with Infiniband or Gigabit ETH

Compact – Remarkable density, storing 32 powerful Xeon processors in a 12U (or 17U with incorporated heat exchanger) rack

Energy efficient – Direct hot liquid cooling doesn’t require air conditioning savings on energy bills.

Noiseless – The Aurora G-Station is fan-less so it completely silent

Easy – The G-Station doesn’t have a complicated and messy cabling because all of the nodes are connected via backplane

The Aurora G-StationCompact and powerful

The Aurora G-StationCompact and powerful

Computing power

5.5 TFlop/s per rack (peak) or 20.6 Tflop/s per rack with accelerators

Processor Up to 32 X Intel Xeon E5 series per node

Accelerators 16 X Nvidia Kepler K20 per node OR

16 X Intel Xeon Phi 5115D per nodeArchitecture Up to 16 backplane connected server

nodes

Up to 8 backplane connected server nodes with accelerators

Memory Up to 1 TB RAM (64GB soldered RAM per node). ECC DDR3 SDRAM 1866 MT/s

Interconnects 40 Gbps QDR Infiniband

1GbE

Optional: 1+1 3D Torus or 3D mesh BW:up to 240+240Gbps, Latency: ~1us

I/O ports 20 x Infiniband + 17x Gigabit EthernetLocal storage up to 16 TB GB 2,5" Sata Disk or up to 4

TB 1,8" microSATA SSDStorage Up to 200 TB Infiniband storage

Cooling Aurora Embedded Hot Liquid Cooling (external or embedded heat exchanger configurations)

Power 4-6 Kw per rack

Dimensions and weight

H 93cm x W 60cm x D 74cmwith external cooling: H 63cm x W 60cm x D 75cm

Operating System

Linux

Cluster Manager Bright Cluster ManagerCompilers, Libraries and Tools

OpenMPI, CUDA, CAPS, Allinea, NICE software suite

Job Management

PBS Professional

Parallel File System

Lustre

Applications Altair, MSC and Ansys solvers

Environmentaltal

Softwaretal

Specificationstal

AURORA

Storage

• Eurotech Aurora systems can accommodate up to 2TB of SATA disk or 512 GB SSD for each node

• Each Aurora rack will have up to 512 TB of local storage for scratch memory or other utilizations

• Aurora systems are generally coupled with external high performance storage

Local storage

As part of an overall HPC solution Eurotech can integrate its own supercomputers with high speed high performance storage

Aurora mainly integrates Infiniband for storage, to get a performance compatible with the computer power it offers. Hence, the preferred storage solutions are those with a native Infiniband solution.

High performance Storage

EUROTECH

Aurora liquid cooling

Liquid cooling for Eurotech

Liquid cooling for us is:• Hot. So, using hot water wherever possible• Direct. Taken inside the rack in direct contact with the

components• Green. Able to use free cooling in any climate zone• Comprehensive. Cools any source of heat in the server

(including power supply)• Serviceable and safe. Allows ease of maintenance and

doesn’t represent a risk for the electronics in the server

What liquid cooling is for us

Aurora liquid cooling

• The main components of the Aurora cooling system are:• Cooling circuit, that is the pipe work which bring the water to the heat

exchanger and back to the rack• The heat exchanger for free cooling• Distribution pipes which are mounted in the rack• The back plane, which collects the liquid from the distribution pipes and

distributes it to the cold plates• Cold plates: aluminum boards which are intimately coupled with the electronic

boards of compute nodes, PCUs and switches• Quick disconnects that are mounted on the cold plates for inflow and outflow

of liquid in the plates. The quick disconnects are fine pieces of engineering that seal immediately when the boards is extracted from the back plane. No leakage is possible

High level description

Aurora hot water cooling

Liquid distribution bar

Heat

Co

ld

Pla

teC

old

P

late

Co

ld

Pla

te

Co

ld

Pla

te

Backplane

Quick disconnects

Cold Plate

Switch and Root Card

Free Coolers

AURORA

Aurora software

Aurora Software Integration

• Aurora solutions include software, ranging from firmware OS, 3D torus software and cluster management applications

• As part of the solution, Eurotech makes sure that all software necessary to run the customer application is correctly installed

• The software installation can be carried out in house or on customer site

• While Eurotech leverages partnerships with commercial software vendors, It also has the in house expertise to manage open source and licensed software throughout the software lifecycle

• While the software stack depends on customer requirements, an example is reported in the next slide

Aurora Software Integration servicesThe Eurotech HPC team integrates drivers, operating systems, cluster managers, filesystems, resource managers, schedulers… to provide a turnkey environment where the customers run their applications.

Several applications can run on Eurotech Aurora supercomputers benefiting from a combination of compatibility and higher performance. For exampleAbaqus , Avizo, ANSYS Workbench, ANSYS Fluent, Altair HyperGraph, Altair HyperMesh, Altair HyperView , Blender, EnSight.

Aurora supercomputers

Intel® Cluster Ready Architecture

Application ApplicationApplication

Benefits :

• Wider Audience

• New Markets

• More Revenue

Aurora supercomputers are Intel cluster ready

Aurora supercomputers are Intel cluster ready

Value of Intel Cluster Ready !

Intel® Cluster Ready is a standardized platform programSO WHAT DOES THAT MEAN TO ME ?

HPC adoption is everywhere – and affordable thanks to momentum in hardware and software technology. But clusters are hard to implement. Answer: they are useable for the average non-Linux savvy buyer, if clusters are developed on a standardized platform – like Intel® Cluster Ready. Assurance is that the software will run, and everything will work because it has been tested.

Wait a minute – isn’t that like buying a laptop from Best Buy or a computer store ?

Yes !!! You know it will work – they have tested it !

AURORA

Services

Aurora HPC Services

• Eurotech can provide services that complement and complete the product offering over and above the standard warranties

• The customer can choose between a range of different options varying from warranties extensions to on site dedicated support

• Eurotech also leverages its long history of custom projects and its experience in solution delivery to seamlessly manage HPC project

Aurora HPC services

Customer requirement

Solution design Deployment Training Customer

Support

Maintenance and software

updates

The service offering covers end to end an HPC project lifecycle: from customer needs gathering and design to deployment, training and support

Eurotech aims to meet customer requirements, to properly design, assemble and install the Aurora solution and to guarantee smooth operations throughout the lifetime of the proposed solution

Aurora HPC delivery

Aurora solutions are delivered to customer following a proven methodology

The methodology consists in a blueprint that covers:

• Design• HW production • Pre-test • HW and SW installation• Acceptance

The blueprint is the structure within which the HPC project is defined

Support and maintenance

As part of the operational support schema, Eurotech provides preventive maintenance

This includes activities like • Monitoring• Software Services• Spare part management

The maintenance schema aims to provide both the proactive actions that prevents faults and the reactive capabilities to act quickly and reduce the mean time to repair (MTTR)

The final goal is to maximize the availability and up time of the system

Operational support

Solution optimization

Maintenance

Training

Support

Aurora HPC support to customers and SI

Eurotech supports the solutions it delivers via a structured approach that allows the customer to benefit from one single point of contact.

Structure doesn’t prevent customer intimacy: the engineers who designed the hardware or assembled the solution are in close contact with the 2nd line of support and, if necessary, are assigned to follow Customer Service Requests from the beginning to the end.

Eurotech can organize that an engineer, trained on the HPC solution implemented, is located on site to administer the system and provide immediate support

Aurora HPC support

Gold

On site permanent trained personnel

Part replacement and RMA management

Software maintenance

On site replacements

Single point of contact

24x7 web portal access

Bronze

Office hours support

Part replacement and RMA management

Single point of contact

24x7 web portal access

Silver

Extended office hours telephone support

Part replacement and RMA management

Engineer travels on site

On site replacements

Software maintenance

Single point of contact

24x7 web portal access

No rigid structures: any combination of the below options is feasible

Installation

Monitoring and

Support

Upgrade and patch

Aurora Software Services

• All of the software delivered with Aurora is regularly checked for updates, upgrades, new releases and patches

• Depending on the type of update required, Eurotech can either assist or deliver on customer premises patches and upgrades

• Depending on the urgency and the impact of the software update, Eurotech will liaise with the 3rd party software vendor

Training

• Eurotech provides ad-hoc training on the Aurora solutions it designs and assemble for customers

• Training covers the Aurora systems (usage, maintenance, software), including the water cooling

• Specific software training can be provided by Eurotech or directly by the software vendor training personnel, depending on the type of software installed

AURORA

Aurora solution benefits

Why Aurora solutions?

ScalabilityLinear scalability to users from Gigaflops to Petaflops

Compatibility and flexibilityChoice of interconnectsX86 based systems

GreenAurora data centers consume 50% less power than data centers based on standard air cooled technology

CompetenceHPC division expertiseEnd to end solution deploymentFlexibility to work with final customer, SI and as OEM

RAS and UseReliabilityAvailabilityServiceabilityEase of installation and use

High performance densityFastest available technology for high density computational power

High Performance Density

• Aurora uses the fastest Intel technology available− Intel Xeon E5 (Sandy Bridge) , Intel Phi, Nvidia Kepler

• Fast Infiniband Interconnects− Water cooled infiniband switches included in the systems

• 3D Torus− High speed up 60/240 GB/sec fullduplex 3D torus network based on FPGA− In collaboration with research institutions like I.N.F.N, TNW and FBK, Eurotech has

developed one of the fastest and most reliable 3DTorus in the market

• FPGA accelerators− Aurora nodes have an on-board FPGA that can be programmed as an accelerator

• High Density– Aurora systems can pack 350 Tflop/s per standard rack.

• Modular system– Aurora systems can scale from a single chassis with 16 nodes to multiple chassis in a

rack and into a system with multiple racks

• 3D torus network− Next neighbor low latency network, no switches and no bottlenecks facilitate scalability

• Infiniband– Fast interconnections allow low latency communication

• Synchronization network– Very fast channel and global commands with subdomain manageability– Low/high level synchronization

• Less cabling– Aurora uses less cabling than competitive solutions. Only rack to rack cabling are

necessary while all inner rack interconnections are done via backplane– .

Scalability

• Aurora HW has no moving parts:– There are no spinning discs and no fans for cooling on-board heat generating

components– As a result, there are no vibrations that can harm memory and rotating discs, increasing

the longevity of components and, as a consequence, of the whole system.

• Aurora cooling limits hot spots− Improved cooling infrastructure and direct to component heat removal allows uniformity in

heat production/removal, limiting hot spots and hence another cause of failures− Stable and low temperature environment for all components− Liquid cooling eliminates data center hot spots

• Monitoring and resilience– Independent sensor networks– Redundancy of all components including networks– Choice of pro active support (preventive maintenance)

Reliability, Availability, Serviceability

• Maintainable, despite liquid cooling– Aurora node cards are hot swap thanks to the special connectors that seal

instantaneously the water circuit when a card is extracted, with guaranteed no spillage – As a result, there are no vibrations that can harm memory and rotating discs, increasing

the longevity of components and, as a consequence, of the whole system.

• 3D Torus partitioning− In each partition, the network is isolated from other partitions –no network interference

from other partitions

• Software integration– Eurotech works with the best HPC software providers to offer robustness across the

solution stack– Eurotech software competences help seamless integration

• Eurotech commitment to quality– Eurotech produces its boards in its Japanese plant, following high quality standards– Eurotech HPC selects the best in class supplier to set up the Aurora solutions

Reliability, Availability, Serviceability

• Choice of interconnects – Aurora computational units offer both an Infiniband network and a 3D Torus

interconnection that can be used in parallel– The customer can choose what is the best technology to be implemented accordingly to

the nature of the computational problem to be solved

• x86 based solution– Aurora supercomputers are based on x86 processors– Intel cluster ready certified

• A choice of software– Aurora can run a vast variety of software, both open source and commercial

• A flexible solution approach– Eurotech HPC can design solutions involving accelerators, storage and software,

according to customer requirements

Flexibility and compatibility

Everyone nowadays claims to be «green» – but are they?

Aurora Green proposition:

• Energy efficiency (achievable datacenter PUE of 1.05)• Direct on component water cooling• High reliability means less spare parts and hence less waste• 230 AC to 10 V DC in 2 steps for a power conversion close to 97%• Free cooling (heat exchangers rather than chillers and AHU)• Thermal energy recovery• High density means floor space and real estate savings (tons of CO2 and

other pollutants spared)• Noiseless operations means better work environments• Compatible with energy optimization software and job schedulers

Green and environmental

• 10 years+ of HPC experience:– An extended experience in top HPC projects– Collaborated with best in class research center to develop advanced supercomputer prototypes– Developed experience in delivering large systems (15M$+)

• Structure and agility:– Eurotech HPC division benefits from the structure coming from the Eurotech group, while keeping the

typical agility of a start up– This means prompt adaptability to customer needs. Eurotech can deliver end to end HPC solutions

inclusive of supercomputers, storage, software and services. But they can also work with system integrators, delivering parts of larger systems and as OEM for larger vendors

• Financial solidity– Differently from the pure HPC players in the market, Eurotech income statements relies on multiple

line of business, helping the HPC division to smooth revenues and to rely on abundant resources

Competence

AURORA

Aurora total cost of ownership

Data center TCO drivers

Driver Cost components

IT CAPEX Initial SW and HW capital expenditures

Space occupancy (footprint)

Cost of the occupied space and auxiliary infrastructure: rent, opportunity cost, civil, structural and engineering, permits and taxes

Data center infrastructure Electrical (UPS, generator, cables…)Cooling (Chillers, AHUs, heat exchangers, pumps…)Facilities (fire prevention, plants, security, building mng systems)

Installation Delivery, installation, test and tuning of IT, electrical and cooling equipment

Energy Cost of energy: IT, cooling, lighting and waste

Maintenance and additional operation costs

Warranty extensions, support, software licenses, IT maintenance, electrical and cooling maintenance, facilities maintenance, costs of outages, heating, security

Other: disposal, green… Costs of end of life, carbon footprint (missed) incentives, fines…

Main Areas of Aurora systems impact on TCO

• Area 1: energy savings– Lower costs due to energy cost optimization and better PUE

• Area 2: density (FLOPS/ m2) – Aurora density allows for space, racks, electrical, cooling and network

savings

• Area 3: reliability, availability and serviceability– Aurora reliability contributes to lower maintenance costs and outage

business costs

• Area 4: liquid cooling

– A part from the energy savings that water cooling implies, it also allows to save on the capital costs of cooling infrastructure

TCO - energy“Typical” power breakdown in datacenters

Data from APC

Image from APC

TCO- energyPower breakdown in an Aurora datacenter leading to a PUE of 1.05

Eurotech Aurora energy savings points

Eurotech AuroraIT equipment

Maximize Flops / Watt

Data CenterReduce House Load

Reduce Cooling Energy consumption

Data Center or ecosystem

Reuse thermal energy

Optimize power conversion

Architecture and cooling

TCO - density

MORE Flops/m2

- maintenance costs

- electrical

- cooling

- volume occupancy(m3)

- civil, structural and engineering

costs

- energy costs

- raised floor costs

- space occupancy (m2)

- IT hardware costs, like racks

- cabling and cooling hardware

costs

Reliability impacts TCO in 2 ways:- Direct costs, associated with spare parts, extended warranties, support

personnel- Indirect costs, related to the business cost associated to an outage.

The direct costs depend on the number of components and their estimated FIT (failure in time) rate, as demonstrated in the MTBF equation where is the failure rate of the single component and N the number of components

is related to quality, operating conditions, monitoring and preventive maintenance of

components

MTBF =

The indirect impact depends on type of organisation and could range from thousands to millions € per hour of outage.

So the impact of low reliability on the business could offset any saving reached during purchase and installation of IT solutions!

TCO - reliability

Impact of downtime

Adopting liquid cooling technology, it is possible to avoid most of air conditioning used to cool the IT equipment

This means that savings come from the avoidance of chillers, AHU, CFD (computational fluid dynamics), raised floor, air conditioning tuning

Liquid cooling infrastructure is generally cheaper relying on components like piping, pumps and free coolers.

If we take a 1 MW installation and we consider a cost of air cooling infrastructure of 3000$/KW, the total cooling cost would be 3M$. The same 1MW data center would require roughly 20% of that expenditure, if hot liquid cooling is implemented.

TCO – liquid cooling