Linkedin Open19 Deep Dive

Yuval Bachar

Principal Engineer, Global Infrastructure & Strategy at

Data Center Philosophy

• Every element in the data center is a server

• Appliance free data centers

• Multi-Supplier for every component in the data centers

• Solve in software what you can

Scale OutFlash for storage Disaggregation Cost Optimized

The Open19 Project

Open19 Project Goals

• Create an open standard that can fit any 19” Rack environment

for server, storage, and networking

• Create a solution that will have applicability for large, medium,

and small scale data centers

RACK DEPLOYMENT COST OPTIMIZATION

Reduce commons by 50%

CONSOLIDATE REQUIREMENTS

Eco system with high adoption level

ENABLE FASTER RACK INTEGRATION

3-5x faster integration time

Open19 Project Non-Goals

• Create a proprietary form factor

Low adoption level

• Create restrictive development environment

Minimized defined specification

• Build a heavy bureaucratic organization

Minimal organization that will enable collaboration

Engineering focused first

Business partners next

Brick

Double Wide

Brick

Power Shelf

Brick Cage

Network Switch

Double High

Brick

Platform Building Blocks

Blind mate

Power

Connectors

Blind mate

100G data cables

and

Connector

Open19 in real life…

HPe

Flex

InspurLinkedin

SuperMIcro

Brick Cage

• Passive mechanical

cage

• 12RU and 8RU options

• 2RU modularity– 4x Bricks

– 2x Double High Half Width

– 2x Double wide

– 1x Double High

• Snap-on rear opening

Rack View:

Full Cable without Rack:

• Plastic ‘spine’ snaps

around main cable

breakout

Close-Up Cable

• 4X2 Impel breakouts remain

flexible

• Length of 4X2 Impel optimized so

that cable will sit closer to the

rack

Bricks Form Factors

• Four brick form factors

– Brick (½ wide 1RU)

– Double High Half Width – (2RU)

– Double Wide Brick (1RU)

– Double High Brick (2RU)

• Linear power and data growth

• Self Sustained – EMI & Safety

& cooling

• 100G Blind Mate network

Servers in design

• Dell, HPe, SuperMicro, Flex, Celestica and Inspur are actively

working on Open19 server

• White boxes in development by Linkedin:

• Quad socket Broadwell-DE in a half width 1RU (brick)

• Dual socket High-end Skylake with up to 1.5T memory in 1RU

• Storage Servers – Single socket up to 32 drives per 1RU

• One clarification about the high density solution – To get to the

full capacity (96 @ 19.2Kw) the core count will only be 3000

Open19 Switch

• 3.2T Switch

• Dual switch: Data Path &

Management (OOB)

– 50G per server data path

– 1G per server management (optional)

– Console port per server (optional)

• 12v input (no power supplies)

• Up to 8x100G uplinks or local

switching ports

• Broadwell-DE CPU with BMC

• Linkedin white box design

Open19 Power shelf

• Two configurations:• 1RU 9.6KW per leaf zone

• 2RU 19.2KW per leaf zone

• Shared power modules

• Management via GE port

• Full AC and DC range

• Multi-Source for the shelf and modules

• Per server protection and monitoring OPTIONAL BBU

Optional rack level battery

back unit

Fast Installation Process

• Any 19” Rack

• Install the cages: 4 screws each, front only

• Install the power shelf: 2 screws, front only

• Install the two switches: 2 screws each, front only

• Snap-on cables to the back of the cages: Tool-less

• Plug the power shelf: Snap-on cable, tool-less

• Connect the switch: Snap-on + optics, tool-less

• Blind-mate install the bricks: Tool-less

• Connect the power feed to the power shelf: Tool-less

• GO: The rack is integrated, up and running!

Open19 & OCP

• OCP is an organization that allows hardware and

software specification contributions, with propriety

form factor per solution from the rack to the server.

• Open19 defines an architecture and standard form

factor for compute and storage in any 19” rack

environment with fully cross supplier interoperable

environment

Open19 & OCP - Features

Feature Open Compute Project -

OCP

Open19

Required rack Requires a variety of non-

compatible special racks – like

the FB OCP rack, the Google

48v rack, etc.

ANY standard EIA 19” rack

Form Factor Specialty or 19” racks with OU

and RU form factors

19” Rack with 1RU (1.75”)

building blocks

Server &

Storage

Pre-designed servers by the

data centers’ operators and

manufactured by single or

multiple ODMs

Open design for innovation by

all server design teams and

manufacturers in the industry

into a shared form factor

Non-Standard

equipment

Does not allow a mix with non-

OCP gear in the same rack

Allows full integration of

Open19 gear and standard 19”

gear in the same rack

Open19 vs. OCP – Detailed FeaturesFeature Open Compute Project - OCP Open19

Disaggregation Disaggregated solution with a rack

level cooling/power/and

controllers in place

Fully disaggregated solution each

element is self-sustained with

common power conversion

Cooling and airflow Centralized cooling – fan door or

localized large fan trays.

Specialty site airflow requirements

(like hot/cold isle isolation)

Disaggregation – Each element in

the system is self sustained. With

per location optional cooling assist

(like fan doors, self cooling racks)

Power Centralized power distribution

using bus bars

Centralized power distribution

leveraging low cost connectivity

EMI and Safety No element or rack level EMI

containment, rack level safety

Disaggregation – Each element in

the system is self-certified and

responsible for safety and EMI

certification

Networking Per server networking

connectivity – DAC cables

Blind mate cost effective

100G/every ½ wide 1RU slot.

Open19 vs. OCP – Eco-System

Feature Open Compute Project -

OCP

Open19

Eco System Built out of a collection of

design teams and

manufacturing ODMs

operating in isolation and

contributing specifications

Form factor centralized and

common to all solutions.

Compatible elements designed

by ODM/OEM suppliers

IP protection Limited to no IP protection for

OCP contributions

Full IP protection, the designs

are not required to be open

their IP

Drivers and

supporters

Mostly mega data centers

operators and some service

providers

Mostly mid to large size data

center operators with some

service providers

Manufacturing

hardware

suppliers

Mostly ODMs 1-2 suppliers for

each element including

commons, servers, and

storage

OEMs and ODMs 2-3 sources

for every common element in

the platform and 4-10 suppliers

for unique servers and storage

Platform Benefits

ANY19” RACK

Any location

DISAGGREGATION

Self sustained servers

EFFICIENT POWER

Single stage 96% power conversation

No server power supplies

LEVERAGE EXISTING SERVERS

Bricks form factor fit most existing motherboards

MULTI-SERVER TIERS

Four form factors

Server IP protection and innovation

FULLY REDUNDANT INFRA

A/B 2N power redundancy

No central controllers

COST EFFECTIVE

Rack level cost reduction

Solution cost savings

SHORT INTEGRATION TIME

5-6x faster rack level integration

Open19 Deployment Models

• Traditional: Data center operators

• Bare metal cloud service: Lease a slot - Emerging

• High efficiency offsite integration

• Edge platform cloud optimization

Future Developments for Open19

• Open orchestration & management software

• Different cage form factors

• New “server” models

• Automated data center deployment model

• Optical snap-on data cabling

• Liquide cooling integration

• Automated data center

• Any other “crazy idea”

Linkedin Deployment Model

Staged Datacenter Deployment – Stage1

Pre-Server Stage

• Build out to site/suite capacity of empty cages

• Power shelf and cables integration

• Switching integration with optical uplinks

• Move to warm deployment state

• Cost effective

• Accelerating date center deployments

Staged Datacenter Deployment – Stage2

Server Integration

• Insertion of servers on demand

• Fully automated provisioning and deployment

• Deploy 1000s of severs in days not months

• Create an elastic data center model with fix low cost infra

Staged Datacenter Deployment – Stage3

Sustaining & Operations

• Never touch infra

• Server only blind mate insertion removal

• Full monitoring and automation

Open19 Foundation

Open19 Foundation

• Established in May 2017 and open for business

• Launch event 5/23/2017 – Check out our YouTube channel

• A community based organization for open source hardware and

software, Open19 project is one of many

• 5 Founding members, 27 members, 1200 individual members

growing daily

• In forming stages and establishing very fast very special

community and IP sharing rules

• Join us @ www.open19.org

Summary

• Open19 is about defining a common form factor

• Open19 is about community collaboration

• The Open19 community is established now: over 75 companies

involved

• Data center Operators and integrators

• Systems Suppliers

• Components suppliers

• Open19 technology will be ready for production Q1 2018

• Go to open19.org and join us individuals and companies

Yuval Bachar

www.open19.org