Fiber in Data Centers...Standards Review •IEEE 802.3: Ethernet Fundamentals •TIA-568.3-D:...

Fiber in Data Centers

What’s Next?

Srinivasan B, RCDD

Hubbell Fiber Systems

10G / 40G / 100G / 400G

Standards, Applications and

Practices

Agenda Part 1: Current Technologies

▪ Standards Review

• IEEE 802.3: Ethernet Fundamentals

• TIA-568.3-D: Telecommunications Fiber Cabling

• TIA-942-A: Data Center Standard Overview

▪ IEEE 802.3ba: Fiber 40G and 100G Channel Overview

▪ Migration: 10G - 40G - 100G - 400G

▪ IEEE 802.3bs: 400G Draft Standard

▪ Singlemode 40G/100G

▪ Summary: Evolution and Migration Strategy

Agenda Part 2: New Developments, 2017

▪ IEEE 802.3by: Introduction of 25Gb/s

▪ IEEE 802.3bm: Application of 25Gb/s to 40G and 100G Protocols

▪ IEEE 802.3bm: New 40G Singlemode Application

▪ Impact of 25Gb/s on Future Migration: 40G/100G/400G

▪ Emergence of Wide Band OM5 Multimode

▪ OM5 applications and impact on 100G/400G migration

▪ Maintaining MPO 12-Fiber Infrastructure

▪ Conclusion

IEEE 802.3

Networking Standards:

Basic Overview

Local Area and Metro Networking Standards

IEEE 802.3 Ethernet Standard

IEEE 802.3: Carrier Sense Multiple Access with Collision Detection (CSMA/CD)

▪ IEEE 802.3 is a “Living Document” defining the Physical Layer and Data Link

Layer Ethernet specifications for Local Area and Metro Networks.

▪ CSMA/CD is the “traffic control” technology for network access and signaling.

▪ New Technologies are continually published on 802.3 addenda.

▪ Current Multimode short wave Ethernet protocols:

▪ 1 Gb/s: 1000BASE-SX (1 fiber pair)

▪ 10 Gb/s: 10GBASE-S (1 fiber pair)

▪ 25 Gb/s: 25GBASE-S (1 fiber pair)

▪ 40 Gb/s: 40GBASE-SR4 (4 X 10G pairs = 8 Fibers)

▪ 100 Gigabit Ethernet: 100GBASE-SR10 (10 X 10G pairs = 20 Fibers)


Basic Elements of Ethernet Message Transfer

▪ Devices on a network have a MAC and IP address

▪ Ethernet frames travel between MAC devices through network cabling,

switches, and routers

▪ Frame “collisions” at a node are detected and sequenced

▪ Collision Detection is the fundamental concept of Ethernet

Basic Network Elements Defined

▪ LAN: Switch-based network, single broadcast domain in a building

▪ WAN: Router-based network, multiple broadcast domains

▪ SAN: Switch-based network, storage equipment domains

▪ MAC: Medium Access Control (protocol for access network devices)

▪ IP Address: Internet protocol (for internet access to network devices)


LAN-WAN-SAN Campus Network Example

WAN

Router

Building #1 Building #2


Contents of an Ethernet Medium Access Control (MAC) frame

PreambleDestination

Address

Source

Address

Length/

Type

Data

Packets

Frame

Check

Sequence

Start of

Frame

Delimiter

Packet Errors affect

network performance

Impact of Cabling on Data Rate

Transport Layer and Quality of Data Transfer

▪ Impacted by cabling, components, and installation

▪ Primary cause of Optical Bit Errors:

• Insertion loss, modal dispersion, and back reflections

▪ Impact of Bit Errors

• Corruption of data packets

• Packet rejection by the Transport Layer (Delay)

• Result: Slow network speeds

High Bit Error Rate = DELAY

TIA-568.3 Standard: Key Developments

Current Revision: TIA-568.3-D (December, 2015)▪ Replaces TIA-568-C.3

▪ Incorporates 24-fiber MPO connector

• Two rows of 12 fibers

• Supports 100GBASE-SR10

▪ Defines MPO Polarities for 10G, 40G, and 100G

• A Polarity: Straight-through, 1-1 mapping

• B Polarity: Reversed sequence, 1-12 mapping

• C Polarity: Crossed pairs, 1-2, 2-1 mapping

12-Fiber MPO 24-Fiber MPO

TIA-568.3 Standard: Key Specifications

Connector Mated Pair: Insertion Loss▪ 0.75 dB Maximum (Note: 0.5 dB is typically recognized)

Connector Mated Pair: Minimum Return Loss

▪ OM3 and OM4: 20 dB

▪ Singlemode UPC: 35 dB

▪ Singlemode APC: 55 dB

OM3 and OM4 Multimode Cable Loss

▪ 3.0 dB/km @ 850 nm

▪ 1.5 dB/km @ 1300 nm

OS2 Singlemode Cable Loss @ 1310, 1383, and 1550 nm

▪ Indoor: 1.0 dB/km

▪ Indoor/Outdoor: 0.5 dB/km

▪ Outside Plant: 0.4 dB/km

TIA-568.3: 10G MPO Infrastructure

10GBASE-S MPO Cabling: 4-Connector Channel

▪ OM3 Channel Limits:

• 300 meters, 2.6 dB Max

▪ OM4 Channel Limits:

• 550 meters, 3.1 dB Max

Switch

or

Server

Switch

or

Server

MPO Female

Trunk

LC Duplex

Patch Cord

LC Duplex

Receptacle

MPO to LC

Cassettes

LC Duplex

Receptacle

LC Duplex

Patch Cord

TIA-568.3: 10G Polarity Management

Rules for 10G Channel Polarity

▪ Must have one overall pair crossing, end to end

▪ In general: Must have an odd number of pair crossings, end to end

▪ Pair Crossings are managed in the patch cords, cassettes, or MPO trunk

Switch

or

Server

Switch

or

Server

MPO Female

Trunk

LC Duplex Cord

Straight Polarity

MPO to LC

CassettesLC Duplex Cord

Reversed Polarity

Multimode Fiber Evolution

VCSEL Laser Optimized Multimode Fiber: OM3 and OM4

▪ VCSEL = Vertical Cavity Surface Emitting Laser

▪ Longer distances / Higher bandwidth at 850 nm

OM3 Laser-Based Multimode Distances

▪ 1Gb/s: Up to 1,000 meters

▪ 10Gb/s: Up to 300 meters

▪ 40G/100G: Up to 100 meters

OM4 Laser-Based Multimode Distances

▪ 1Gb/s: Up to 1,100 meters

▪ 10Gb/s: Up to 550 meters

▪ 40G/100G: Up to 150 meters

IEEE 802.3 Physical Layer Data Link

10 GbE Fiber Transceivers are Laser Based

▪ Transmitter: Converts digital to optical by laser modulation

▪ Receiver: Converts optical to digital by photo detection

Fiber 10/25 Gb/s Physical Layer Data Link

TX RXOP OP

RX TXOP OP

Digital

Input VCSEL Laser

850 nm

DetectorDigital

Output

Digital

Output Detector VCSEL Laser

850nm

Digital

Input

Multimode Fiber Evolution

Bend Insensitive Laser Optimized OM3 and OM4

▪ New bend radius performance introduced by ITU, TIA, and IEC standards

• Modified cladding index band around core

• New cladding chemical formulation

▪ Performance Advantages:

• Longer cable fatigue life under bend loading

• Lower dB loss at a smaller bend radius 50 Micron Core

Graded Index

Cladding

125 Micron

Modified Refractive

Index Band Around

Core

Tight Bend

Radius:

5 to10 mm

Multimode Fiber

Cross Section

Singlemode Fiber Evolution

Bend Insensitive Singlemode Fiber: OS2 Grade

▪ OS2 singlemode replaces legacy OS1

▪ OS2 improvements similar to multimode:

• Modified cladding refractive index band around core

• New cladding chemical formulation

• Improved fatigue life and lower dB bend loss

9 Micron Core,

Step Index

Cladding

125 Micron

Modified Refractive

Index Band Around

Core

Tight Bend

Radius:

5 to10 mm

Singlemode Fiber

Cross Section

Data Center: TIA-942 Update

TIA-942-A: Telecommunications Infrastructure Standard for Data

Centers

▪ Replaces TIA/EIA-942

▪ Incorporates two addenda:

• AD1: Coaxial cable (T-3, E-1 and E-3) and distances

• AD2: Energy efficiency: wider range of temp and humidity, 3-level lighting,

Cat 6A, noise sources, updated tier structure

▪ Terminology: Harmonized with 568-C series and ISO/IEC

▪ Added references to TIA-569-C, TIA-606-A and TIA-607

▪ New Infrastructure elements added for large data centers:

• IDA - Intermediate Distribution Area

• ICC - Intermediate Cross Connect

Data Center: TIA-942 Topologies

Key Elements of the Data Center using Fiber Cabling

▪ Equipment Distribution Area (EDA)

▪ Main Distribution Area (MDA)

Switch

Servers

Switch

Servers

Switch

Servers

Switch

Servers

MDA

MC, Router, Switch, PBX

Data Center

TR

Entrance

Room APOutside

TR’s

EDA

Computer

Room

Data Center Overview

What is a Data Center?

A large group of networked computer servers used for remote

storage, processing, and distribution of large volumes of data.

Data Center Overview

ANSI/BICSI 002-2014: Data Center Design and Best Practices

▪ BICSI is a publication of general guidelines

Data Center: ANSI/BICSI 002-2014

Key Topics Covered by ANSI/BICSI 002-2014

▪ Site Selection

▪ Space Planning

▪ Architectural

▪ Structural

▪ Electrical Systems

▪ Mechanical

▪ Fire Protection

▪ Management and Building Automation Systems

▪ Cabling Infrastructure, Pathways and Spaces

▪ Security and Disaster Recovery

▪ Commissioning

▪ Data Center Maintenance

Fiber Data Center Applications

Fundamental Cabling Topologies▪ Server Fabric / SAN Fabric

▪ Switch/SAN to Servers

▪ Servers to MDA/LAN

Basic Fiber Infrastructure▪ Equipment and Patch Cords

▪ Local Interconnect Units (LIU’s)

▪ Interconnect MPO Trunk Cable

EQUIP EQUIP

Patch

Cords

Patch

CordsLIU LIU

MPO

Trunk

(Link)

Data Center: Key Fiber Products

▪ Interconnect Enclosures

▪ Pre-Terminated MPO cassettes

▪ MPO Trunk assemblies

▪ LC duplex patch cords

What is an MTP (MPO) Connector?

“MTP” or “MPO” is a 12 or 24 Fiber Array Connector

▪ MTP* = Multi Fiber Termination Push-on

▪ MPO = Multi Fiber Pull Off

Key Characteristics

▪ Rectangular ferrule with fibers equally spaced

▪ Keyed connector body for orientation

▪ Precision flat polish end face

▪ Male connectors have two alignment pins

1 2 3 4 5 6 7 8 9 10 11 12

Connector

BodyFerrule

Key

Fibers

*MTP is a registered trademark of US Connec

MPO 12-Fiber Connector Polarity

Type ‘A’ Polarity: Straight-Through, No pair crossing▪ Most universal termination

▪ Pin 1 to Pin 1 direct mapping, end to end

Advantages▪ 10G pair crossing managed externally in the patch cords

▪ Compatible with 10G or 40G applications

1 2 3 4 5 6 7 8 9 10 11 12

MPO Near End: Key Up MPO Far End: Key Up

1 2 3 4 5 6 7 8 9 10 11 12


Type ‘B’ Polarity: Reversed Sequence

▪ Key-wise reversal: Pin 1 to Pin 12 mapping

Advantages

▪ Provides 40G-ready B-polarity flip in the MPO trunk

▪ Sequential reversal provides individual pair crossing

1 2 3 4 5 6 7 8 9 10 11 12


12 11 10 9 8 7 6 5 4 3 2 1


Type ‘C’ Polarity: Crossed pairs▪ All pairs crossed end to end▪ Pin 1 to Pin 2 / Pin 2 to Pin 1 mapping▪ Not compatible with 40G migration

Advantages▪ 10G channel pair crossings are managed in the trunk▪ Can use standard polarity patch cords (no reversing)

1 2 3 4 5 6 7 8 9 10 11 12


2 1 4 3 6 5 8 7 10 9 12 11

New Developments in MPO Technology

24-Fiber MPO Connector

▪ Two rows of 12 fibers in the same MPO footprint

▪ Supports 100GBASE-SR10

▪ Supports 10G and 40G channel consolidation

MPO Near End: Key Up

Receive fibers across top row

Transmit fibers across bottom row

4 outer fibers not used

MPO 10G Fiber Interconnect Trunks

Manufactured in 12-Fiber Multiples

▪ A, B, or C polarities are user-defined

▪ MPO on each end (no pins)

▪ Cassettes have pinned male MPO receptacles

▪ MPO transceivers are also pinned male

12-Strand

24-Strand

48-Strand

MPO Transition Assemblies

Transition from MPO to LC Connector Fan-Out

▪ Known as a “Hydra” assembly

▪ MPO 12-strand to (6) LC X 10G pairs

▪ Used for LC backbone channel consolidation

▪ Also used for 40G 8-fiber to 10G pair break-out

▪ MPO Reduces Tx/Rx congestion at the equipment

IEEE 802.3ba:

40G and 100G Ethernet

(Original Standard Release)

40G and 100G Overview

IEEE 802.3ba: 40 Gb/s Overview

40GBASE-SR4: Ratified Addendum IEEE 802.3ba, 2008

▪ Optics: 850 nm over 8 multimode fibers (4 pairs / 4 lanes)

▪ Transceivers: MPO male, 12-fiber interface

▪ 40G Multimode distance Limits:

• OM3: 100 meters

• OM4: 150 meters

▪ Strictly MPO cabling channel, end to end

40GBASE-SR4 MPO Transceiver

Lane Assignments

(4) Un-used middle fibers

NOTE: 1 Lane = 1 Pair

IEEE802.3ba: 40 Gb/s Overview

40 GbE Fiber Cabling Channel and dB Attenuation Limits

▪ OM3: 1.9 dB max

▪ OM4: 1.5 dB max

▪ IEEE suggests a maximum 2-connector channel (shown below)

▪ NOTE: Beyond 2 mated pairs may exceed dB insertion loss limits

▪ No migration from legacy LC/SC cabling

40GbE: 4 Pair, 2-Connector MPO Channel

4 Pairs 4 Pairs 4 Pairs

IEEE 802.3ba: 40 Gb/s Overview

Why use an MPO/MTP connector interface?

▪ Maximum fiber density in a small foot print

▪ MPO/MTP connectors are well recognized

▪ Equal fiber lengths minimize delay skew

40GBASE-SR4 Lane Assignments

Polished fibers,

equal in length

40Gb/s Overview: Channel Polarity Rule

There must be one Type ‘B’ (key-wise) polarity reversal end to end

▪ In general: Must have an odd number of key-wise polarity reversals end to end

Managing 40G Channel ‘B’ Polarity Reversal▪ In the MPO patch cord - either end

▪ In the MPO trunk

▪ Or - Use a polarity-reversed MPO adapter panel in LIU #1 or LIU #2

▪ Polarity-reversed MPO adapters are available, with a gray color

MPO 12-Fiber Trunk

MPO Patch CordMPO PanelsMPO Patch Cord

F M M F

LIU #1 LIU #2

IEEE 802.3ba: 40Gb/s Summary

Native 40G is a Pre-Terminated 8-Fiber MPO Channel, End to End

▪ Supported by legacy 10G 12-fiber MPO cabling

▪ Positioned for new applications (see “New Developments”)

40G Cabling Design and Implementation

▪ Adhere to a 2-connector channel, distance, and dB loss limits

▪ Use a consistent channel polarity scheme, end to end

▪ Consider 40G/100G migration strategy

IEEE802.3ba: 100 GbE Overview

100GBASE-SR10: Established in addendum IEEE 802.3ba, 2008

▪ Optics: 850 nm over 20 fibers in parallel (10 pairs / 10 lanes)

▪ Transceivers: 24-fiber MPO male (Departure from 12-fiber MPO)

▪ 100G Multimode channel distance limits:

• OM3: 100 meters

• OM4: 150 meters

▪ Strictly an MPO channel, end to end

100GBASE-SR10 Transceiver

Lane Assignments

(4) Un-used outer fibers

24-Fiber MPO Connector

IEEE802.3ba: 100 GbE Overview

100 GbE Fiber Cabling Channel dB Attenuation Limits

▪ OM3 Channel: 1.9 dB max

▪ OM4 Channel: 1.5 dB max

▪ IEEE suggests a maximum 2-connector channel (shown below)

▪ NOTE: Beyond 2 mated pairs may exceed dB insertion loss limits

▪ No migration from legacy LC/SC cabling

100GbE: 10-Pair, 2-Connector MPO Channel

10 Pairs 10 Pairs 10 Pairs

100Gb/s Overview: Channel Polarity Rule

There must be one Type ‘B’ (key-wise) polarity reversal end to end

▪ In general: Must have an odd number of key-wise polarity reversals end to end

▪ 100G polarity is similar to the 40G polarity rule

Managing 100G Channel ‘B’ Polarity Reversal

▪ In the MPO patch cord - either end

▪ In the MPO trunk

▪ Use a polarity-reversed MPO adapter panel in LIU #1 or LIU #2

▪ In the consolidation module if migrating legacy 12-fiber MPO cabling **

MPO 12-Fiber Trunk


F M M F

LIU #1 LIU #2

** Not Recommended

40G/100G Overview: Notes on Gender

All MPO Junctions are Male to Female

▪ Male MPO connectors have alignment pins

▪ MPO adapters only facilitate pre-alignment

General Guidelines for Native 40G/100G Cabling

▪ Transceiver receptacles are always pinned MPO male

▪ MPO patch cords should be female, both ends

▪ MPO trunks should be pinned male both ends to create a receptacle

▪ In general, the “permanent” side of any MPO receptacle should be pinned male

MPO Trunk


F F F F

LIU #1 LIU #2

** Not Recommended

M M

IEEE 802.3ba: 100GbE Summary

802.3ba 100G is an Independent 24-fiber MPO Channel, End to End

▪ Direct equipment interconnect only, “chip to chip”

▪ Supported by legacy 24-fiber MPO cabling only (see “Migration Strategies”)

100G Cabling Design and Implementation

▪ Adhere to a 2-connector channel, distance and dB loss limits

▪ Consolidation of legacy 12-fiber MPO infrastructure is not recommended **

▪ Add 100G 24-fiber MPO channels separately to simplify administration

▪ Consider a 100G – 400G migration strategy (see “New Developments”)

** 4-connector channel = dB loss violation

40G/100G: Worst Case 100m Channel Loss

For a 2-Connector MPO Channel (2 LIU’s), per TIA-568.3 Loss Spec of 0.75 dB:

▪ Total Mated Pair Insertion Loss = 0.75 X 2 = 1.50 dB (Worst Case)

▪ Add 0.3 dB for 100 meter channel length: Total channel loss = 1.80 dB

▪ OM3 Channel dB Loss Limit = 1.90 dB @ 100 m


➢ The worst case 2-connector channel loss is marginal

➢ Reducing the mated pair loss specification to 0.5 dB becomes necessary

MPO 12-Fiber Trunk

MPO Patch Cord

MPO Panels

(2 Mated Pairs)MPO Patch Cord

F M M F

LIU #1 LIU #2

40G/100G: “Typical” 100m Channel Loss

For a 2-Connector MPO Channel (2 LIU’s), Using a Loss Spec of 0.50 dB:

▪ Total Mated Pair Insertion Loss = 0.50 X 2 = 1.00 dB




➢ The 2-connector channel loss is robust at 0.50 dB per mated pair

➢ Adding one mated pair junction at 0.50 dB in the channel becomes marginal

MPO 12-Fiber Trunk

MPO Patch Cord

MPO Panels

(2 Mated Pairs)

MPO Patch Cord

F M M F

LIU #1 LIU #2

40G/100G: Low Loss MPO Connections

4-Connector, 100m MPO Channel (4 LIU’s), Using 0.35 dB Specification

▪ Total Mated Pair Insertion Loss = 0.35 dB X 4 = 1.50 dB


▪ OM3 Channel dB Loss Limit = 1.90 dB

▪ OM4 Channel dB Loss Limit = 1.50 dB

➢ The 4-Connector channel is marginal with low loss MPO connectors

MPO Trunk

MPO Patch Cord

0.35 dB

Low Loss

MPO “Elite” MPO Patch Cord

F M M F

LIU #1 LIU #3LIU #2M F

LIU #4F M F F

Summary: Low Loss MPO Connectors

Low loss connectivity is required for a 4-connector MPO channel

▪ (4) Low loss MPO junctions increases cost, administration, and points of failure

▪ Low loss MPO connectors will permit a robust 3-connector channel

▪ A 3-connector channel permits one consolidation or polarity-changing module

➢ Best design is a 2-connector channel with standard loss connectors

MPO Trunk

MPO Patch Cord

MPO “Elite”

JunctionsMPO Patch Cord

F M M F

LIU #1 LIU #3LIU #2

M F

LIU #4

F M F F

10G to 40G Migration Methods

Method 1: De-Commissioning Legacy 10G MPO Cabling

▪ Requires substantial elimination of existing cabling infrastructure

➢ Scrap everything end to end, except the MPO trunk

10G

Switch

or

Server

10G

Switch

or

Server

MPO 10G

Female Trunk

LC Duplex

Patch Cords

LC Duplex

Receptacles

MPO to LC

Cassettes

LC Duplex

Receptacles

LC Duplex

Patch Cords

10G to 40G Migration: Method 1

After Elimination of LC Cords and MPO Cassettes, Both Ends

▪ Add: MPO feed-through panels and MPO 40G patch cords (Note Gender)

▪ NOTE 40G Polarity Rule: One Type ‘B’ reversal, end to end

40G

Tx/Rx

40G

Tx/Rx

Existing MPO

Female Trunk

MPO 40G Female

to Male Patch Cord

A-Polarity

40G MPO Male

Tx/Rx Receptacle

MPO Feed-Through

Adapter Panel

40G MPO Male

Tx/Rx Receptacle

MPO 40G Female

to Male Patch Cord

B-Polarity

F M M F

10G to 40G Migration: Method 2 - Native

Method 2: Add 40G Channels Separately: No De-Commissioning 10G

▪ Add: MPO trunk, MPO panels and MPO 40G patch cords (Note Gender)

▪ 40G Polarity Rule: One Type ‘B’ reversal, end to end

40G

Tx/Rx

40G

Tx/RxNew 40G MPO Trunk

MPO 40G Female

Patch Cord

A-Polarity

40G MPO Male

Tx/Rx Receptacle

MPO Feed-Through

Adapter Panel

40G MPO Male

Tx/Rx Receptacle

MPO 40G Female

Patch Cord

B-Polarity

F F F FM M

40G to 100G Migration: Method 1

Method 1: De-Commissioning Existing 40G 12-Fiber Cabling

▪ Replace: 40G MPO patch cords with 100G MPO patch cords, both ends

▪ Replace: MPO adapter panels with consolidation modules (Note Gender)

▪ Consolidate: 40G 12-strand MPO trunks: 2 into 1 (Note: only 12-strand will work)

100G

Tx/Rx

100G

Tx/Rx

Consolidated

MPO Trunks

MPO 100G Female

Patch Cord 24

Strand

100G MPO Male

Tx/Rx Receptacle

MPO 2 into 1

Consolidation

Modules

100G MPO Male

Tx/Rx Receptacle

MPO 100G Female

Patch Cord

24-Strand

F F F F

40G to 100G Migration

What is a 100G MPO “Consolidation Module” ?

▪ A CM combines two 12-fiber MPO inputs into one 24-fiber MPO output

▪ Also known as a “2 into 1 conversion cassette”

▪ CM’s are also used to “re-map” polarities into 100G format.

▪ NOTE: A CM creates a 4-connector MPO channel – Not Recommended

2 x 12-Fiber

MPO Cords

MPO 100G Female

Patch Cord

24-Fiber

MPO 12-Fiber Male

Receptacle Inputs

MPO 100G Female

Patch Cord

24-Fiber

CMCM

MPO 100G Male

Receptacle

24-Fiber Output

MPO 100G Male

Receptacle

24-Fiber Output

40G to 100G Migration: Method 2 - Native

Method 2: Add 100G Channels Separately: No De-Commissioning 40G

▪ Add: MPO male trunk, MPO panels, and MPO 100G patch cords (Note Gender)

▪ 100G Polarity Rule: One Type ‘B’ reversal, end to end

100G

Tx/Rx

100G


MPO 100G Female

Patch Cord

A-Polarity

100G MPO Male

Tx/Rx Receptacle

MPO Feed-Through

Adapter Panel

100G MPO Male

Tx/Rx Receptacle

MPO 100G Female

Patch Cord

B-Polarity

F F F FM M

40G to 100G Migration: Summary

Notes Regarding Migration to 100 GbE

▪ A 2-Connector channel is recommended due to channel loss budgets

▪ Consolidation Modules create a 4-connector channel – Not Recommended

▪ 100G cabling should be a native new installation, using OM4 fiber

➢ See “New Developments” for further evolution of this technology

100G

Tx/Rx

100G


MPO 100G Female

Patch Cord

100G MPO Male

Tx/Rx Receptacle

MPO Feed-Through

Adapter Panels

100G MPO Male

Tx/Rx Receptacle

MPO 100G Female

Patch Cord

F F F FM M

IEEE 802.3ba: Singlemode 40 Gb/s

40GBASE-LR4: Long Range Singlemode 40 Gb/s

▪ Optics: (4) WDM 10G wavelengths over a single lane (1 or 2 fibers)

▪ Transceivers: LC Duplex

▪ Utilizes conventional simplex or duplex cabling channel

▪ 40GBASE-LR4 Max operating distance: 10 km


40GBASE-ER4: Extended Range Singlemode 40 Gb/s



▪ Utilizes conventional simplex or duplex cabling channel

▪ 40GBASE-ER4 Max operating distance: 30 km

IEEE 802.3ba: Singlemode 40 Gb/s Cabling

IEEE 802.3ba: Singlemode 40G Cabling Model

▪ Simplex or duplex fiber channel

▪ Can migrate from legacy singlemode fiber plant

▪ IEEE 802.3ba power budgets apply

▪ Transceivers utilize conventional LC duplex

40GBASE-LR4/ER4 Singlemode Cabling Model


100GBASE-LR4 and 100GBASE-ER4


▪ Transceiver Interface: LC Duplex

▪ Max operating distance for 100GBASE-LR4: 10 km

▪ Max operating distance for 100GBASE-ER4: 30 km

IEEE 802.3ba: Singlemode 100 Gb/s Cabling

IEEE 802.3ba: Singlemode 100 Gb/s Cabling Model

▪ Full duplex transmission over a single or duplex fiber

▪ Same cabling model as 40GBASE-LR4/ER4

▪ Can migrate from legacy cabling plant

▪ Standard LC Transceiver interface

100GBASE-LR4/ER4 Singlemode Cabling Model

Fiber 40/100 Gb/s Singlemode Summary

Migration of Singlemode Cabling from 10 GbE to 40/100 Gb/s

▪ Legacy singlemode cabling can migrate from 10 Gb/s to 40/100 Gb/s

▪ Transceivers have a conventional LC duplex interface

▪ Cabling test parameters of IEEE 802.3ba apply

• Full Duplex over a single fiber

• Full Duplex over a pair of fibers

▪ See “New Developments” for Singlemode Advancements

IEEE 802.3bs: 400G Baseline (2018)

400GBASE-SR16 Lane Assignments

▪ Defined as (4) 100GBASE-SR4 Channels

▪ Total 32-fiber channel: 16 X 25G pairs

▪ Employs a new 32-fiber MPO connector – Two rows of 16 fibers

▪ Direct-connect or 2-connector MPO channel only

▪ Departure from standard MPO interface:

• Key shift off-center

32-Fiber MPO

Connector

Will this be adopted?

See “New Developments”

IEEE 802.3bs: Timeline for 400 Gb/s

Published Standard Anticipated in Q4, 2017

▪ 400GBASE-SR16 for OM3/OM4 multimode

▪ PSM4 Singlemode: 4 x 100G singlemode lanes

▪ NOTE: New Developments may impact adoption of 400GBASE-SR16 !!!

Part 2: New Developments, 2017 Update

▪ IEEE 802.3by: Introduction of 25Gb/s

▪ IEEE 802.3bm: Application of 25Gb/s to 40G and 100G Protocols

▪ Impact of 25Gb/s on “Legacy” Migration: 40G/100G/400G

▪ Non-IEEE 40G Singlemode Applications

▪ Emergence of Wide Band OM5 Multimode (WBMMF)

▪ IEEE 802.3cd Task Force – Future Applications

▪ Maintaining MPO 12-Fiber Infrastructure

▪ Conclusion

Introduction of 25 Gb/s: IEEE 802.3by

IEEE 802.3by: Introduction of 25GBASE-SR, June, 2016

▪ Basic Objectives:

▪ Increase 1-lane throughput from 10 Gb/s to 25 Gb/s

▪ Reduce energy consumption

▪ Preserve Ethernet protocols

▪ Support IEEE 802.3bm objectives

▪ Establish a cost-optimized path to 100GBASE-SR4

▪ Optics: 850 nm / 25 Gb/s full duplex over 2 fibers (1 lane)


▪ 25GBASE-SR Multimode channel distance limits:

• OM4: 100 meters

• OM3: 70 meters

New 100 Gb/s Standard: IEEE 802.3bm

IEEE 802.3bm: Evolution to 100GBASE-SR4, March, 2015

▪ Basic Objectives:

▪ Reduce 100GBASE-SR10 lane count from 10 to 4 lanes (20 to 8 fibers)

▪ Extend 40GBASE-ER4 to 40 km

▪ Further reduce energy consumption

▪ Preserve Ethernet protocols

▪ Facilitate migration from 40GBASE-SR4

▪ Optics: 850 nm 100G full duplex over 8 fibers ( 4 lanes)

▪ Transceivers: MPO 12-Fiber (multimode)

▪ 100GBASE-SR4: New multimode channel distance limits:

• OM4: 100 meters

• OM3: 70 meters

Impact of IEEE 802.3bm on 100G Migration

Lanes Reduced to 12-Fiber MPO Channel

▪ Enables 40G and 100G operation over legacy 12-fiber MPO channel

▪ Supersedes “Legacy” 100GBASE-SR10

▪ Eliminates 24-fiber MPO connectors for 100G

▪ Migration simplified to MPO polarity and gender management

40G

Or

100G

Tx/Rx

40G

Or

100G

Tx/Rx

12 Fiber MPO Trunk

MPO 12-Fiber

Patch Cord

A-Polarity

MPO Male

Receptacle

MPO Feed-Through

Adapter Panel

MPO Male

Receptacle

MPO 12 Fiber

Patch Cord

B-Polarity

F F F FM M

IEEE 802.3bm: Singlemode 40 Gb/s

40GBASE-ER4: Extended Range Singlemode 40 Gb/s

▪ Objective: Extend 40GBASE-ER4 from 30 km to 40 km

▪ Optics: 4 x 25G WDM wavelengths over 2 fibers (1 lane), full duplex


▪ New singlemode channel distance: 40 km

Non-IEEE Singlemode 100 Gb/s Apps

100GBASE-PSM4: Parallel Singlemode 4-Lane

▪ Objectives: Longer 100G reach, reduce cable cost and congestion

▪ Optics: 4 x 25G lanes (8 fibers), 1310 nm full duplex

▪ Supported Transceivers: MPO 12-fiber APC

▪ Channel Distance: 500 m

▪ Application: Data Center interconnect

100G PSM4 Lane Assignments

1 2 3 4 4 3 2 1


100G-CWDM4 MSA: Coarse Wavelength Division Multiplexing

▪ Objectives: Longer 100G reach, reduce cable cost and congestion

▪ Multi-Source Agreement (MSA): Compatibility across vendors

▪ Optics: 4 x 25G CWDM lanes over 2 fibers (1 lane)

▪ Supported Transceivers: LC Duplex

▪ Channel Distance: 2 km

▪ Application: Extended Data Center interconnect


100G-CWDM4 OCP: Coarse Wavelength Division Multiplexing

▪ Objectives: Lower cable cost, extended 100G reach, reduced congestion

▪ Open Compute Platform (OCP): Compatibility across vendors

▪ Optics: 4 x 25G CWDM lanes over 2 fibers (1 lane)

▪ Supported Transceivers: LC Duplex

▪ Channel Distance: 500 m

▪ Application: Data Center interconnect

Emergence of Wide Band Multimode Fiber

WBMMF: Ratified by the Telecommunications Industry Association

▪ TIA-492-AAAE: Published in June, 2016

▪ Supports low cost wavelengths from 850 nm to 950 nm range

▪ Application: Multiplexing 4 x CWDM short wavelengths

▪ Backward compatible with OM3 and OM4 multimode

▪ Official ISO/IEC 11801 Designation: OM5

Emergence of OM5 WBMMF

Future Objective: 100 Gb/s Through One Pair of MM Fibers

Non-IEEE Emerging OM5 Applications

▪ 100GBASE-SWDM4 (4 x 25G SWDM wavelengths)

▪ 200GBASE-SWDM4 (4 x 50G SWDM wavelengths)

▪ SWDM Wavelengths: 850 nm, 880 nm, 910 nm, 940 nm

▪ Full duplex over 1 WBMMF lane (2 fibers)

▪ Future Transceivers: LC Duplex, SWDM


Advantages of OM5 WBMMF Using SWDM Technology

▪ Achieves maximum throughput per single MM fiber

▪ Reduces 100GBASE-SR4 lane count to 1 lane (2 fibers)

▪ Supports 100G over a single pair (4 x 25G SWDM)

▪ Enables future multiplexing schemes

▪ Longer reach than OM4 for 100GBASE-SR4

▪ 150 m vs. 100 m


Disadvantages of OM5 WBMMF Using SWDM Technology

Compared to 100GBASE-SR4 over OM4 MMF:

▪ More costly than OM4 cabling (Up to 50% added cost)

▪ SWDM transceivers also 50% more costly

▪ SWDM not being considered by IEEE for next-gen MM app’s

▪ 100G SWDM cannot break out to individual 25G channels

▪ Singlemode solutions are less costly and supported by IEEE

▪ IEEE 802.3cd task force not considering OM5 or SWDM

▪ Migration from OM3/OM4 cabling not supported

IEEE 802.3cd Task Force - Future

Objectives for Future 50G/100G/200G IEEE Applications

50 Gb/s: Single Lane (2 fibers)

▪ OM4 Multimode: 100 m

▪ Singlemode: 2 to 10 km

100 Gb/s

▪ OM4 Multimode: 100 m, 2 lane (4 fibers)

▪ Singlemode: 500 m, 1 lane (2 fibers, consistent with IEEE 802.3 bs)

200 Gb/s: 4 lane (8 fibers)

▪ OM4 Multimode: 100 m

Maintaining MPO Infrastructure

Contamination is the #1 Cause of Optical Network Failures

Good cleaning and inspection practices are critical

▪ Contamination will permanently damage polished fiber ends

▪ Avoid costly replacement of pre-terminated cabling

Airborne Accumulation Mating Dirty Connectors


Protecting Cable Infrastructure Investment

To extend the life of MPO cabling for future migration:

▪ Advanced cleaning practices are required

▪ Use recognized cleaning and inspection products

➢ RULE #1: “Clean and inspect before you connect”



Advanced cartridge cleaning instruments are available

▪ MPO male or female – connector or ports

▪ LC connectors or ports



Use advanced inspection devices

▪ Microscope for connectors

▪ Probe for blind ports

Conclusions

▪ Migration of MPO cabling evolves with new IEEE developments

▪ Increasing data rates to reduce fiber count remains a key IEEE objective

▪ Emergence of 25 gb/s has reduced MPO fiber count and cabling costs

▪ Migration to 100GBASE-SR4 can now utilize 12-fiber MPO cabling

▪ Current 100G standards impacted by 25GBASE-SR:

▪ 100GBASE-SR10: Can be replaced by 100GBASE-SR4

▪ 400GBASE-SR16: Will this change in Draft IEEE 802.3bs???

Conclusions

▪ OM5 WBMMF may not be supported due to costly cabling and SWDM

▪ Singlemode cabling in data centers will compete with OM5

▪ Risk with OM5: IEEE may not recognize SWDM in future standards

▪ Standards evolution continues with IEEE 802.3cd task force

▪ New 50G, 100G, 200G under development

▪ Maintenance and cleaning fiber infrastructure

▪ Increasingly important to preserve installed MPO connectivity

Thanks for Your Participation

Fiber in Data Centers...Standards Review •IEEE 802.3: Ethernet Fundamentals •TIA-568.3-D:...

Documents

Transcript of Fiber in Data Centers...Standards Review •IEEE 802.3: Ethernet Fundamentals •TIA-568.3-D:...