Enabling 400G Networking with 56G Ethernet PHY IP€¦ · Rita Horner. April 9, 2019. D&R IP SoC...

21
Rita Horner April 9, 2019 D&R IP SoC Days Enabling 400G Networking with 56G Ethernet PHY IP

Transcript of Enabling 400G Networking with 56G Ethernet PHY IP€¦ · Rita Horner. April 9, 2019. D&R IP SoC...

Page 1: Enabling 400G Networking with 56G Ethernet PHY IP€¦ · Rita Horner. April 9, 2019. D&R IP SoC Days. Enabling 400G Networking with 56G Ethernet PHY IP

Rita HornerApril 9, 2019

D&R IP SoC DaysEnabling 400G Networking with 56G Ethernet PHY IP

Page 2: Enabling 400G Networking with 56G Ethernet PHY IP€¦ · Rita Horner. April 9, 2019. D&R IP SoC Days. Enabling 400G Networking with 56G Ethernet PHY IP

© 2019 Synopsys, Inc. 2

Agenda

• Next-Generation Data Centers• Multi-Level Modulation • 56G Ethernet PHY• High-Speed Ethernet PHY Integration

Page 3: Enabling 400G Networking with 56G Ethernet PHY IP€¦ · Rita Horner. April 9, 2019. D&R IP SoC Days. Enabling 400G Networking with 56G Ethernet PHY IP

© 2019 Synopsys, Inc. 3

Flexible &

cost effectiveScalability

Enterprise Growth Hyperscale Data Center

• Horizontal Scaling (a.k.a. scaling out)– Additional processing & storage– Larger housing area– Increased IT management &

cooling cost

• Vertical Scaling (a.k.a. scaling up)– Upgraded hardware – Potential availability constraints– More expensive equipment– Ease of control

Data Center

spee

d

# Systems

Page 4: Enabling 400G Networking with 56G Ethernet PHY IP€¦ · Rita Horner. April 9, 2019. D&R IP SoC Days. Enabling 400G Networking with 56G Ethernet PHY IP

© 2019 Synopsys, Inc. 4

Facebook Hyperscale Data Center1.5 Million Square Feet on a 325 Acres (Virginia, US)

Page 5: Enabling 400G Networking with 56G Ethernet PHY IP€¦ · Rita Horner. April 9, 2019. D&R IP SoC Days. Enabling 400G Networking with 56G Ethernet PHY IP

© 2019 Synopsys, Inc. 5

Hyperscale Data Center 100GE InterconnectsIntra-Rack, Inter-Rack, Co-Location & Regional

Building 1DC1

DC2 DC3DC4

DC5

DC6

100G Regional50G / 100G Colocation25G / 50G / 100G Inter-rack25G Intra-rack

Spine Switch

Leaf Switch

Leaf Switches

Page 6: Enabling 400G Networking with 56G Ethernet PHY IP€¦ · Rita Horner. April 9, 2019. D&R IP SoC Days. Enabling 400G Networking with 56G Ethernet PHY IP

© 2019 Synopsys, Inc. 6

Hyperscale Data Center 400GE InterconnectsIntra-Rack, Inter-Rack, Co-Location & Regional

Building 1DC1

DC2 DC3DC4

DC5

DC6

400G Regional200G / 400G Colocation100G / 200G / 400G Inter-rack50G Intra-rack

Page 7: Enabling 400G Networking with 56G Ethernet PHY IP€¦ · Rita Horner. April 9, 2019. D&R IP SoC Days. Enabling 400G Networking with 56G Ethernet PHY IP

© 2019 Synopsys, Inc. 7

Agenda

• Next-Generation Data Centers• Multi-Level Modulation • 56G Ethernet PHY• High-Speed Ethernet PHY Integration

Page 8: Enabling 400G Networking with 56G Ethernet PHY IP€¦ · Rita Horner. April 9, 2019. D&R IP SoC Days. Enabling 400G Networking with 56G Ethernet PHY IP

© 2019 Synopsys, Inc. 8

Multi-Level Signaling vs. Binary ModulationPAM-4 (4-Level Pulse Amplitude Modulation) vs. NRZ (Non Return to Zero)

PAM-4

NRZ #1

0

1

00 0

1

NRZ #2

10 0 0

11 1

1 1

0

1

2

3

000=0

01=1

11=2

10=3

11=2

00=0

AmplitudeLevels

Symbol

1/3

1

Page 9: Enabling 400G Networking with 56G Ethernet PHY IP€¦ · Rita Horner. April 9, 2019. D&R IP SoC Days. Enabling 400G Networking with 56G Ethernet PHY IP

© 2019 Synopsys, Inc. 9

• Additional voltage levels reduce the eye height by a factor of 3 in PAM-4– Signal-to-noise ratio (SNR) degrades

• TX output eye width 1/2 to 2/3 of NRZ– Middle eye is the most symmetrical

– Top and bottom eyes do not match the middle eye

• Impairments impact each eye differently • Nonlinearity can significantly impact bit error rate• Crosstalk and reflection have greater signal

degradation impact

PAM-4 vs. NRZChannel Impairment Impact NRZ

PAM-4

1/3

V0

V1

V0

V1

V2

V3

Page 10: Enabling 400G Networking with 56G Ethernet PHY IP€¦ · Rita Horner. April 9, 2019. D&R IP SoC Days. Enabling 400G Networking with 56G Ethernet PHY IP

© 2019 Synopsys, Inc. 10

Frequency (GHz)0 2.0 4.0 6.0 8.0 10.0 12.0 14.0 16.0 18.0 20.0 22.0 24.0 26.0 28.0 30.0 32.0 34.0 36.0 38.0 40.0 42.0 44.0 46.0 48.0

0

-10

-20

-30

-40

-50

-60

-70

-80

-90

-100

-110

Inse

rtio

n Lo

ss (d

B)

Shift From NRZ To PAM-4

56G NRZ- 62dB @ 28.0GHz

56G PAM-4- 33.35dB @14.0GHz13.28

50GBASE-KR Channel Insertion loss

Page 11: Enabling 400G Networking with 56G Ethernet PHY IP€¦ · Rita Horner. April 9, 2019. D&R IP SoC Days. Enabling 400G Networking with 56G Ethernet PHY IP

© 2019 Synopsys, Inc. 11

Data Center Interconnects @ 100GE

As speeds go up, technology requirements migrate down, and channels shrinkChannel Length, Media, Loss, Width (x4)

400GE (x8)

Connection Area Medium Type 100GE (25G / 50G / 100G)

400GE(50 G / 10G / 200G / 400G)

Regions (Data center-to-data center)

Optical

40km SMF 10km SMF

Colocation(Building-to-building) 10km SMF 2km SMF

Room-to-room 100m MMF 500m SMF

Intra-rack(Rack-to-rack) 30m AOC, MMF 30m AOC, MMF

Inter-rack (within the rack) Copper -- cable 5m DAC, Twin-axial 3m DAC, Twin-axial

Intra-server CopperPCB/mezzanine/backplanes 35dB @12.89GHz 30dB @13.28125GHz

Single Mode Fiber (SMF), Multi Mode Fiber (MMF), Active Optical Cable (AOC), Direct Attached Cable (DAC)

Page 12: Enabling 400G Networking with 56G Ethernet PHY IP€¦ · Rita Horner. April 9, 2019. D&R IP SoC Days. Enabling 400G Networking with 56G Ethernet PHY IP

© 2019 Synopsys, Inc. 12

Agenda

• Next-Generation Data Centers• Multi-Level Modulation • 56G Ethernet PHY• High-Speed Ethernet PHY Integration

Page 13: Enabling 400G Networking with 56G Ethernet PHY IP€¦ · Rita Horner. April 9, 2019. D&R IP SoC Days. Enabling 400G Networking with 56G Ethernet PHY IP

© 2019 Synopsys, Inc. 13

Major Types of PAM-4 DesignsAnalog vs. Digital Receiver Architecture

DFECTLE+VGA Analog FFE

CTLE+VGA ADCAnalog FFE

DSP(FFE+DFE)

Analog Receiver

Digital Receiver

• Similar to NRZ receiver design• PVT variation concern• Technology scalability• DFE taps (area + power)• Ideal for short channels• Power advantage

• Complex architecture• Flexibility in process scaling• More capable signal processing

techniques• Ideal for broad range of channels• Power disadvantage

Page 14: Enabling 400G Networking with 56G Ethernet PHY IP€¦ · Rita Horner. April 9, 2019. D&R IP SoC Days. Enabling 400G Networking with 56G Ethernet PHY IP

© 2019 Synopsys, Inc. 14

IEEE802.3 Standards for Single & Multiple Channel802.3bs (200G & 400G) & 802.3cd (50G, 100G, 200G, 400G) @ 53.125 Gbps

Single & aggregated link rates of up to 400 Gbps

Specifications Description

50GAUI-1100GAUI-2200GAUI-4400GAUI-8

Chip-to-chip &

Chip-to-module

50GBASE-CR100GBASE-CR2200GBASE-CR4

1-, 2- or 4-lane shielded balanced Twinaxial copper cabling (CR) , 2 m & 3 m

50GBASE-KR100GBASE-KR2200GBASE-KR4

1-, 2- or 4-lane Electrical backplane (KR)

Chip Chip

Chip Module

Chip Chip

Chip Chip

Page 15: Enabling 400G Networking with 56G Ethernet PHY IP€¦ · Rita Horner. April 9, 2019. D&R IP SoC Days. Enabling 400G Networking with 56G Ethernet PHY IP

© 2019 Synopsys, Inc. 15

For Next-Generation 400G Hyperscale Data CentersDesignWare 56G Ethernet PHY IP

NRZ Eye @10.3125 Gbps

PAM-4 Eye @ 53.125 Gbps

DUT

Tx Test Set-up

DUTISIChannel

Rx Backplane Set-up

ISIChannel

SFP28MCB

Copper(DAC)

DUT

Rx C2M & C2C Set-up

IEEE 802.3cd Electrical Compliance

Page 16: Enabling 400G Networking with 56G Ethernet PHY IP€¦ · Rita Horner. April 9, 2019. D&R IP SoC Days. Enabling 400G Networking with 56G Ethernet PHY IP

© 2019 Synopsys, Inc. 16

Agenda

• Next-Generation Data Centers• Multi-Level Modulation • 56G Ethernet PHY• High-Speed Ethernet PHY Integration

Page 17: Enabling 400G Networking with 56G Ethernet PHY IP€¦ · Rita Horner. April 9, 2019. D&R IP SoC Days. Enabling 400G Networking with 56G Ethernet PHY IP

© 2019 Synopsys, Inc. 17

DesignWare 56G PHY Integration

Placement Floor Plan Hierarchy Bumps

Nor

th-S

outh

(N/S

)Ea

st-W

est (

E/W

)

Page 18: Enabling 400G Networking with 56G Ethernet PHY IP€¦ · Rita Horner. April 9, 2019. D&R IP SoC Days. Enabling 400G Networking with 56G Ethernet PHY IP

© 2019 Synopsys, Inc. 18

DesignWare 56G PHY Package StudyEscape Route & Substrate Routing

Page 19: Enabling 400G Networking with 56G Ethernet PHY IP€¦ · Rita Horner. April 9, 2019. D&R IP SoC Days. Enabling 400G Networking with 56G Ethernet PHY IP

© 2019 Synopsys, Inc. 19

DesignWare 56G PHY IBIS-AMI Models

• Model elements to match architecture & implementation (including adaptation algorithms)

• Model tuned with information from hardware characterization data

• Correlated with silicon characterization for accurate analysis

• Verify models with different AMI simulators - Keysight-ADS, SiSoft-QCD and HSPICE

Silicon Correlated Models for Accurate SI Analysis

Measured

Page 20: Enabling 400G Networking with 56G Ethernet PHY IP€¦ · Rita Horner. April 9, 2019. D&R IP SoC Days. Enabling 400G Networking with 56G Ethernet PHY IP

© 2019 Synopsys, Inc. 20

• Available in advanced process technologies (16-nm to 7-nm FinFET)

• Supports all OIF & IEEE 802.3 Ethernet-based channel types

– Backplane, copper cables (DAC) and optical links

– Backward compatible with NRZ data rates

• Delivers high performance, >35dB @ 14GHz PAM-4 Nyquist

• Digital (AFE + ADC + DSP) based receiver with power-performance knobs

• Robust performance over Voltage & Temperature (VT) corners

• Scalable architecture to 112 Gbps

For Next-Generation 400G Hyperscale Data CentersDesignWare 56G Ethernet PHY IP

Page 21: Enabling 400G Networking with 56G Ethernet PHY IP€¦ · Rita Horner. April 9, 2019. D&R IP SoC Days. Enabling 400G Networking with 56G Ethernet PHY IP

Thank YouSynopsys.com/ethernet