OMNInet: A Metropolitan 10Gb/s DWDM Photonic · PDF fileNORTEL NETWORKS CONFIDENTIAL 1...

26
NORTEL NETWORKS CONFIDENTIAL 1 OMNInet: A Metropolitan 10Gb/s DWDM Photonic Switched Network Trial April 13, 2004 Paul Daspit Advanced Technology Investments Group, Nortel Networks [email protected]

Transcript of OMNInet: A Metropolitan 10Gb/s DWDM Photonic · PDF fileNORTEL NETWORKS CONFIDENTIAL 1...

NORTEL NETWORKS CONFIDENTIAL 1

OMNInet: A Metropolitan 10Gb/s DWDM Photonic Switched Network Trial

April 13, 2004

Paul DaspitAdvanced Technology Investments Group, Nortel [email protected]

NORTEL NETWORKS CONFIDENTIAL 2

Agenda

• Rationale and Applications• Network Architecture• Photonic Switch Implementation• Control Plane• Results• Research Projects

NORTEL NETWORKS CONFIDENTIAL 3

Optical Metro Network Initiative

• Partnership– Nortel Networks

– SBC Communications

– International Corporation for Advanced Internet Research (iCAIR)/Northwestern University

• Experimental metropolitan photonic network field trial

• 10Gb/s Ethernet WAN and LAN service over a wavelength-granularity photonic switched network

• G.ASON, GMPLS Control Plane

NORTEL NETWORKS CONFIDENTIAL 4

• Enhanced metro photonic services• O-VPNs• Dial-a-lambda service• Router by-pass

• Emerging applications• Optical GRIDs• Storage on demand• Data Mining • 3D teleconferencing• Visualization• Large-Science Apps

Services and Applications

3D Virtual Museum3D Multi-media

Virtual Design

presentation name NORTEL NETWORKS CONFIDENTIAL PG 5

Site SSite L

Site T

12.3 km7.6 km

24.8 km7.2 km

24.6 km7.4 km

= Glass-Thru Central Office

Starlight PhotonicLabs

Site F

CA*Net 3

Network Configuration

• 4 sites in Chicago• 6 fiber spans • 4 wavelength planes• Partial mesh network

Visualization LabData Mining Lab

NORTEL NETWORKS CONFIDENTIAL 6

OMNInet Network Configuration-2004

10 GigE10 GigE

Photonic Node

Photonic Node

Photonic Node

10/100/GigE

10/100/GigE

10/100/GigE

10/100/GigE

10 GigEOptera5200

10Gb/sTSPR

Photonic Node

λ4

PP8600

10 GigEPP

8600

PP8600

2

3

4

1

λλλ

λ

λλ

λ2

3

1

Optera5200

10Gb/sTSPR

10 GigE10 GigE

Optera5200

10Gb/sTSPR

2

3

4

1

λλλ

λ

Optera5200

10Gb/sTSPR

2

3

4

1

λλλ

λ

1310 nm 10 GigEWAN PHY interfaces

10 GigE10 GigE

PP8600

SBC Fiber

KM MI[1*] 35.3 22.0[2] 10.3 6.4[3*] 12.4 7.7[4] 7.2 4.5[5] 24.1 15.0[6] 24.1 15.0[7*] 24.9 15.5[8] 6.7 4.2[9] 5.3 3.3[10]

NWUEN Link

Span Length

* not in use

…CAMPUSFIBER (16)

EVL/UICOM5200

LAC/UICOM5200

CAMPUSFIBER (4)

INITIALCONFIG:10 LAMBDA(all GigE)

StarLight / Lakeshore

Interconnectwith otherresearchnetworks

10GE LAN PHY (Apr 04)

• 8x8x8λ Scalable photonic switch• Trunk side – 10G DWDM

• OFA on all trunks

TECH/NU-EOM5200

CAMPUSFIBER (4)

INITIALCONFIG:10 LAMBDAS(ALL GigE)

Optera Metro 5200 OFA

[1*]

[5]

[6][2]

[3*]

[4][8] [9]

[7*]

Fiber in useFiber not in use

5200 OFA

5200 OFA

Optera 5200 OFA

5200 OFA

[10]

presentation name NORTEL NETWORKS CONFIDENTIAL PG 7

Fiber Infrastructure

• SBC metro G.652/SMF-28 single mode fiber• “Next pair” selected from installed fiber plant• Longest span ~25km• 2 to 5 Glass thru per span

• Span losses from 6dB to 13dB (1550nm)• 0.5dB/km to 1.2dB/km

• Characterization tests• ORL, PMD, CD, OTDR

presentation name NORTEL NETWORKS CONFIDENTIAL PG 8

• C-band ITU-T grid 200GHz spacing• 4 wavelengths installed in the test bed:

1550.92 nm 1552.52 nm1547.72 nm 1549.32 nm

• Switch supports 8 wavelengths • Per-wavelength power grooming enabled a mix of

high and low performance TRx (FEC, Modulator Driver…)

• 24 possible light paths on each wavelength plane: 96 total

• Longest lightpath ~75 km

DWDM Lightpaths

NORTEL NETWORKS CONFIDENTIAL 9

Optical Link Impairments

• Electrical crosstalk• Receiver noise• Timing jitter• Electric• Sensitivity

• Fiber Losses• Chromatic dispersion • Back reflections• Polarization mode dispersion• Nonlinear effects

Tx Rx

• Optical power tolerance• Modulator chirp• Laser wavelength stability• Laser relative intensity noise• Electrical cross-talk• Extinction ratio• Back reflection effects• Timing jitter

• Losses • Optical amplifier effects on OSNR• Amplifier Transient• DWDM filter shape• Optical crosstalk • Back reflections• Polarization-dependent loss

Built IntoTransmission Margin

Actively Controlled

presentation name NORTEL NETWORKS CONFIDENTIAL PG 10

• Link budget is deterministic and computed to work in all 24 network configuration.

• Link loss diversity 6dB to 13dB• Node loss diversity 6dB to 10dB• Commercial optical amplifiers

• pre-amp and/or post-amp configurations• 23dB constant-gain

• Minimum OSNR• 32dB for LAN interfaces (experimental hardware)• 24dB for WAN interfaces (product hardware)

• FEC RS(255, 239) implemented on WAN wavelengths• Dispersion compensated on longest span (chirpy

EML on experimental hardware)

Link Budget

NORTEL NETWORKS CONFIDENTIAL 11

Transmitter ID•Power monitoring and signal tagging system implemented.

•Transmitter signal tagged with unique 100kHz - 400kHz AM tone.

•Tone sensing using simple photo-detection circuits andDSP-based analyzer.

•Tone power proportional to the optical power.

•Used to sense power and ID both muxed and single wavelength fibers.

•0.1dB precision, 0.5dB accuracy.

Tone Modulation on data carrier (Exaggerated).

NORTEL NETWORKS CONFIDENTIAL 12

Node Configuration.

Client interfaces:

•10/100•Gigabit Ethernet

λ1

λ2

λ3

λ4

Inter-Node Fibers

PP8600SwitchRouter

λ

10 Gb/sTransponder

1310nmWAN

1310nmWAN

EDFA

10 Gb/sTransponder

LANLAN

OPTeraMetro 5200

Opetra Metro 520010 Gb/s Transponder

Photonic Switch Node• OPM & VOA• 2-D MEMs switch

• λ mux/demux• OFA

Passport 8600 Ethernet Switch/Router(Commercial and Experimental Interfaces)

Monitors

Metro Amplifiers

ITU-TC-bandwaves

NORTEL NETWORKS CONFIDENTIAL 13

Site InstallationMosaic of node at Site F

Passport 8600 OPTera 5200 Transponder

10GE LAN Blades10GE WAN Blade

OPTera 5200 Optical Amplifier

Photonic Switch Node Controller and DSP

PhotonicSwitch Node

Overlay Management Network hub/switch

Power Inverter

NORTEL NETWORKS CONFIDENTIAL 14

λ1-2

λ3-4

λ5-6

λ7-8

From Ethernet Switch / OTR

#1 Tributary Line Card

+Monitor

λ1-2

λ3-4

λ5-6

λ7-8

From Inter-NodeFiber

#8 TrunkLine

Cards

Fiber ShufflesOptical Backplanes

λ 5-6

λ 7-8

λ1-2

λ3-4

λ5-6

λ7-8

To Ethernet Switch / OTR

#1Tributary Line Card

+Monitor

ToInter-NodeFiber

INPUTS OUTPUTS

λ 3-4

λ 1-2

2x 8X8 Switch Fabric

VOA

λ1-2

λ3-4

λ5-6

λ7-8

#8TrunkLine

Cards

Photonic Switch Architecture• Wavelength plane architecture can connect any input signal of aspecific wavelength to any output without wavelength translation. • Could switch 8 instances of 8 wavelengths. • Larger Photonic Switch Node 640 x 640 wavelengths using the same architecture was developed.• Much more efficient switch architectures are subject of multiple patent applications

NORTEL NETWORKS CONFIDENTIAL 15

Node LNode T Node S

Node F

Network Optical Link(Data Plane)

Photonic Switch

TCP/IP connectivity(Control Plane)

(Routing Card)

O-UNI-NWRP WDP

OLMPPSCP

Management orUser Workstation

Access Optical Link

Optical Service Client(or CPE)

ProxyO-UNI-CServer

I-NNI

UNI Service I/FO-UNI-C

G.ASTN Control Plane with O-UNI

UNI control interface

NORTEL NETWORKS CONFIDENTIAL 16

OMNInet Control Plane: Protocols & Interfaces

• System configuration/maintenance— Consolidated optical link/interface

configuration — Support on-line static/dynamic

link/interface provisioning— Module start/stop, memory and

resource management— Configuration data storage

• Wavelength Routing Protocol (WRP)— Optical topology discovery and

inventory of physical link resource— New path selection/optimization

algorithm to support traffic engineering and constraint-based routing

— O-UNI interworking & control integration

— Integrated path selection and protection/restoration with WDP

— O-VPN support

• Wavelength Distribution Protocol (WDP)— End-to-End, on-demand light path signaling

for I-NNI— Bi-directional LSP— Optical Connection Admission Control (CAC)— Generalized label and wavelength label set— 1:1 & 1:N Light path restoration

• Optical Link Management Protocol (OLMP)— Control channel monitoring— TE link resource management— Optical link fault isolation— Verify dark fiber connectivity

• O-UNI server— Client register/de-register— TNA address resolution— VPN group auto discovery— On-demand light path creation/deletion— Light path status enquiry

presentation name NORTEL NETWORKS CONFIDENTIAL PG 17

• Network has been operating since 2001• Most lightpaths have less than 10 packets lost per

million (Measurement limited)• Stressed lightpath 50 packets lost per million (~10-10

BER) • More than 1000 lightpath setup/teardown operations• No optical component failures

Results

Site SSite L3

Site T

12.34 km7.60 km

24.75 km7.20 km

24.57 km7.37 km

StarLight PhotonicLabs

Site F

CA*Net 3

IXIA

Tester

~75km path

Visualization LabData Mining Lab

presentation name NORTEL NETWORKS CONFIDENTIAL PG 18

• Technology field trial• Photonic switched network• Highly managed photonic layer• Scalable photonic switch architecture• Standards-based control plane• For bandwidth intensive applications

• Network continues to operate as infrastructure for content networking research (DARPA DWDM-RAM project)

Summary

NORTEL NETWORKS CONFIDENTIAL 19

References to experiments using OMNInet

• Photonic TeraStream demonstration over OMNInet– http://www.startap.net/starlight/igrid2002/photonicTeraStream02.html

• A Case for the Global Access to Large Distributed Data Sets using Data Webs Employing Photonic Data Services

– http://storageconference.org/2003/papers/08_Grossman-Case.pdf• Distributed Optical Testbed (OMNInet provides one leg of the DOT)

– http://www.dotresearch.org/about.html• SABUL experiments over OMNInet

– http://www.rgrossman.com/pdf/sabul-hpdtp-11-02.pdf• Northwestern University Information Technology Annual Report - 2002

(pp14 & 17 refers)– http://www.it.northwestern.edu/AR02/report.pdf

• FAST TCP Experiments (see last 4-5 charts for OMNInet reference)– FAST v3

NORTEL NETWORKS CONFIDENTIAL 20

DWDMRAM

DWDMRAM

Data@LIGHTspeed

NORTEL NETWORKS CONFIDENTIAL 21

DWDM-RAM

• DARPA funded research project• Architecture for data-intensive services

– Manage extremely large sets of distributed data– Dynamic on-demand light path and “e-path” provisioning– Network resource scheduling

• Demonstrations– GGF9 (Chicago, Oct 2003)– SC2003 (Phoenix, Nov 2003)– Chicago, Jun 2004 (SUPERComm)

• Current research/experiment activity: • Multiple sequential service requests• File transfer performance measurements and metrics• Other transport protocols

NORTEL NETWORKS CONFIDENTIAL 22

Data Transmission Plane

Connection Control

Data storageswitch Data

Center

λ1

λn

λ1

λn

DataPath

DataCenter

Applications

Optical ControlPlane

Data Path Control

Data TransferScheduler

StorageResource

Service

Dynamic Optical Network

Basic NetworkResource

Service

OtherServices

ProcessingResource

Service

NetworkResource Scheduler

Basic Data Transfer Service

Data Transfer Service

Network Transfer Service

External Services

NORTEL NETWORKS CONFIDENTIAL 23

Chicago

OMNInet Tetsbed Node Locations

NORTEL NETWORKS CONFIDENTIAL 24

End-to-end Transfer time(Not Optimized)

ODIN Server Processing

File transfer complete, path released

File transfer request arrives

Request Path Deallocation

Data Transfer(10 GB)

Path ID returned

ODIN Server ProcessingPath Allocation request

Network reconfiguration

FTP setup

Path setup: ~48.7sData Transfer (10GB): ~464sPath Teardown: ~ 11.3s

0.5s 2.6s 0.5s 464s 0.3s 11s45s 0.14s

presentation name NORTEL NETWORKS CONFIDENTIAL PG 25

NORTEL NETWORKS CONFIDENTIAL 26

DWDMRAM

DWDMRAM

Data@LIGHTspeed