Rob.Vietzke@uconn.eduConnecticut Education Network

University of ConnecticutNEREN

The Current State and Future of Advanced Optical Networks

July 20, 2004

Agenda

Current State of the Optic Networking Metro Regional

New Approaches & Hype Broken Reasoning Community Directions

Distance scales for U.S. R&E optical networking

Distance scale (km)

Examples Equipment

Metro < 60 UWash

USC/ISI(LA),MAX(DC/MD/VA)

Dark fiber & end terminals

(cwdm, routers,

pluggables)

State/Regional < 500

I-WIRE (IL),I-LIGHT (IN),

NEREN

OpticalAmplifiers, filters, etc.

ExtendedRegional/National

> 500TeraGrid

2nd Gen Abilene, NLR

Add OEOregenerators

& O&M $’s

CT Ed Net “Metro” Experience

Over 1,200 miles of SMF-28 fiber deployed across Connecticut 160 dark fiber connected K12, Higher Ed sites All edge sites are GigE

Higher Eds homed to 2 core sitesUp to 4 K12’s daisy chained between

pair of core sitesSome CWDM for metro higher ed ringsConsidering 10G/1G CWDM combo links

CEN Leased Dark Fiber Network

Bristol

New Britain

Newington

14.1 m

Waterbury

Cheshire

N.Haven

Naugatuck

Derby

400 State St

W. Haven

Milford

9.1 m

3.5 m

8.5 m

8.2 m

5.6 m

4.6 m

26.4 m

9.9 m

4.9 m

5.9 m

10.6 m

Middletown

12.0 m

Meriden

Wallingford

East Haven

3.5

7.2m

2.2m

1.3m

.6

.2

RING TWO

E. Hartford

Farmington

Simsbury

Bloomfield

Wethersfield

12.7 m

9.1 m

5.6 m10

11

12

NaugatuckHigh

SheltonHigh

Milford BOE

West Haven HS

New Haven

HamdenHigh

Gateway CCNorth Haven

Sheehan HS Wallingford

CheshireTown Hall

Meriden Town Hall

Seymour HS

Derby High

14.1 m

Gateway CC

.61.9

New BritainSlade Middle

.7

4

2.9m

1.1m

.6

Albertus

ACES

6

Yale

Trumbull

Wilton

New Canaan

Stamford

Bridgeport

FairfieldWestport

Norwalk

Stamford

22 m

5.8 m

3.8m 6.2 m

5.5 m

3.7 m

.4 m

4.7 m6.6 m

6.0 m

.6 m

.4 m

1.4 m

10.6 m2.2m

.6 m

Windsor

7.1 m

6.6 m

5.6 m

13.3 m

10.6 m5.6 m

Windsor

Enfield

Enfield

Rockville

Manchester

Glastonbury

Wilton High

School

BPT03

UConn Waterbury

JF KantorVT

South Windsor

Plainville

3 m

3500 ft

Simsbury

BloomfieldC Arce Middle

WindsorHigh

School

2700

Windsor Locks

Enfield

3090

Ellington Middle School

RockvilleHigh

School

1900

1.37

5.22

Manchester

1800

3.44m

3100Glastonbury

4844ft

4250ft

300 ft

Howell Cheney VT

Wethersfield

Rocky Hill High School

1.25 m

0Cromwell

Middle School

MeridenHC Wilcox VT

4.43

2,577 ft

Pratt VT3421

StratfordBOE

1100

Bullard VT

Harding High

Hous. CC

U Bridgeport

Fairfield Board of Ed

Fairfield U

1.34 m

3,741 ft

0

Westport Town Hall

Gibbs College

Norwalk BOE

3,980 ft300 ft

0 ft

Darien BOE

St. Basil College

Stamford

JM Wright Votech

44

4

4

4

4

4

4

4

4

36

Somers

4

Fire Training Academy

Troop C

2

2

2

CES Office

StVinc

Dept of Labor

2

79 Elm

165 Capitol

18 Trin

10Cltn

2

ECSU

10.3 m

NVCC

East Windsor

Stratford

4.8 m

Reg 8

Reg 1

Reg 14

Reg 16

Amity RegHS

Eli WhitneyVotech

Reg 5

Reg 5

Reg 1

Reg 1

Reg 8

Reg 4

Reg 4

Reg 7

Reg 7

Reg 9

Sacred Heart U

SEE HARTFORD AREA DETAIL

BELOW

Hartford

MRouter

Joel Barlow High

Redding

Danbury BOE

Henry Abbott VT

NewtownHigh

Nonewaug High

WoodburyNew Milford

WashingtonShepaug High

Dist 12

LitchfieldReg High

Ed Connection RESC

UConnTorrington

CantonCollinsville

Avon High School

Middlebury K-6

Prospect

East HavenHigh

North Haven High

WesleyanUniversity

Middletown High School

Asnuntuck

WindhamMiddle School

WindhamVT

Coventry

Tolland

Willington

BerlinTown Hall

Bristol

Briarwood College

MonroePS

TrumbullPS

MRouter

Old Saybrook

Old Lyme

Waterford

MRouter

Bethany

BristolVT

Lewis Mills 9-12Burlington

Torrington

WolcottVT

New HartfordReg 7

LEARNRESC

To MASS

Middlesex Meriden

MiddletownVinal VT

AnsoniaHS

U of NewHaven

Emmett Obrien VT

MRouter

Dept of Public Safety

Trooper HQ

MRouter

Mansfield

Wolcott

Mitchell College

Norwalk CC

New CanaanTown Hall

RowlandCenter

WaterburyBOE

Conn College

USCGA

New London Groton

GrassoVT

UConn Avery Point

8.3

2.14m

36

36

72

72

3.8

6.41

3.55

4600

2700

1.5m

1.5m

Qwest New

London

29421.2m

4.8m

1.720008.1m

3700

2.75

PlymouthTerryville

Thomaston

Watertown

Reg 11

MRouter

Reg 12

Reg 12

Teiko Post

Suffield 4.6 m

New Fairfield

Danbury High

Sherman

SCSU

Capitol410Cap

505 Huds

Arm

25 Sig

LOB

ManchesterCC

ASD

UHart

CTCCSU

UCLAW

UC HTFDSt

JOES

CCC/HPS

RENS

Tunxis CC

UConn HealthFarmington

High School

TunxisBristol

Trinity

MRouter

DOIT

NewingtonSchools

MRouter

CentralCT StateU

6

2

4

UConn Depot

UConn Storrs2436

2

2

2

2

2

2

2

2

2

2

2

2

2

2

2

36

36

36

3636

36

72

6

6

East Hartford HighHartford

CREC

Goodwin VT

East Lyme

BoltonAndover

Columbia

Hebron

Marlborough

Montville

BozrahNorwich

Franklin Sprague

MRouter

3.1m

OrangeAmity Jr

High

2.6m

BeaconFalls

SouthburyPomeraug

High - Dist 15

Troop A

Troop G

Greenwich

UConn Stamford

2,000 ft

Haddam Kinngworth

High

Durham CochinaugRegional

High

Middlefield Memorial School

1.9 m

3.7 m

3.1 m

3.1 m

Deep River

Chester

Essex

1.23 m

1.55m

500 ft

10.7 m

5.7 m14.4m

7.95 m

8.64

4.9m

5.29

5.92

5.146.03

9 m

Western Connecticut

MRouter

Hub SitesUse large count fiber

MRouter

MRouter

Qwest

Bethel High

School

Weston

Easton

NMS RegHigh

Harwinton

Current State: Metro Typical Scenarios for metro optics

Long Haul GBIC, SFP, XFP, or Xenpak Occasionally POS or ATM long haul on dark fiber

Integrated pluggable in router/switch Redundancy through Link State monitoring on multiple

paths and L3 routing Occasionally CWDM or even DWDM added

Almost no other statusing other than up/down of optical layer

Market leaders could do more … Make basic power telemetry available from pluggables Make cross-vendor pluggables usable Encourage higher-power affordable single-channel applications

By example 10G-ER+ to match 1G ZX

Current State: Metro CWDM Passive nature of OADM’s makes rings livable

for customer sites in non-C/O environments Dedicated, redundant GigE Paths from site Maintains link state to core Reasonable Cost / Performance

CWDM OADM packaging adds complexity No cost effective test gear/approach for CWDM

Complexity of cabling, patching, testing, cleaning can’t be overstated.

Still arguably a great, cheap, disruptive approach

CWDM OADM Options

CWDM GBIC & XenPack-EROne Fiber Pair

LAMBDA XXXX OADMEast

RouterRouterRouterRouter

Xenpak-ERWestWest EastEast

East 1470nmEast 1470nmWest 1470nmWest 1470nm

NotUsed

Xenpak-ERWestWest EastEast

East 1470nmEast 1470nmWest 1470nmWest 1470nm

NotUsed

CWDM-MUX-AD-1470CWDM-MUX-AD-1470 CWDM-MUX-AD-1470CWDM-MUX-AD-1470

Site A Site B

2 λ1x GE

1x 10GE

1470 GBIC 1470 GBIC

Current State: Regional3rd Generation DWDM Systems

Market competitors moving very much in step with one another

Planning tools Power Management ROADM (Reconfigurable Add/Drop Mux) Other Evolutions

Dynamic Optical power management across systems, paths, channels, bands

Very manual OADM approaches Disruptive insertion and balancing Lots of patch cords within systems & even shelves?? Highly touted ROADM typically works with limited

wavelength windows on transponders & mux-ponders

Current State: Regional3rd Gen DWDM (Cont’d)

More Flexible transponders and muxponders Larger agile frequency range for optical output Larger variety of interfaces and better stuffing of 2.5G and 10G

wrappers Device Management

Increasingly good telemetry and monitoring of optic power, bit error rate, etc.

May need to know TL-1 or CORBA Always check on XML & SNMP options? A whole new OSS to learn and support in many cases

Very Much an analog world Dispersion, loss, balancing, planning more about gain structure

than bits. Still wonder if a good sound engineer or a physicist would

understands these things better than a bit head

DWDM OADM Site Block Diagram

Current State: Regional

Analog World 99% of designs are fundamentally

about how much “noise” can you allow to grow in a system before you won’t be able to see bits anymore and therefore need to regenerate

Faster bit rates are harder to distinguish at shorter distances than slower bit rates

Disruptive Thought? OEO everywhere

O-E-O

O-E-O

O-E-O

O-E-O

O-E-O

O-E-O

O-E-O

O-E-O

• Maximize distance between expensive transponders, muxes, etc• Reduce “noise” by reducing OADM’s, amps, etc wherever possible• Aggregate analog PM data, have some fault isolation capability

An

alo

g-O

pti

cal

Sys

tem

s

• Regenerate every analog wavelength at every site, make noise problems so far beyond span specs as to become irrelevant • Leverage E in OEO to create electrical add-drop fabric at each site

Dig

ital

Op

tica

lN

etw

ork

That’s fine, but what would Next Generation Equipment that you wanted look like?

Needs & Future Directions Agile Amplification & Dispersion Approach

Not visit dependant as channel loading increases or fiber ages

Not even to patch an agile transponder in to the right ROADM port

Interruption-free upgrades/changes Initially affordable & predictable scalability Allow multi-point exchange of lambdas

Not just rings! Spurs & Aliens necessary Support RON interconnection

Good growth cost curve (>? Distruptive ?)

Observations We’re spending lots of dollars on separate software licenses, maintenance contracts and O&M systems for optical and L3+ services Telemetry still lousy for the large enterprise Am I running a digital optical network or a broadband CATV system Composite Triple Beat, Carrier to Noise Ratio,

Harmonics, Composite Second Order, etc. all things I remember from balancing amplifier cascades. (Telemetry for that stunk too.)

Current Approach:

Assume optics and routers are separate Accept need to purchase/learn new O&M Look to roll wrappers in to transport layer

Increase complexity there too? Look for additional flexibility and features

to be built in to –both- parts of the equation

Approach: OEO w/elec. fabric

Still assume optics and routing is separate Essentially eliminate analog portion of the problem by doing full conversion and retiming to digital at each site Continues separation of Optic and Services hardware Provides switched “wavelengths” cheap 2.5G based cross fabric may create new barriers for wide-band migration to 40G and 100G Another highly complex device to understand, manage, troubleshoot and maintainIdea of a backbone electrical fabric probably increases opportunities for good multi-point junctions at high bandwidthReplace Line-Card router optics with this technology?

Approach: Purify, Simplify O & E

Move digital timing, framing, shaping, etc. in to routers with controllable ITU grid wavelengths out (Large form pluggables?)

Maybe even tunable wavelengths? Make optical portion pure optic amplification, Dispersion, balancing, etc. Eliminate shaping, timing, framing cards.

Good telemetry and control back to routers for optic control Can I graph optical performance on Cricket/MRTG? Need dispersion compensation for 10G or eFEC at day0

Advance Alien Wavelengths in to Optic platforms Think about federated optical networks!

Cannibalizes vendor business units & requires current business to do development togetherSingle wavelength application can actually be router-only with no throw-aways as DWDM is addedProbably still lousy at multi-directional fiber intersections

Other thoughts Drive vendors on telemetry from optics Anticipate we will need the ability to link RON’s, perhaps with (or even without) a common national backbone for all services We need to solve Alien Wavelength problem on optical & router platforms Need ability to monitor and control Power,

Wavelength, dispersion, eFEC, etc across the common control plane

Need standardization of signalling and wrappers for alien wavelengths

Rob.Vietzke@uconn.eduConnecticut Education Network

University of ConnecticutNEREN

The Current State and Future of Advanced Optical Networks

July 20, 2004