SuperJANET5 Enabling Education and Research Roland Trice [email protected].

SuperJANET5 Enabling Education and Research

Roland [email protected]

SuperJANET5 HEAnet National Networking Conference 2006

2

Introduction to JANET

• The Education Internet in the UK• HE, FE, Schools (via LEA networks) Research

Institutes, and others• Over 1000 institutions• Complete Internet connectivity

• SuperJANET4 • 10 Gbit/s SDH backbone• Delivers service to 20 regional networks• Regional networks connect individual

institutions


3

The Requirement: Key issues

• Network reliability and resilience• RNs connected by single link remained a concern

• Demand for bandwidth• Power users• Pent up demand from FE• Enlarging the user base• The usual growth

• Protect the interests of diverse communities• Flexible provisioning• Enhance network monitoring services


4

SJ5 must deliver

• RELIABILITY

• SCALABILITY

• SEPARABILITY

• FLEXIBILITY

• VISIBILITY

END-TO-END

Achievable with a flexible transmission platform built on optical fibre


5

Infrastructure procurement

• Negotiated Procedure • We know what we want

• Flexible transmission system– Fibre and WDM equipment

• Dedicated to SuperJANET• We didn’t know how we wanted it provided

• Lease dark fibre & light it ourselves• Managed service from a Telco

• We didn’t know if the market would deliver


6

Infrastructure procurement

• Pre-qualification Q4 2004• Six suppliers short-listed• Negotiate form of ITT with all six Q1/2 of

2005

• Launch ITT June 2005• Only to short-listed suppliers

• Contract awarded to Verizon (MCI) end of 2005


7

Router procurement

• Met with MCI in mid 2003• Avici, Axiowave, Caspian, Chiaro, Hyperchip,

Procket• Informal talks with suppliers in Q3/4 2003

• RFI document issued in early 2004• Evaluate features of carrier class routers

• Hands-on testing of• Chiaro Enstara, Cisco CRS-1, Juniper T-640,

Procket PRO 8000


8

Router procurement

• Open procurement launched in Sept 2005 • Awarded to Lucent Technology January 2006• Juniper T-640 routers

• Carrier Class• >1000 in service world wide• 40 Gbit/s demonstrated by Juniper and Verizon

• Available as a product now

• Very good deal, Driving down the cost of ownership


9

Router marketplace

• To date• Axiowave, Chiaro & Hyperchip have ceased

trading• Procket bought up by Cisco

• A week before RFI test

• Caspian has moved out of the carrier space


10

Core Infrastructure

• Six C-PoPs• Like SJ4 without Cosham and Edinburgh

• Fibre network dedicated to SuperJANET5• Single pair of fibres

• Protection at the IP layer

• Dedicated WDM transmission equipment• Operated by Verizon initially

• UKERNA may manage circuit provision later in the project


11

Core Infrastructure

• Ciena Corestream DWDM equipment• 80 wavelenghts per fibre• 10Gbit/s now, 40 Gbit/s in 2008

• Pilot on SJ5 core in 2007

• Core circuits grouped into ten bands of eight• Bands add/dropped at C-PoPs or at OADM

sites


12

Core Network Design

• Core Terminal sites – Six blue locations

• Flexible OADM sites (Optical Add Drop) – Eight white locations

• Optical Amplification sites –Eleven locations, not shown

• Core Network consists of three basic components:


13

Core Traffic Provision

• 10Gbit/s circuits are provisioned using two transponders only

• No Regeneration needed • Each circuit would have to be

regenerated separately• Expensive

• Optical amplification still needed every 80 KM or so

• Telehouse & Telecity part of the core• Peerings to UK and Global

Internet


14

Connecting Regional Networks• Two IP production circuits delivered to each

RN• Delivery to diverse locations in the RN

• One 10 Gbit/s research circuit• Connected to UKLight SDH mux

• Two connection methods• Collector Arc

• Point-point fibre through RNEPs linking C-PoPs

• Single point-to-point fibre• Fibre from RNEP into the core


15

Point to point fibre

Glasgow C-PoP

Leeds C-PoP

University of Newcastle

NORMAN

University of Northumbria

VerizonEdinburgh

VerizonNewcastle

VerizonMiddlesbrough


16


Regional Network Carried over collector arc

Production 2.5 Gbit/s circuit presented on muxponder cards at NewcastleCircuit is aggregated onto a 10 Gbit/s wavelength using an aggregation card The 10 Gbit/s wavelength is added into to the core network at the Verizon node in Newcastle and transported to the Glasgow C-PoP over the Corestream equipment. It is dropped out of the Glasgow Corestram into another 4200 at the Glasgow C-PoP The 2.5 Gbit/s circuit is de-muxed by a muxponder card and presented to the core router

10 Gbit/s research circuit

Newcastle UniversityVerizon NewcastleVerizon Glasgow

Core network


17


Regional Network Carried over collector arcNewcastle UniversityVerizon NewcastleGlasgow C-PoP

Core network

Verizon Middlesbrough Northumbria UniversityLeeds C-PoP

Core network


18

Collector Arc

YHMAN Leeds

Network North West

YHMAN Leeds Met

VerizonPreston

NNWPreston

NNWManchester

LeedsC-PoP

YHMAN

Warrington C-PoP


19

Collector Arc

Warrington C-PoP Manchester Leeds Met Leeds Uni

Leeds C-PoP

Leeds Uni 10 Gbit/s Production and Research on 10 Gbit/s transponders to Leeds C-PoP

Leeds Met 10 Gbit/s Production on 10 Gbit/s transponders passing through Manchester to drop off at Warrington. Note pink amplifier cards at Leeds Uni and Manchester and there-use of the green wavelength towards Warrington from Leeds Met.

Manchester 10 Gbit/s Production and Research circuits on 10 Gbit/s transponders to drop off at Warrington.


20

NIRAN & HEAnet

Regional Network N Type A: Ciena CN4200 Author: Tom Sims

Version: 18.10.06

Ukerna Network N: Primary RNEP

NTL Kennedy Way

Verizon Glasgow

FAN

FAN400 W DC

POWER400 W DC POWER

Queens 1

NTL Shore Road

FAN

FAN400 W DC

POWER400 W DC POWER

9km/2.52dB

12km/3.36dB

M6-F

FAN

FAN400 W DC

POWER400 W DC POWER

Queens 2

M6-F

116km/29dB

FAN

FAN400 W DC

POWER400 W DC POWER

OAV-00

OAV-00

LHDC-120

LHDC-120

Newry

92km/23dB

CN2150 CN2150

OAF-00

OAF-00

LHDC-40

OAV-00

OAF-00

CN2150

F10-A (ch35)Network Tribs


F10-T (ch39)



3km / 1.5dB

CoreStream (Subsea Festoon)

SPAN 1

203Km(41dB)

FAN

FAN400 W DC

POWER400 W DC POWER

F10-A (Tune)Network Tribs

M6-F

1550nmHandoff of ch40

To CS

1 Router band (upto 8 Channels) extended to Queens 2 using the CoreStream Remote Shelf Application

Newry NTL Kennedy Way Queens 2Queens 1

NTL Shore road

Verizon Glasgow

Core StreamSubsea Span

203 KM(41 dB)


21

NIRAN & HEAnet

Regional Network N Type A: Ciena CN4200 Author: Tom Sims

Version: 18.10.06

Ukerna Warrington

Ukerna Network N: Primary RNEP

CoreStream (Subsea Festoon)

SPAN 4235Km(49dB)

Verizon Dublin

FAN

FAN400 W DC

POWER400 W DC POWER

FAN

FAN400 W DC

POWER400 W DC POWER

M6-F

HeaNet

89km/23.25dB


F10-T (ch39)

FAN

FAN400 W DC

POWER400 W DC POWER

M6-F

CN2150


FAN

FAN400 W DC

POWER400 W DC POWER

OAV-00

OAV-00

44km/12dB

Manchester

LHDC-40 LHDC-60Lytham

F10-T (ch39)

FAN

FAN400 W DC

POWER400 W DC POWER

CN2150

F10-T (ch35)Network Tribs

1550nm/1310nmHandoff of ch40, ch41

To Ukerna

F10-T (ch39)

CN2150


FAN

FAN400 W DC

POWER400 W DC POWER

CN2150

CN-BS5

Clonshaugh

11km/4.5dB

60km/15dB

OAF-00

OAV-00

LHDC-50

Clonshaugh

HEAnet

Verizon Dublin

Core StreamSubsea Span

235 KM(49 dB)

Lytham

Manchester

Warrington


22

HEAnet

• Replacement of existing connection to JANET• GE circuit presented at ESAT-X• HEAnet provisioned dark fibre between

ESAT-X and the HEAnet PoP at Erne Street

• Delivery due by 24th November• UKERNA/HEAnet acceptance testing


23

Potential research collaboration

• CERN Large Hadron Collider Project• HEP access to the UK Tier 1 centre

• Network research• Future service development • Automated path provisioning• Control plane experiments


24

Migration

• 1st Regional Networks migrated on 31st November

• Aggressive timetable• Tuesdays and Thursday mornings

• Due to complete before Christmas 2006

• SuperJANET4 to continue until March 2007• Contingency• Migrate research projects


25

Meeting the requirement: Reliability

• Reduce single points of failure• Diverse fibre routing in the core• Dual connection of Regional Networks• Carrier class optical and routing equipment

• SDH technology • In the core and out to the regional networks• Rapid failure detection and recovery• Detect latent problems


26

Meeting the requirement: Scalability

• Ability to expand capacity• Where it’s needed• When it’s needed

• 40 Gbit/s trial in early 2007• Predictable cost

• Marginal cost for transmission channels• Significant discount for router equipment

• Not clawed back in maintenance charges


27

Meeting the requirement: Separability

• Hard multiplexing of bandwidth channels• Production services firewalled from research

infrastructures


28

Meeting the requirement: Flexibility

• Deliver bandwidth quickly• In weeks rather than months

• With a variety of interfaces and bandwidths• 10 and 2.5 Gbit/s SDH• 10 and 1 GE (LAN-PHY and WAN-PHY)

• Temporary arrangements may become practical


29

Meeting the requirement: Visibility

• Ability to monitor network in more detail• Operational monitoring• Research projects

• Optical taps • Monitor all router interfaces at Reading and

London• Issues of confidentiality have been addressed

Questions?

SuperJANET5 Enabling Education and Research Roland Trice [email protected].

Documents

Transcript of SuperJANET5 Enabling Education and Research Roland Trice [email protected].