1

Multi-service Resilient Fibre Networking via CWDMa North Sea case study

Richard KirbyManaging Director, Metrodata Ltd

Communications EquipmentInterconnectivity and Interoperability

www.metrodata.co.uk

www.metrodata.co.uk

Agenda

§ Who are we and what do we do?

§ Military applications & typical interfacing issues..

§ Typical connectivity examples

§ More advanced interfacing• Fibre Multiplexed Solution case-study

§ Wrap-up

2

www.metrodata.co.uk

Who we are and what we do!

§ Metrodata Ltd, UK Datacoms Equipment Manufacturer est. 1989• Interface and Transport Specialists• SDH/PDH, Serial, ATM, Fibre & Ethernet• Terrestrial, Microwave, Satellite applications

§ Clients worldwide include:• Telecoms Service Providers• Public Sector (Central & Local Govt., Defence, Health, Edu)• Corporate Enterprises

§ Integration Division, 'Metrodata Network Solutions'• Integrated customer solutions including Metrodata and 3rd Party

Products & Services• "Solving Communications Problems"

www.metrodata.co.uk

Military applications

§ Military sector customers:• USAF (e.g. Eglin AFB), US Navy / SPAWAR & US Army• UK MOD (various deployments)• Other NATO forces, e.g. RNLA TITAAN

§ Typical interfacing requirements / issues:• Service interface conversion (e.g. Telco circuit interface to eqpt.)• 'Copper-fibre' interface conversion for service extension• Interface matching conversion (typically eqpt. to eqpt. often seen

with crypto deployments)• Multi-service multiplexing over fibre (i.e. high bandwidth availability)• Multi-service convergence & multiplexing over restricted speed

links (i.e. typically Radio or Satcom)• Backhaul circuit connectivity, Satcom to Terrestrial

3

www.metrodata.co.uk

Typical Terrestrial & µ-wave Solutions

SERVICE INTERFACE CONVERSION

Carrier 2Mbps Leased Line (E1) connectionto Serial Router port

TYPICALLY E1, E2, E3OR STM-1 INTERFACE

MICROWAVE LINK

TYPICALLYX.21, V.35 or HSSI

CONNECTION

Line-of-sight (µ-wave) equipment often presents withSDH/PDH interface - here interfaced to Serial Routerport (typ. up to HSSI speeds)

SD

Ci sco 17 20

BR IS /T

C ONS OLE

AU XW IC 0 OK

OKB2B1

W IC 1 OK

DSUCPU

LNK1 00FD X

S3

L OOP

LP

FIBRE EXTENSION

Fibre extension of Voice (eg ISDN-30 trunk)or Data (Serial, 10/100 or Gigabit E'Net)

www.metrodata.co.uk

Multiplexing & LAN Extension Solutions

SDH STM-1 LINK

OR DARK FIBRE

SDH STM-1 LINK

OR DARK FIBRE

VOICE & DATA MULTIPLEXING

Multiple E1 &/or E3 and Multiple Ethernetlinks over fibre

ETHERNET LANEXTENSION

Ethernet (Layer 2) extension across variety ofof link media. Here showing Terrestrial 2Mbps

'Leased Line' circuit, alternatively Serial(various i/f types), E3/DS3, STM-1/OC3 etc..

4

www.metrodata.co.uk

Data Links over Satellite

Overcome terrestrial limitations and optimisedata services over satellite

www.metrodata.co.uk

Serial Link Cryptos

HSSI DTE - LVDS

Ethernet - LVDS - HSSI

Note: Auto crypto-resync has proven to be a useful facility!

5

www.metrodata.co.uk

Eglin AFB: Converged Services over Satellite

Central Location Remote Site 2Mobile truck

Remote Site 1(sea-going barge!)

Metrodata AP8000Access Processor

HSSI ATM UNI(x1 or x2)

QUAD T1 - CE

ATM STM-1 UNI

DS3 UNI

LAN (10/100) - CE

TYPICAL AP CONFIGURATION

INPUTS: Voice, Video,Telemetry Data, IP

SERIAL SAT MODEMINTERFACES

AP8000

AP8000

HSSI - CE

USAF Eglin AFB:Voice, Video, Telemetry & IP Data Convergence via ATM transportfor multi-site Communications

( with onward multi -castlinks throughout Eglin

AFB network )

OC-3 ATM UNI (Fibre link used as satellite eliminatorfor link testing between deployments)

www.metrodata.co.uk

Global Hawk Comms back-haul

6

www.metrodata.co.uk

Satellite Backhaul for NASA LANDSAT

§ Backhaul of customer application from Earth Station over Terrestrial Infrastructure to Data Centre

§ This Solution Quadrupled the Resolution of Satellite Pictures

www.metrodata.co.uk

Example: multi-protocol fibre network

§ Network required to converge Voice, Data and Alarm/Control signalling, via sub-sea fibre, between 3 North Sea Oil platforms

• Key network aspects:» Distance: platforms up to ~ 50km apart» Versatility: Voice and multiple data types over the same network» Resilience: Critical aspect, resilience to multiple network/device failures» On-site deployment: Small window, limited and (relatively) unskilled resources» Low cost!

§ Payload profile:• Data: 10/100 & Gigabit Ethernet• Voice: TDM PBX inter-connection via 2Mbps voice trunks• Alarm/Control: Proprietary (but relatively low speed) Serial data

7

www.metrodata.co.uk

1. Converged Ethernet/IP approach

CONSOLESummit X450a-24tDC

TM S h a r e d P o r t s

STACK NO.

S o l i d O N = L i n k

FANPSU-I

PSU-E

M G M T 1 0 G

Stack

1

21

2

Blinking = Activity

CONSOLESummit X450a-24tDC

TM S h a r e d P o r t s

STACK NO.

S o l i d O N = L i n k

FANPSU-I

PSU-E

M G M T 1 0 G

Stack

1

21

2

Blinking = Activity

CONSOLESummit X450a-24tDC

TM S h a r e d P o r t s

STACK NO.

S o l i d O N = L i n k

FANPSU-I

PSU-E

M G M T 1 0 G

Stack

1

21

2

Blinking = Activity

CONSOLESummit X450a-24tDC

TM S h a r e d P o r t s

STACK NO.

S o l i d O N = L i n k

FANPSU-I

PSU-E

M G M T 1 0 G

Stack

1

21

2

Blinking = Activity

CONSOLESummit X450a-24tDC

TM S h a r e d P o r t s

STACK NO.

S o l i d O N = L i n k

FANPSU-I

PSU-E

M G M T 1 0 G

Stack

1

21

2

Blinking = Activity

CONSOLESummit X450a-24tDC

TM S h a r e d P o r t s

STACK NO.

S o l i d O N = L i n k

FANPSU-I

PSU-E

M G M T 1 0 G

Stack

1

21

2

Blinking = Activity

Resilient Fibre Ring using RSTPor other protocols for Ethernet

'loop avoidance'. These may take timeto 're-converge' in the event of a failure

Serial-over-IP(Control)

TDM-over-IP(Voice)

Native Ethernet(Data)

Complex QoS configuration(if supported!) to ensure effective

prioritisation of Voice & Alarm/Control trafficvs 'general' IT Data

Specialised solutions for TDMoIP and/or SoIP are not readily available

with 'redundant/dual-homing'connection to Ethernet, so either dual

source connections are required or this represents a single point of failure

Resilient Ethernet/IP networks involving convergenceof multiple communications protocols require

advanced networking skills for support staff and addressingschema can be complex

Serial-over-IP and TDM-over-IP converters are both expensiveand complex to configure. They may suffer 'clock recovery'

issues in transmission of synchronised Voice data acrossnon-clocked 'best effort' transmission media (i.e. Ethernet!)

Off the shelf Serial -over-IP products didn't support the obscure alarm/control system serial interface, and

could introduce delays or jitter which may have de-stabilised the system.

www.metrodata.co.uk

2. Optical Multiplexing approach

§ Passive 'CWDM' (Coarse Wavelength Division Multiplexed) solution offered the following:

• Low cost» Using well established, low cost fibre interface converters

• Low complexity» Config. & installation more akin to 'plumbing' than to complex data networking

• High reliability & resilience» All systems 'dual homed' onto two separate fibre rings» Optical multiplexers are un-powered devices, minimal possibility of failure» Resultant network offers resilience to double fibre and/or equipment failures» Network could be fully deployed on a single Tx/Rx fibre pair between each

location (although in fact two pairs used to give fully redundant resilience)

8

www.metrodata.co.uk

Resilient (dual-homed) Service Interfacing

Serial (max 8Mbps) to dual SFP fibreRS-232/X.21/V.35/EIA-530

10/100/1000 Ethernetto dual SFP fibre

ISDN-30 (E1) to dual SFP fibre

FIMO -2100

FCM9000

FC1500

FC-GES

SFP to dual SFP fibre(used typically for MMF to SMFmatching, for both Ethernet and

'generic' signalling incl. Alarm/Control)

Emux

Multi E1 (4, 8, 16 ports) to dual SFP fibre

Resilient (dual-path)fibre routes to other

end of link

PassiveCWDM Hub

PassiveCWDM Hub

And more! (TV, SAN etc. etc.)

Serial (max 8Mbps) to dual SFP fibreRS-232/X.21/V.35/EIA-530

10/100/1000 Ethernetto dual SFP fibre

ISDN-30 (E1) to dual SFP fibre

FIMO -2100

FCM9000

FC1500

FC-GES

SFP to dual SFP fibre(used typically for MMF to SMFmatching, for both Ethernet and

'generic' signalling incl. Alarm/Control)

Emux

Multi E1 (4, 8, 16 ports) to dual SFP fibre

Resilient (dual-path)fibre routes to other

end of link

PassiveCWDM Hub

PassiveCWDM Hub

And more! (TV, SAN etc. etc.)

Serial

Data

Voice

IndustrialControl

www.metrodata.co.uk

Resilient Ring Topology

Site A

Site B

Site C

Required Communications:Serial (Alarm/Control): A <> CEthernet (Data): A <> BVoice (TDM): B <> C

Serial i/f

Serial i/f

E'net i/f

E'net i/f

Voice Trunk i/f(E1 / ISDN-30)

Voice Trunk i/f(E1 / ISDN-30)

Link 1

Link 2

Link 3

All Services resilient to failure ofany of Link 1, 2 or 3 or to failureof any CWDM Mux/Demux unit

9

www.metrodata.co.uk

6U

19"

Packaged fibre communications solution offering fully resilient (dual fibre routed) connectivityfor any combination of:

• Up to 16 x Copper to (MM or) SM Fibre 10/100/1000Mbps Ethernet • Up to 16 x MM Fibre 10/100/1000Mbps Ethernet to SM Fibre 10/100/1000Mbps Ethernet• Up to 13 x Serial (RS-232/X.21/V.35/EIA530) to (MM or) SM Fibre (**possibility to increase**?)• Up to 16 x MM Non-Ethernet Fibre Signalling (e.g. Alarm/SCADA apps etc.) to SM Fibre• Up to 13 x E1 (a.k.a. ISDN-30/ QSIG etc.) Copper to SM Fibre

Typical config:2 x E1 (i.e. up to 60 Voice circuits)4 x 100Mbps or Gigabit E'net2 x Non-E'net Media Conversion4 x Serial1 x spare connection

P2P dual-path flexible comms package

www.metrodata.co.uk

Wrap up

§ Whilst today's commercial communications infrastructure marches inexorably to ever higher speeds, military deployments demand a more careful approach:

• Compatibility across multiple generations of equipment & infrastructure

• Incorporation of a multitude of equipment, often with 'specialised' interface requirements

• Rapid and simple deployment in theatre

§ Metrodata, and Metrodata Network Solutions, can help!• Long-established company of high expertise in interface solutions• Metrodata equipment is designed and manufactured in the UK• COTS, KOTS(!) and fully bespoke developments undertaken

10

Thank you!

www.metrodata.co.uk