New Age of PIONIER infrastructure

Artur Binczewski, Robert Pękal, Maciej Stroiński

PSNC

Where are we going?

Source: ICT Research and Innovation in Horizon 2020, Morten Moller, European Commission, 23.05.2013

PIONIER global collaboration

GÉANT GLIF

PIONIER EU

PIONIER network infrastructure

Regional Networks

PIONIER National Infrastructure

ZIELONA

GÓRA

KATOWICE

KRAKÓW

LUBLIN

WARSZAWA

BYDGOSZCZ

TORUŃ

CZĘSTOCHOWA

BIAŁYSTOK

OLSZTYN

RZESZÓW Bielsko-Biała

KOSZALIN

SZCZECIN

WROCŁAW

ŁÓDŹ

KIELCE

PUŁAWY

OPOLE

RADOM

CESNET; SANET 2x10 Gb/s

GÉANT 30 Gb/s

CBDF 10Gb/s

Zamość

UKRAINE 1x10 Gb/s

Gorzów

PIONIER network node

2 x 10 Gb/s (2 lambdas)

POZNAŃ

Elbląg Suwałki

LITHUANIA 1 x 10 Gb/s

BIELARUS 1 x 10 Gb/s

GDAŃSK

RUSSIA (Kaliningrad) 1 x 10 Gb/s

Colorless, directionless and contentionless

80ch DWDM system

Sochaczew

Hamburg (GLIF, Surfnet, Nordunet)

4x10 Gb/s

National Research and Education Network –

PIONIER (transmission)

International Fiber Infrastructure

AMS-IX

GLIF

CERN

DE-CIX

VIX

HAMBURG

100G migration

Gdańsk

KDM

Poznań

KDM

Wrocław

KDM

MAN

Szczecin

MAN

Zielona

Góra

MAN

Bydgoszcz

MAN

Często

chowa

MAN

Opole MAN

Śląsk

MAN

Łódź

100Gb/s

MAN

Koszalin

MAN

Olsztyn MAN

Toruń

MAN

Białystok

MAN

Puławy

MAN

Radom

MAN

Kielce

MAN

Lublin

MAN

Rzeszów

HPC Gdansk

HPC Poznan

HPC Wroclaw

HPC Warsaw

HPC Krakow N x 100Gb/s

100G migration

100Gb/s

N x 100Gb/s

AMS-IX

GLIF

HAMBURG

VIX

CERN

DE-CIX

Wroc

Poz

Gda

Waw

Cra

planned

100G migration

HPC PSNC NODE

Firewall

Firewall

DWDM

100GE

Transponders

100GE

&

10x10GE

Muxponders

HPC 2

HPC 5

100NET DWDM

Coherent ≥ 100G λ

HPC

resource

Existing

Juniper MPLS Switch

with new 100GE card

Existing

Juniper MPLS Switch

with new 100GE card

MAN 1 MAN 21

LLE

Switch

SDN

IB/Eth

Switch

SDN

MPLS Switch

100GE/10GE

SDN

MPLS Switch

100GE/10GE

SDN

NewMAN DWDM

10G & 100G λ

Is it enough?

Research infrastructure must be equipted with advanced living labs

• Available always and remotely

• Provide possibility to make disruptive and repeatable tests

• Provide full workflow for users (managing lab infrastructure, users access

and experiments)

Example of network technology laboratories in PIONIER network

• Hardware Design and Prototyping Labolatory

• Optical Technology Labolatory

• Open Network Hardware Labolatory

• Integrated Network Management and Simulation Labolatory

• Software Defined Network Labolatory

Hardware Design and Prototyping

Laboratory

SMT PLACEMENT EQUIPMENT

• Robotic SMT machine

• High speed

• High precision

STENCIL PRINTER

REFLOW OVEN

• Multiple soldering zones

• Conveyor belt PCB transmission

• High quality thermal profiling

HETEROGENOUS INSPECTION SYSTEM

• Voiding check capabilities

• Cold solder joints discover

• Electrical correctness inspection

• Signal analysis in bandwidth of tens of GHz

PCB BOARD

• Multilayered designs

• Impedance controlled

• Mostly FPGA powered

• Gigabit transmission oriented

(10G / 3GSDI etc.)

Examples of own hardware design

VIDEO HEADER • 8 independent LVDS lines

• Source synchronous mode

• Up to 8Gbps throughput

• Fitted for 8/10mpx sensors

• 4K resolution @ 60fps

VIDEO RAM • Post acquisition buffer for digital signal

processing purposes

• Video RAM for 4 independent video

controllers

• DDR2 technology @ 400MHz

FPGA CHIP • Internal IP architecture based on

proprietary AXI4-like bus

• Unique design of quad head

graphics controller

• Real time demosaicing and color

space conversion

DIGITAL VIDEO INTERFACES • HD-SDI & 3GSDI compatible

• Four independent video channels

• Multiple video modes available

The miniaturized 4k camera

MULTIPLEXER FEATURES

• integrated DDS for phase and freq

adjustment 10MHz clock

• phase shifting for PPS & 10MHz

• programable delay line

• silent switching capability

• OCXO oscillator

• backup clock for no input signal

• ETH statistics and management

The high precision atomic clock signals MUX

Optical Technology Laboratory

Existing measurement tools

POLMUX WDM OSA

PSO-200

Power meter

Tunable attenuator

Router tester 10G

CD i PMD

EDFA/RAMAN

OTDR

Finisar WaveShaper

4000S

MEMs Optical Switch

IP tester 100G

Tunable Sources HR OSA

PMD ControllerFilters Polarizators

Fibers

Broadband light source

3 ROADM nodes supporting:

– colourless, directionless,

contentionless and gridless

Interfaces: 10G, HD-SDI/3G, 100G and

400G link

Tunnable lasers able to apply different

modulation schemas (affecting the size of

the signal spectral bandwidth)

Additional measurement tools and

elements

Open Network Hardware Laboratory

ONH Laboratory in PSNC contains:

– ATCA standard choice (Advanced Telecommunications Computing

Architecture)

– six chassis each of them equipped with several blades with different

network processors (NP) and digital signal processors (DSP)

Each ATCA chassis (node) in the ONH Laboratory has:

– two switch Ethernet 14 SFP+ blades,

– two dual Intel Xeon E5-2600 blade with SAS disk,

– dual Cavium Octeon II CN68xx blade together with Cavium Octeon

SDK,

– dual Broadcom XLP832 module and dual EZchip NP4 blade.

Each ATCA chassis is also equipped with Texas Instrument DSP media

resource module that provides high density of media processing

Nodes have 20 x 1G/10G interfaces for interconnections and seven free slots

for future expansion and reconfiguration

Open Network Hardware Laboratory

ATCA node decomposition

Integrated Network Management and

Simulation Labolatory

FTTH

Switch

CPE

MPLS

Router

MPLS

Router

MPLS

Router

MPLS

Router

MPLS

Router

MPLS

Router

CPE

STB STB

Domain A Domain B

Access

Switch

MPLS Network MPLS Network

FTTH Network

Computer Center

FTTH

Switch

CPE CPE

STB STB

Access

Switch

TV TV

TV TV

Computing

Resources

Server

(OpenStack,

OpenFlow,

MGMT…)

Computer Center

FTTH Network

Integrated Network Management and

Simulation Labolatory

Software

• IBM Tivoli / HP OpenView

– Cloud and infrastructure management system

– Network management

– Virtualization management

– Cloud management

– Services management

• SteelCentral (OpNET)

– Network planning

– Network performance simulator

– Multi-technology, multi-vendor design

– Lifecycle support

Software Defined Network Laboratory

Current status

• Mininet was used as first-choice for testing of SDN developments in

PSNC

• A simple testbed using MX80, MX240 and EX9208 was used for

demonstrations (shared in time)

• The number of SDN related projects increased, sharing the testbed is

not possible anymore, it was decided to build a shared, flowspace

based testbed

• The testbed consists of:

– Two Juniper MX80 supporting OpenFlow 1.0

– Flowvisor and servers to accommodate endpoints and controllers

Software Defined Network Laboratory

Current status

• We used Floodlight and

OpenDaylight as a

controller

• In addition to „traditional

flowvisor” we look also at

other options for

slicing/virtualization

(flowspace firewall, OVX)

• This simple testbed is

integrated with current

national testbed

(PL-LAB)

flowvisor

controller1

controller1

Controller-3

Controller-n

VMA-1

VMA-2

VMA-3

VMA-n

VMB-1

VMB-2

VMB-3

VMB-n

Juniper MX 80Juniper MX 80

mgmt

OpenFlow OpenFlow

Endpoints Endpoints

Externalconnections

Externalconnections

Software Defined Network Laboratory

• A new infrastructure project

received structural funds

funding: PL-LAB2020

• Joint collaboraiton of PSNC,

NIT and 5 Polish Universities

• 10 Gb/s interconnectivity

betweeen SDN sites in the

core

• Each site equipped with

wireless and SDN testbeds

• Deployment:

Q3/Q4 2015

PSN

C

PG

PW

AGH

IITiS

PŚl PWr

PP

Sieć VPLS

IŁ

10 Gb/s 10 Gb/s

10 Gb/s

10 Gb/s

10 Gb/s

1 Gb/s

1 Gb/s

1 Gb/s

10 Gb/s

Software Defined Network Laboratory

Typical SDN Island in PL-LAB2020

Summary

• Infrastructure brigde between East Europe countries and GÉANT,

GLIF, CERN and Internet Exchange Points

• Achieve synergy in development network and research

infrastructures

– Openess for public and comercial research sectors

– Support to national & Horizon 2020 projects

– Efficient use of Strucutral Funds

• PIONIER is part of Polish Roadmap of Research Infrastructures

– New list of 53 research initiatives

– Integration with other research infrastructures

– Access to special, dedicated funds

– Period 2015-2020