European networking research Beyond Hybrid Networking€¦ · 29/09/2008 · University of...
Transcript of European networking research Beyond Hybrid Networking€¦ · 29/09/2008 · University of...
![Page 1: European networking research Beyond Hybrid Networking€¦ · 29/09/2008 · University of Amsterdam. European Network Research (Max Lemke) PHOSPHORUS PROJECT!European and Global](https://reader034.fdocuments.in/reader034/viewer/2022051907/5ff989f3c88e8514af739879/html5/thumbnails/1.jpg)
Cees de Laat
European networking research
Beyond Hybrid Networking
University of Amsterdam
![Page 2: European networking research Beyond Hybrid Networking€¦ · 29/09/2008 · University of Amsterdam. European Network Research (Max Lemke) PHOSPHORUS PROJECT!European and Global](https://reader034.fdocuments.in/reader034/viewer/2022051907/5ff989f3c88e8514af739879/html5/thumbnails/2.jpg)
European Network Research (Max Lemke)
![Page 3: European networking research Beyond Hybrid Networking€¦ · 29/09/2008 · University of Amsterdam. European Network Research (Max Lemke) PHOSPHORUS PROJECT!European and Global](https://reader034.fdocuments.in/reader034/viewer/2022051907/5ff989f3c88e8514af739879/html5/thumbnails/3.jpg)
![Page 4: European networking research Beyond Hybrid Networking€¦ · 29/09/2008 · University of Amsterdam. European Network Research (Max Lemke) PHOSPHORUS PROJECT!European and Global](https://reader034.fdocuments.in/reader034/viewer/2022051907/5ff989f3c88e8514af739879/html5/thumbnails/4.jpg)
![Page 5: European networking research Beyond Hybrid Networking€¦ · 29/09/2008 · University of Amsterdam. European Network Research (Max Lemke) PHOSPHORUS PROJECT!European and Global](https://reader034.fdocuments.in/reader034/viewer/2022051907/5ff989f3c88e8514af739879/html5/thumbnails/5.jpg)
PHOSPHORUS PROJECT
! European and Global alliance of partners to develop
advanced solution of application-level middleware and
underlying management and control plane technologies
! Project Vision and Mission
• The project will address some of the key technical challenges in
enabling on-demand end-to-end network services across multiple
heterogenous domains
• In the Phosphorus' implementation the underlying network will be
treated as first class Grid resource
• Phosphorus will demonstrate solutions and functionalities across a
test-bed involving European NRENs, GÈANT2, Cross Border Dark
Fibre and GLIF
![Page 6: European networking research Beyond Hybrid Networking€¦ · 29/09/2008 · University of Amsterdam. European Network Research (Max Lemke) PHOSPHORUS PROJECT!European and Global](https://reader034.fdocuments.in/reader034/viewer/2022051907/5ff989f3c88e8514af739879/html5/thumbnails/6.jpg)
MULTI-DOMAIN TESTBED
![Page 7: European networking research Beyond Hybrid Networking€¦ · 29/09/2008 · University of Amsterdam. European Network Research (Max Lemke) PHOSPHORUS PROJECT!European and Global](https://reader034.fdocuments.in/reader034/viewer/2022051907/5ff989f3c88e8514af739879/html5/thumbnails/7.jpg)
PHOSPHORUS ARCHITECTURE
The different domains of thePhosphorus' test-bed will have:
!Two “flavours” of GMPLS! standard (Ph. 1)! Grid-enabled (Ph. 2)
! Three types of NRPS:! UCLP! DRAC! ARGON
! Grid middleware! UNICORE as a reference point!AAA policies
![Page 8: European networking research Beyond Hybrid Networking€¦ · 29/09/2008 · University of Amsterdam. European Network Research (Max Lemke) PHOSPHORUS PROJECT!European and Global](https://reader034.fdocuments.in/reader034/viewer/2022051907/5ff989f3c88e8514af739879/html5/thumbnails/8.jpg)
My view here
GLIF
GN2/3
Frederica
Phosphorus
Onelab
Planetlab
FIRE
etc.
OSI
• needs
repeatable
experiment
• needs QoS &
lightpaths
• needs
infrastructure
descriptions
![Page 9: European networking research Beyond Hybrid Networking€¦ · 29/09/2008 · University of Amsterdam. European Network Research (Max Lemke) PHOSPHORUS PROJECT!European and Global](https://reader034.fdocuments.in/reader034/viewer/2022051907/5ff989f3c88e8514af739879/html5/thumbnails/9.jpg)
Telescopes
Input nodes
Correlator nodes
Output node
..... To equal the hardwarecorrelator we need:
16 streams of 1Gbps
16 * 1Gbps of data
2 Tflops CPU power
2 TFlop / 16 Gbps =
1000 flops/byte
THIS IS A DATAFLOW PROBLEM !!!
SCARIe: a research project to create a Software Correlator for e-VLBI.VLBI Correlation: signal processing technique to get high precision image from
spatially distributed radio-telescope.
The SCARIe project
![Page 10: European networking research Beyond Hybrid Networking€¦ · 29/09/2008 · University of Amsterdam. European Network Research (Max Lemke) PHOSPHORUS PROJECT!European and Global](https://reader034.fdocuments.in/reader034/viewer/2022051907/5ff989f3c88e8514af739879/html5/thumbnails/10.jpg)
TeraThinking
• What constitutes a Tb/s network?
• UvA has 2000 Gigabit drops ?->? Terabit Lan?
• look at 80 core Intel processor
– cut it in two, left and right communicate 8 TB/s
• think back to teraflop computing!
– MPI makes it a teraflop machine
• massive parallel channels in hosts, NIC’s
• TeraApps programming model supported by
– TFlops -> MPI / Globus
– TBytes -> OGSA/DAIS
– TPixels -> SAGE
– TSensors -> LOFAR, LHC, LOOKING, CineGrid, ...
– Tbit/s -> ?
ref Larry Smarr & CdL
![Page 11: European networking research Beyond Hybrid Networking€¦ · 29/09/2008 · University of Amsterdam. European Network Research (Max Lemke) PHOSPHORUS PROJECT!European and Global](https://reader034.fdocuments.in/reader034/viewer/2022051907/5ff989f3c88e8514af739879/html5/thumbnails/11.jpg)
application
networkelement
nc
application
networkelement
networkelement
networkelement
nc nc nc
ac acac ac
nc nc nc
• The network is virtualized as a collection ofresources
• UPVNs enable network resources to beprogrammed as part of the application
• Mathematica, a powerful mathematicalsoftware system, can interact with realnetworks using UPVNs
User Programmable Virtualized Networks allows the resultsof decades of computer science to handle the complexities of
application specific networking.
![Page 12: European networking research Beyond Hybrid Networking€¦ · 29/09/2008 · University of Amsterdam. European Network Research (Max Lemke) PHOSPHORUS PROJECT!European and Global](https://reader034.fdocuments.in/reader034/viewer/2022051907/5ff989f3c88e8514af739879/html5/thumbnails/12.jpg)
139.63.145.0
139.63.145.1
139.63.145.15
139.63.145.16139.63.145.17
139.63.145.18
139.63.145.2
139.63.145.3
139.63.145.31
139.63.145.32
139.63.145.33
139.63.145.34
139.63.145.38
139.63.145.40
139.63.145.41
139.63.145.42139.63.145.43
139.63.145.44
139.63.145.45
139.63.145.46
139.63.145.49
139.63.145.50
139.63.145.51
139.63.145.52
139.63.145.63
139.63.145.64
139.63.145.65
139.63.145.66
139.63.145.68
139.63.145.69139.63.145.70139.63.145.71
139.63.145.72
139.63.145.73139.63.145.74
139.63.145.75
139.63.145.79
139.63.145.81
139.63.145.82
139.63.145.83
139.63.145.84
139.63.145.85
139.63.145.86
139.63.145.87
139.63.145.88
139.63.145.94 192.168.0.1 192.168.0.2
192.168.0.3
192.168.0.4
192.168.0.5
192.168.0.6
192.168.1.1
192.168.1.2
192.168.1.3
192.168.1.4
192.168.2.1
192.168.2.2
192.168.2.3
192.168.2.4
Visualisation
Initialization and BFS discovery of NEs
95.9
94.5
95.8
96.
95.9
99.9
99.
100.
100.
94.599.9
99.9
100.
95.899.
96.
99.9
100.
100.
99.8
100.
100.
98.9
99.8
100.
100.
100.
100.
100.
98.9
101.
100.
101.100.
100.
100.
139.63.145.94192.168.0.1192.168.0.2
192.168.0.3
192.168.0.4
192.168.0.5
192.168.0.6
192.168.1.1
192.168.1.2
192.168.1.3
192.168.1.4
192.168.2.1
192.168.2.2
192.168.2.3
192.168.2.4
Network flows using real-time bandwidth measurements
nodePath = ConvertIndicesToNodes[
ShortestPath[ g,
Node2Index[nids,"192.168.3.4"],
Node2Index[nids,"139.63.77.49"]],
nids];
Print["Path: ", nodePath];
If[NetworkTokenTransaction[nodePath, "green"]==True,
Print["Committed"], Print["Transaction failed"]];
Path:{192.168.3.4,192.168.3.1,139.63.77.30,139.63.77.49}
Committed
Transaction on shortest path with tokens
Topology matters can be dealt with algorithmicallyResults can be persisted using a transaction service built in UPVN
Needs["WebServices`"]
<<DiscreteMath`Combinatorica`
<<DiscreteMath`GraphPlot`
InitNetworkTopologyService["edge.ict.tno.nl"]
Available methods: {DiscoverNetworkElements,GetLinkBandwidth,GetAllIpLinks,Remote, NetworkTokenTransaction}
Global`upvnverbose = True;
AbsoluteTiming[nes = BFSDiscover["139.63.145.94"];][[1]]
AbsoluteTiming[result = BFSDiscoverLinks["139.63.145.94", nes];][[1]]
Getting neigbours of: 139.63.145.94Internal links: {192.168.0.1, 139.63.145.94}(...)Getting neigbours of:192.168.2.3 Internal links: {192.168.2.3}
Mathematica enables advanced graph queries, visualizations andreal-time network manipulations on UPVNs
ref: Robert J. Meijer, Rudolf J. Strijkers, Leon Gommans, Cees de Laat, User Programmable VirtualiizedNetworks, accepted for publication to the IEEE e-Science 2006 conference Amsterdam.
![Page 13: European networking research Beyond Hybrid Networking€¦ · 29/09/2008 · University of Amsterdam. European Network Research (Max Lemke) PHOSPHORUS PROJECT!European and Global](https://reader034.fdocuments.in/reader034/viewer/2022051907/5ff989f3c88e8514af739879/html5/thumbnails/13.jpg)
Sensor grid: instrumenting the dikes
•30000 sensors (microphones) to cover Dutch dikes
•focus on problem area when breach is to occur
First controlled breach occurred on sept 27th ‘08:
![Page 14: European networking research Beyond Hybrid Networking€¦ · 29/09/2008 · University of Amsterdam. European Network Research (Max Lemke) PHOSPHORUS PROJECT!European and Global](https://reader034.fdocuments.in/reader034/viewer/2022051907/5ff989f3c88e8514af739879/html5/thumbnails/14.jpg)
Programmable Deterministic Service
![Page 15: European networking research Beyond Hybrid Networking€¦ · 29/09/2008 · University of Amsterdam. European Network Research (Max Lemke) PHOSPHORUS PROJECT!European and Global](https://reader034.fdocuments.in/reader034/viewer/2022051907/5ff989f3c88e8514af739879/html5/thumbnails/15.jpg)
Multi Layer Service Architecture
Network
layers
Application
layers Use Interface
Control Interface
(protocols API’s)
Network
Service
Application
5b of 6
![Page 16: European networking research Beyond Hybrid Networking€¦ · 29/09/2008 · University of Amsterdam. European Network Research (Max Lemke) PHOSPHORUS PROJECT!European and Global](https://reader034.fdocuments.in/reader034/viewer/2022051907/5ff989f3c88e8514af739879/html5/thumbnails/16.jpg)
RDF describing Infrastructure“I want”
contentcontent
RDF/CGRDF/CG
RDF/ST
RDF/NDL
RDF/NDL
RDF/VIZ
RDF/CPU
Application: find video containing x,then trans-code to it view on Tiled Display
COCE
![Page 17: European networking research Beyond Hybrid Networking€¦ · 29/09/2008 · University of Amsterdam. European Network Research (Max Lemke) PHOSPHORUS PROJECT!European and Global](https://reader034.fdocuments.in/reader034/viewer/2022051907/5ff989f3c88e8514af739879/html5/thumbnails/17.jpg)
Questions ?
rototyping the NGI: Phosphorus