Federating experimental platforms as a playground for the future internet

Federating experimental platforms as a playground for the future

internet

Serge Fdidahttp://www-rp.lip6.fr/~sf/

UPMC – Sorbonne UniversitésLaboratoire LIP6 – CNRS

France

FIBRE Workshop- Salvador - Nov 27 2012 1

Past and current testbeds success


● Do you/we TRUST the results that you/we produce?

● Can you REPRODUCE the conditions for which you obtained these results, or reproduce the results? Or check the robustness of your assumptions?

● Which Solution(s)?

Simulation, Emulation, Testbeds

● A testbed for what type of problem?

One or multiple testbeds?

● What about the environment?

Monitoring, Control and Experimental plane

Why?


What is our target?Can we achieve this?


Or this, eg FEDERATION

Overlays

Services

Optical

Sensors

Multi-Hopradio


Some possible scenario ….


The Polymorphic Internet : Some Internet Future(s)

• The Network is a Database (“CCN”)

• The (Access) Network is The (Access) Network is WirelessWireless

• The Network is the People

• The Network is a global Virtualized resource

• And many others … The Social Computer …

• They’re all Federated (Inter-domain)


Enabling continuous deployment of New architectures

Virtualized substrate

IP world

Policies

Monitoring

Security/Trust

Federation


The Federation Concept!


Federation (dictionary definition!)

A federation is a union comprising a number of partially self-governing regions united by a central ("federal") government under a common set of objectives.


Why to federate?

● Many benefits …. For users, testbed providers, …

● But also challenges Complexity, Legal and trust issues Policies

● How? Trust testbed owners Describe, control and manage distributed testbeds

resources

● Challenges Modelling and description of the resources Policies, Monitoring, Scheduling, “Scale”, Diversity, …


Federation Architecture

● Who is concerned?

● Management Authority

Own the resources

Legal entity

● Operation Engineers

Operate the testbeds and their associated resources

● Experimenters

Motivated by the launch of an experiment across the resources


Architecture: Definition (from GENI)

● An aggregate represents a resource or set of resources that can be offered for inclusion in some customer specified topology. These typically fall into the broad categories of Computation, Communication and Storage resources.

● A sliver is a (real or virtual) resource group provided by the aggregate via the “Aggregate Manager” (AM) API.

● A slice is a collection of slivers gathered for a common purpose that are configured into a topology on which to deploy experiments or applications in some degree of isolation from other slices.


Federation: main entities

Researchers

Resources

Facility A

Slice Management

Administrative borderAuthority A Authority B

Slice Management

Facility B


Federation (1)

Facility A

Slice Management Slice Management

Facility B1. Share user credentials


Federation (2,3)

Facility A


Facility B1. Share user credentials

2. Share resource descriptions

3. Allow experiments to run across facilities


Federation: more than resource integration

Facility A


Facility B

Policies

Monitoring

Security


PlanetLab nodes worldwide and (insert) PlanetLab nodes located within Europe

PlanetLab Europe testbed


PlanetLab Terminology

● Site A site is a physical location where PlanetLab nodes are located (e.g. Fraunhofer Institute or UCL).

● Node A node is a dedicated server that runs components of PlanetLab services.

● Slice A slice is a set of allocated resources distributed across PlanetLab. Slices are assigned to some number of PlanetLab nodes. Slices have a finite lifetime and must be periodically renewed to remain valid.

● Sliver A sliver is a slice running on a specific node. You can use ssh to login to a sliver on a specific node.

● MyPLC: PL control framework

19FIBRE Workshop- Salvador - Nov 27 2012 19

Distributed Virtualization

● As a user you want to isolated from other activities on those nodes on which you run. The PL provides a level of isolation which gives you your own file system, and process control.

● You share CPU cycles and network bandwidth with other active slivers on each node.

● The concept of slice aggregates the presence of your slivers within the system


Nodes


Slices – hujiple_isis


Slices – upmcple_paristr


Slices


Federation (& Legal aspects)

● Local consortium agreement defines responsibilities and liabilities of each partner

● Federation integrates the consortiums into a seamless global authority

● Formal Trust Relationships are the basis for this integration


Global Federation

26

UPMC

EuropePLC

USAPLC

JapanPLC

Princeton

Kyoto


In Practice …

What is SFA, OMF, MySlice, …


Researchers

Testbeds

What researchers want

Researchers

Testbeds


To have access to a testbed

Researchers

Testbeds


To access many instances of thesame type of testbed / resource

Researchers

Testbeds


To access many instances of thesame type of testbed / resource

• For geographic diversity• For reproducing experiments

Researchers

Testbeds


To access different types oftestbeds and resources

Researchers

Testbeds


To access different types oftestbeds and resources

• For combined experiments• For moving between simulation,

emulation, and the real-world

Researchers

Testbeds


Authority

Researchers

Testbeds


Administrative simplicity:A single place to sign upin order to use all the testbeds

Authority

Researchers

Testbeds


Experimentcontrol tool

Researchers

Testbeds


Ease of access:The ability to use a smallnumber of familiar tools toaccess and control the testbeds

Experimentcontrol tool

Researchers

Testbeds

Where we were recently

Authorities

Tools

Researchers

Testbeds


Authorities

Tools

✗

Researchers

Testbeds


Authorities

Tools

✗ ✗ ✗

Researchers

Testbeds


Authorities

Tools

✗ ✗✗

Researchers

Testbeds

Impossible to agree on whowill be the single trustedauthority at a global scale

Problems to be solved

Researchers

Testbeds

Impractical to scale asingle database to globalscale

Problems to be solved

Researchers

Testbeds

A secure and distributedthin waist

Common API

Researchers

Testbeds

SFA aims to provide a secure common API with the minimum possible fonctionality to enable a global testbed federation

SFA: Slice Facility Architecture

Researchers

Testbeds

Experiment lifecycle

Authorities

Tools

Authenticate

Researchers

Testbeds


Authorities

Tools

Resource discovery

Researchers

Testbeds


Authorities

Tools

Resource reservation

Researchers

Testbeds


Authorities

Tools

Configure resources

Researchers

Testbeds


Authorities

Tools

Run experiment

Researchers

Testbeds


Authorities

Tools

Repatriate results

Researchers

Testbeds


Authorities

Tools

Release resources

Researchers

Testbeds

SFA and the experiment lifecycle

Authorities

Tools

Authenticate Yes*

*This is at the heart of SFA

Researchers

Testbeds


Authorities

Tools

Resource discoveryYes*

*Without going into all details

Researchers

Testbeds


Authorities

Tools

Resource reservationYes

Researchers

Testbeds


Authorities

Tools

Configure resourcesNo*

*Use the tool of your choice

Researchers

Testbeds


Authorities

Tools

Run experimentNo*


Researchers

Testbeds


Authorities

Tools

Repatriate resultsNo*


Researchers

Testbeds


Authorities

Tools

Release resourcesYes

Naming (slices, users, resources, authorities)

Hierarchical naming space

Authentication and authorization

X.509 certificates and signed credentials

Federation links through the exchange of certificates

Resource descriptions (RSpecs)

Only the language (XML) not the semantics

Standard API (XMLRPC)

To manage objects (users, resources, slices, authorities)

To manage resources (browse, acquire, manifest)

To manage slices (create, delete, start, stop)

60 SFA


OMF supports users over the full cycle of their experiments, from description to instrumentation, to

execution and measurement collection and visualization.

OMF/OML software


● A common abstraction to help the user browse through and interact with a large amount of data and sources

● Grounded on related work on data integration and large dataset navigation.

● Formulate semantic queries, requesting ltering and annotations

● Propose enhanced visualizations on received results

● Allow to balance homogeneity and heterogeneity in the GUI

MySlice


MySlice


Federating experimental platforms as a playground for the future internet

Technology

Transcript of Federating experimental platforms as a playground for the future internet