Sponsored by the National Science Foundation Scaling Up: Growing the Topology of an Existing...

Sponsored by the National Science Foundation

Scaling Up: Growing the Topology of an

Existing Experiment in GENI

Sarah Edwards

GENI Project Office

Xuan Liu, UMKC

Sponsored by the National Science Foundation 2Scaling Up – October 22, 2014

Agenda

• Background and Motivation• Hands-On: Medium sized, multi-site topology

– A multi-slice, multi-site technique for building larger stitched topologies

– Building large RSpecs• geni-lib based scaleup tool


Why are we here?

At GEC20, we talked about Systematic Experimentation

A quick review…

• Build smallest reasonable

topology by…

– … changing one thing at a time …

– … automating as you go …

– … saving what you do.

• THEN scale up. Today

client server

router

router router


Scaling Up

Assumption #1You have a small scale working experiment

Assumption #2Install and orchestration scripts are auto-configuring

Today we will discuss how to make your topology

BIGGER


Process Recommendation

A. Build (smallest possible) topology by hand at a single aggregate

B. Automate topology creation at a single aggregate

C. Orchestrate and Instrument

D. Increase scale

E. More nodes

F. More aggregates

Automate






D. Increase scale

E. More nodes

F. More aggregates

AutomateGetting Started

Tutorials






D. Increase scale

E. More nodes

F. More aggregates

Automate

LabWiki,OEDL, and

GENI Desktop tutorials






D. Increase scale

E. More nodes

F. More aggregates

Automate

Scaling Up & geni-lib tutorials


Experiment Workflow• Part I: Design/Setup

• Part II: Execute

• Part III: Finish


Medium-scale GENI Experiments

• 150 node international topology– Brecht Vermeulen, iMinds & Thierry Rakotoarivelo, NICTA

• Domain Science Applications– Paul Ruth, RENCI

Courtesy of Ezra Kissel, Indiana University, GEC 20 Demo

Long-lived slicefor stitched, shared

VLAN

Dynamically add/remove nodes

as needed

Intelligent Data Movement System


Why use this topology?

Large topologies at a single aggregate can take a

long time to come up

Stitched links fail with some frequency

Updating topologies is hard


Single Aggregate

Single Aggregate / 1 SliceSingle Aggregate /

2 Slices with Shared VLAN

Proto-Backbone

Share VLAN:scalingup


backbone

router

router.1

10.100.1.0/24

.1router

scalingup

.2

Illinois

Stanford

Wiscscalingupscalingup

10.100.2.0/24

.2

site-10

2host

3host

1router

.110

10.10.2.0/24

10.10.1.0/24

site-5 site-15

Topology: Multi-site, multi-slice, stitched


General Procedure

1. Backbone Slice

– Reserve stitched backbone

– Share VLAN at each geographic location

2. At each geographic location

– Reserve a topology on the appropriate shared VLAN

3. Add, remove, update topologies at each geographic location as needed

http://groups.geni.net/geni/wiki/HowTo/ShareALan


Tools to generate a scaled RSpec

(from bad to good)• Copy paste existing RSpec in a text editor• Manually create in an Rspec Editor (Flack, Jacks,

jFed)• Write a shell script to do

– Brecht and Thierry’s 150 node topology

• scaleup tool– We’ll use today!!!


geni-lib library and scaleup tool

geni-lib is a python library to interact with the GENI Federation.

– Written by Nick Bastin, Barnstormer Softworks

geni-lib supports the creation of tools. An example of such a tool is …

scaleup is a script to create arbitrary topologies based on user-defined node types

– Written by Xuan Liu, University of Missouri, Kansas City– Distributed with geni-lib in tools directory

http://geni-lib.readthedocs.org/en/latest/intro/install.html


Site-X scaleup config

[general]topo_type=star

subnet=10.X

node_type=host, routersingle_am=yes

output_rspec=site-X.xml

# Star Topology # n+1 nodes, node 1 is center[star]num_nodes=2

[host]# Plain Ubuntu 12 image. . .

node_list=2,3

[router]# XORP software router# OSPF auto-configuring install script

node_list=1

[add-shared-vlan]shared_vlans=scalingup

[scalingup]lans=[(1,)]

[am_nodes]# unbound RSpecany=ALL


Procedure: Create a small topology

1. Modify site.txt config by replacing X with the value from your worksheet

2. Run scaleup on site.txt config

3. In Jacks, modify IP of shared VLAN interface with the value from your worksheet

4. Save file

5. Reserve Resources


Procedure: Test Connectivity

1. Login to a host node

2. Ping the backbone nodes

ping 10.100.1.1

ping 10.100.2.2

3. Ordinarily, this is when you would run your procedure (e.g. using LabWiki)


Procedure: Make a bigger topology

1. Delete your existing slice

2. Make a copy of site.txt

cp site.txt bigsite.txt

3. Add nodes to the star topology

num_nodes = 5

node_list=2,3,4,5,6

output_rspec=bigsite-X.xml

4. Repeat everything from Step 3.1.d onward including reservation


Procedure: Try other topologies

• Create and view (but don’t reserve) other topologies:

– How make a topology besides a star?

– How install different software on one of the nodes?


Scaling Up

Assumption #1You have a small scale working experiment

Assumption #2Install and orchestration scripts are auto-configuring

Today we have discussed how to make your

topology BIGGER


Thank you!

Sarah EdwardsGENI Project Office

[email protected]

Xuan LiuUniversity of Missouri, Kansas City

[email protected]

Sponsored by the National Science Foundation Scaling Up: Growing the Topology of an Existing...

Documents

Transcript of Sponsored by the National Science Foundation Scaling Up: Growing the Topology of an Existing...