A Case for Overlays in DCN Virtualization
-
Upload
duongquynh -
Category
Documents
-
view
220 -
download
1
Transcript of A Case for Overlays in DCN Virtualization
![Page 1: A Case for Overlays in DCN Virtualization](https://reader033.fdocuments.in/reader033/viewer/2022042611/589d94881a28aba44a8bc10b/html5/thumbnails/1.jpg)
IBM 2011 CopyrightDC Caves Workshop, San Francisco, September 20111
A Case for Overlays inDCN VirtualizationKatherine Barabash, Rami Cohen, David Hadas, Vinit Jain,
Renato Recio and Benny Rochwerger IBM
Presenter:Vinit Jain, STSM, System Networking Development, IBM System & Technology Group
![Page 2: A Case for Overlays in DCN Virtualization](https://reader033.fdocuments.in/reader033/viewer/2022042611/589d94881a28aba44a8bc10b/html5/thumbnails/2.jpg)
IBM 2011 CopyrightDC Caves Workshop, San Francisco, September 20112
Physical Network
�Static workloads
– Applications ran on Operating Systems (OS)
– OS resided on physical server (vs moving from one server to another)
�Each workload has network state associated with it.
– Examples: VLAN, Access Control Lists - ACLs, Traffic rate limiting.
�The workload’s network state:
– Resided in the physical network
– Associated with server and static
�Physical network is static & simple (per server addresses, per port state)
– Before (or after) physical server is installed,
the network administrator configured the physical network once
10 years ago – networking was simpler
...
...
Database
Server
ApplicationServer
![Page 3: A Case for Overlays in DCN Virtualization](https://reader033.fdocuments.in/reader033/viewer/2022042611/589d94881a28aba44a8bc10b/html5/thumbnails/3.jpg)
IBM 2011 CopyrightDC Caves Workshop, San Francisco, September 20113
Legend
Physical Network with Virtual Switches
�Server virtualization made workloads dynamic
– Virtual Machines (workloads) can be dynamically added to servers.
– VMs can move from an over-utilized server to less utilized server.
�The VM’s network state:
– Now resides in both the server (vSwitch) & physical network
– Is no longer associated with the server,
it’s now associated with the VM & is dynamic (can move around).
�Physical network is dynamic and more complex
– Single “server port” now has multiple VMs, each with different network state.
– Requires network state coordination between Hypervisor and Physical network
..
......
VM
Migration
Virtualization increased network complexity
vSwitches
Physical Switches
Virtual Machines (VMs)
![Page 4: A Case for Overlays in DCN Virtualization](https://reader033.fdocuments.in/reader033/viewer/2022042611/589d94881a28aba44a8bc10b/html5/thumbnails/4.jpg)
IBM 2011 CopyrightDC Caves Workshop, San Francisco, September 20114
Overlay Networks
�Concept: create an overlay network above the physical network.
�Workloads remain dynamic, but:– Physical server state resides in physical network.
– All VM network state resides in server’s
Distributed Overlay Virtual Ethernet (DOVE) network.
�Physical network is static & simple (per server addresses, per port state)
– Network administrator configures physical network once.
�Virtual network is more efficient and supports multi-tenancy (see next slide).
..
......
Overlay
Network
DC2DC1
Virtualization � Can it be simpler?
Legend
DOVE Switches
Physical Switches
Virtual Machines (VMs)
VM
Migration
![Page 5: A Case for Overlays in DCN Virtualization](https://reader033.fdocuments.in/reader033/viewer/2022042611/589d94881a28aba44a8bc10b/html5/thumbnails/5.jpg)
IBM 2011 CopyrightDC Caves Workshop, San Francisco, September 20115
Site
Site
HOST
Server
Multi-Tenant with
Overlapping Address Spaces
� Multi-tenant, Cloud environments require multiple IP address spaces
within the same server, within a Data Center and across Data Centers (see above).
– Distributed Overlay Virtual Ethernet (DOVE) switches to enable multi-tenancy all the way
into the Server/Hypervisor, with overlapping IP Address spaces for the Virtual Machines.
Co
ke
Overl
ay N
etw
ork
10.0.3.1
00:23:45:67:00:01
10.0.5.7
00:23:45:67:00:04
10.0.5.7
00:23:45:67:00:04
10.0.0.4
00:23:45:67:00:25 Pep
si
Overl
ay N
etw
ork
DatabaseDatabaseDatabaseDatabase
DatabaseDatabaseDatabaseDatabase
HTTPHTTPHTTPHTTPAPPAPPAPPAPP
A Virtual Machine
Note, vSwitches are not shown.Note, vSwitches are not shown.Note, vSwitches are not shown.Note, vSwitches are not shown.
10.0.3.42
00:23:45:67:00:25APPAPPAPPAPP
vAppliance
vAppliance
10.0.5.4
00:23:45:67:00:01HTTPHTTPHTTPHTTP
10.0.5.1
00:23:45:67:00:01HTTPHTTPHTTPHTTP
10.0.3.1
00:23:45:67:00:01HTTPHTTPHTTPHTTP
10.0.3.42
00:23:45:67:00:01HTTPHTTPHTTPHTTP
![Page 6: A Case for Overlays in DCN Virtualization](https://reader033.fdocuments.in/reader033/viewer/2022042611/589d94881a28aba44a8bc10b/html5/thumbnails/6.jpg)
IBM 2011 CopyrightDC Caves Workshop, San Francisco, September 2011
Network as a Service
� Logical description of the network
� Connectivity:
– A Load Balancer is connected to the internet
– A Load Balancer is connected to a set of Application servers
– The set of Application Servers are connected to a database
� Security
– All the incoming traffic from the Internet to the Load Balancer must pass through Firewall and an IDS
� Performance
– All the traffic between the Application Servers and the Database must pass through a compression middle box
– All the SSL traffic between the Load Balancer and the web servers must pass through SSL accelerator
6
Application
Servers
Load
Balancer
Database
![Page 7: A Case for Overlays in DCN Virtualization](https://reader033.fdocuments.in/reader033/viewer/2022042611/589d94881a28aba44a8bc10b/html5/thumbnails/7.jpg)
IBM 2011 CopyrightDC Caves Workshop, San Francisco, September 20117
Distributed Overlay Virtual Ethernet Network
Achieve same level of virtualization for networks as we have today for servers
Host virtualization should enable virtual
machines
– To remain independent of
physical location
– To remain independent of the host
physical characteristics such as
CPU, Memory, I/O, etc.
– To form isolated compute
environments on top of the shared
physical host environment
Network virtualization should enable
virtual machines
– To remain independent of
physical location
– To remain independent of the
physical network infrastructure characteristics such as
network layer (2, 3), protocols,
addresses, topology, etc.
– To form isolated network
environments on top of the shared
physical network environment
serving the hosts
![Page 8: A Case for Overlays in DCN Virtualization](https://reader033.fdocuments.in/reader033/viewer/2022042611/589d94881a28aba44a8bc10b/html5/thumbnails/8.jpg)
IBM 2011 CopyrightDC Caves Workshop, San Francisco, September 20118
Network Virtualization for the Cloud -
Requirements
Host 1.1 Host 1.2 Host 2.1
Site 1 Site 2
Service App. 1 Service App. 2 Service App. 3
Gateway Gateway
Internet
HTTPServer
DBServer
Appl,Server
�Location and Topology Independence�Isolation
![Page 9: A Case for Overlays in DCN Virtualization](https://reader033.fdocuments.in/reader033/viewer/2022042611/589d94881a28aba44a8bc10b/html5/thumbnails/9.jpg)
IBM 2011 CopyrightDC Caves Workshop, San Francisco, September 20119
Network Virtualization for the Cloud -
Requirements
Host 1.1 Host 1.2 Host 2.1
Site 1 Site 2
Service App. 1 Service App. 2 Service App. 3
Gateway Gateway
Internet
HTTPServer
DBServer
Appl,Server
�Dynamically grow …
![Page 10: A Case for Overlays in DCN Virtualization](https://reader033.fdocuments.in/reader033/viewer/2022042611/589d94881a28aba44a8bc10b/html5/thumbnails/10.jpg)
IBM 2011 CopyrightDC Caves Workshop, San Francisco, September 201110
Network Virtualization for the Cloud -
Requirements
Host 1.1 Host 1.2 Host 2.1
Site 1 Site 2
Service App. 1 Service App. 2 Service App. 3
Gateway Gateway
Internet
HTTPServer
DBServer
Appl,Server
�Dynamically grow … and shrink
![Page 11: A Case for Overlays in DCN Virtualization](https://reader033.fdocuments.in/reader033/viewer/2022042611/589d94881a28aba44a8bc10b/html5/thumbnails/11.jpg)
IBM 2011 CopyrightDC Caves Workshop, San Francisco, September 201111
Network Virtualization for the Cloud -
Requirements
Host 1.1 Host 1.2 Host 2.1
Site 1 Site 2
Service App. 1 Service App. 2 Service App. 3
Gateway Gateway
Internet
HTTPServer
DBServer
Appl,Server
�Live migration “without borders”
![Page 12: A Case for Overlays in DCN Virtualization](https://reader033.fdocuments.in/reader033/viewer/2022042611/589d94881a28aba44a8bc10b/html5/thumbnails/12.jpg)
IBM 2011 CopyrightDC Caves Workshop, San Francisco, September 201112
Network Virtualization for the Cloud -
Requirements
Host 1.1 Host 1.2 Host 2.1
Site 1 Site 2
Service App. 1 Service App. 2 Service App. 3
Gateway Gateway
Internet
HTTPServer
DBServer
Appl,Server
�Live migration “without borders”
![Page 13: A Case for Overlays in DCN Virtualization](https://reader033.fdocuments.in/reader033/viewer/2022042611/589d94881a28aba44a8bc10b/html5/thumbnails/13.jpg)
IBM 2011 CopyrightDC Caves Workshop, San Francisco, September 201113
Overlay Network
vSwitch
VM VM
Hypervisor A
DCN1 (Physical) DCN2 (Physical)
Overlay Network
vSwitch
VM VM
Overlay Network
vSwitch
VM VM
Overlay Network
vSwitch
VM VM
OVERLAY 1
OVERLAY 2
Hypervisor B Hypervisor B Hypervisor A
The Distributed Overlay Virtual Ethernet (DOVE) approach: build the virtual network by creating an overlay networks between
hypervisors, which can be connected to each other over an arbitrary
physical topology
![Page 14: A Case for Overlays in DCN Virtualization](https://reader033.fdocuments.in/reader033/viewer/2022042611/589d94881a28aba44a8bc10b/html5/thumbnails/14.jpg)
IBM 2011 CopyrightDC Caves Workshop, San Francisco, September 201114
The Distributed Overlay Virtual Ethernet (DOVE) approach: build the virtual network by creating an overlay networks between
hypervisors, which can be connected to each other over an arbitrary
physical topology
Overlay Network
vSwitch
VM VM
Hypervisor A
DCN1 (Physical) DCN2 (Physical)
Overlay Network
vSwitch
VM VM
Overlay Network
vSwitch
VM VM
Overlay Network
vSwitch
VM VM
OVERLAY 1
OVERLAY 2
Hypervisor B Hypervisor B Hypervisor A
�The overlay is constructed through encapsulation of packets•Packets originating from a VM are encapsulated and the physical underlay is used to deliver to the server where the destination VM resides.
•Incoming packets (at the destination server) are decapsulated and delivered to the destination VM.
![Page 15: A Case for Overlays in DCN Virtualization](https://reader033.fdocuments.in/reader033/viewer/2022042611/589d94881a28aba44a8bc10b/html5/thumbnails/15.jpg)
IBM 2011 CopyrightDC Caves Workshop, San Francisco, September 201115
OverlayNetwork
DOVE Solution Elements
� High Level Overview
� DOVE Controller
– Performs management & a portion of control plane functions across DOVE
Switches
� DOVE Switches (DOVES)
– Provides layer-2 over UDP overlay (based on OTV)
– Performs data and some control plane functions
– Run in Hypervisor vSwitch or gateways
– Provides interfaces for Virtual Appliances to plug into
(Analogous to appliance line-cards on a modular switch)
DOVE
Controller
Physicalnetwork
DOVESDOVES
DOVES
DOVES
DOVES
![Page 16: A Case for Overlays in DCN Virtualization](https://reader033.fdocuments.in/reader033/viewer/2022042611/589d94881a28aba44a8bc10b/html5/thumbnails/16.jpg)
IBM 2011 CopyrightDC Caves Workshop, San Francisco, September 20111616
DOVE Encapsulation
(OTV + Extension)
PayloadIP Header
EP HeaderOuter IP PayloadInner IP
Original Packet
Encapsulation Options
Encapsulation Protocol (EP) Header
(Yellow is possible extensions to OTV)
UDPInnerMAC
OuterMAC
Options
Version I R R R Overlay ID
Instance ID Reserved
M R R R R R R R Frag ID Frag Offset
Next Header Next Header Length Payload Offset Reserved
InnerMAC
![Page 17: A Case for Overlays in DCN Virtualization](https://reader033.fdocuments.in/reader033/viewer/2022042611/589d94881a28aba44a8bc10b/html5/thumbnails/17.jpg)
IBM 2011 CopyrightDC Caves Workshop, San Francisco, September 2011
� Independency & Transparency
– Using DOVE a virtual network can be deployed on any physical infrastructure
• e.g. Ethernet, InfiniBand, IPv4, IPv6
• Each infrastructure may utilize a different implementation (e.g. using Openflow in IP/Ethernet based network)
– Using DOVE the network topology is flexible
• VM can move from anywhere to anywhere
– Each virtual network can be configured independently
� Scalability
– Using overlay, DOVE reduces the forwarding table size both on switches and routers
• Addressing only physical server
• Reduces cost and improves performance
– DOVE does not require forwarding entities configuration upon migration
• not based on VLAN
– Number of virtual network is not limited
• Not based on VLAN
17
DOVE’s advantages
![Page 18: A Case for Overlays in DCN Virtualization](https://reader033.fdocuments.in/reader033/viewer/2022042611/589d94881a28aba44a8bc10b/html5/thumbnails/18.jpg)
IBM 2011 CopyrightDC Caves Workshop, San Francisco, September 201118