Accurate(yetlong(winded(1tle:( Exposing(network,(VMedge(and( … · 2018. 7. 27. ·...
Transcript of Accurate(yetlong(winded(1tle:( Exposing(network,(VMedge(and( … · 2018. 7. 27. ·...
Accurate yet long winded 1tle:
Exposing network, VM edge and power topology via LLDP and BGP-‐
LinkState -‐-‐ and possible implica1ons
5/23/13 BField / Comcast (NANOG June 2013)
Brian Field / Comcast
1
Applying web principles to the network
[control plane focus]
Brian Field / Comcast
5/23/13 BField / Comcast (NANOG June 2013) 2
Conway’s Law • “Any organiza+on that designs a system (defined broadly) will produce a design whose structure is a copy of the organiza+on's communica+on structure.”
• What does this mean? – Think Reese’s peanut buEer cups–chocolate and peanut buEer – two great tastes that taste great together
– Conway’s law would suggest org structures hamper crea+on of Reese’s peanut buEer cups
5/23/13 BField / Comcast (NANOG June 2013) 3
What has made the web so successful?
– HTTP – open – Apache – open source – Linux– open source – COTS hw – cheap
5/23/13 BField / Comcast (NANOG June 2013)
HTTP
Apache
Linux
COTS hw
Web stack4
Web model versus router model
5/23/13 BField / Comcast (NANOG June 2013)
HTTP
Apache
Linux
COTS hw
BGP, ISIS, PIM, etc.
Proprietary CLI
Proprietry OS/chassis
Proprietary ASICs
Web stack Router stack 5
Is this SDN?
• “open” API
• manage (“hide”) proprietary router environment
• Can we do be`er?
5/23/13 BField / Comcast (NANOG June 2013)
HTTP
Apache
Linux
COTS hw
BGP, ISIS, PIM, etc.
Proprietary CLI
Proprietry OS/chassis
Proprietary ASICs
SDN APIs
Web stack Router stack
6
Service Providers and virtualiza1on • Virtualiza1on
– COTS hw – Many servers, many
loca1ons
• Apps as VMs
• App could run across mul1ple CPs (cloud providers)
• Agility
5/28/13 BField / Comcast (NANOG June 2013) 7
Router
VM-X
VM-Y
PS-1
PS-2
PDU-42
PDU-43
powercords
Virtualizationservers
networklinks
VM-Y
VM-Z
PS-1
PS-2
powerdistribution
units
Applying applica1on thinking to the network
1. Router VM in every COTS hw virtualiza1on
server
2. Rethink how we build/encode network control informa1on
3. Bigdata thinking applied to network–per web transac1on mining -‐> per packet mining
5/23/13 BField / Comcast (NANOG June 2013) 8
Background to Rethinking how we build/encode network control informa1on
• Network/Ops: – What App/VMs are really running in site X right now?
• Facility: – Not all sites and servers are iden1cally configured power-‐wise
• Applica1on: – Are my VMs running in an environment that has sufficient network/server/power redundancy?
BField / Comcast (NANOG June 2013) 5/28/13 9
Three infrastructure topologies related to cloud applica1ons
1. Network topology 2. VM “edge” topology 3. “power” topology
• Who owns audi1ng these topologies? – What if my app spans mul1ple cloud providers?
5/28/13 BField / Comcast (NANOG June 2013) 10
Who owns audi1ng these topologies?
• Past: – Some org or the network folks
• This isn’t a Comcast problem, this isn’t a cloud provider problem this is an applica1on problem
• Put audi1ng onus on the apps
Ø It’s hard to audit info that is dynamic and isn’t learned in real-‐+me
5/23/13 BField / Comcast (NANOG June 2013) 11
How do we dynamically expose these infrastructure topologies?
• IGP • LLDP • BGP LinkState
5/23/13 BField / Comcast (NANOG June 2013) 12
Two key protocols
• BGP LinkState – New AF – Export IGP and TE state north bound
– Part of IETF I2RS WG – dral-‐iem-‐idr-‐ls-‐distribu1on-‐02
• LLDP – Link Layer Discovery Protocol
– TLV based ethernet protocol
– Supported in linux and recent router code
BField / Comcast (NANOG June 2013) 5/29/13 13
Step 1: Expose network topology
BField / Comcast (NANOG June 2013) 5/30/13 14
Network
Router
BGP
Link S
tate
route reflector
BGP Link State
Tools, Apps
Router
IGP
VM-X
VM-Y
real-time network state
PS-1
PS-2
PDU-42
PDU-43
powercords
Virtualizationservers
networklinks
VM-Y
VM-Z
PS-1
PS-2
powerdistribution
units
Step 2: Expose VM edge topology
BField / Comcast (NANOG June 2013) 5/30/13 15
Network
Router
BGP
Link S
tate
route reflector
BGP Link State
Tools, Apps
Router
IGP
VM-X
VM-YLLDP
real-time network state
real-time VM state
PS-1
PS-2
PDU-42
PDU-43
powercords
Virtualizationservers
networklinks
VM-Y
VM-Z
LLDP
LLDPPS-1
PS-2
powerdistribution
units
LLDP
Step 3: Expose power topology
BField / Comcast (NANOG June 2013) 5/28/13 16
Network
Router
BGP
Link S
tate
route reflector
BGP Link State
Tools, Apps
Router
IGP
VM-X
VM-YLLDP
real-time network state
real-time VM state
PS-1
PS-2
PDU-42
PDU-43
LLDP
real-time power-server state
powercords
Virtualizationservers
networklinks
VM-Y
VM-Z
LLDP
LLDPPS-1
PS-2
LLDP
LLDP
powerdistribution
units
LLDP
LLDP
LLDP
LLDP
What are we lel with?
• A real-‐1me database of: – Where all services are running
– App/VM-‐>server-‐>router interface mapping
– PDU-‐>Power Supply-‐>server mapping
• Applica1on Value: – Be`er VM placement – Enable app audi1ng
RouterB
GP
Link
Sta
te
route reflector
BGP Link State
Tools, Apps
real-time network state
real-time VM statereal-time power-server state
5/28/13 BField / Comcast (NANOG June 2013) 17
Lots more info to encode into BGP LinkState
• Encode this new informa1on in bits/bytes? • Is it 1me to think about something a bit more current?
• Like XML/JSON? – Hey, the web guys developed and use that stuff don’t they?
– Aren’t they pre`y successful at what they do?
5/23/13 BField / Comcast (NANOG June 2013) 18
Web thinking applied to network control protocols -‐> Make BGP RESTful
• Proposal: – Encode BGP LinkState using XML/JSON – Convert BGP LinkState primi1ves to be RESTful
• Result: – BGP LinkState operates like a web app
• Apply web’s solware methodology, scale and efficiency in the network control protocol space.
• Does this apply to the IGPs too?
5/23/13 BField / Comcast (NANOG June 2013) 19
Remember I men1oned router VMs?
BField / Comcast (NANOG June 2013) 5/30/13 20
Network
Router
BGP
Link State
route reflector
BGP Link State
Tools, Apps
Router
IGP
VM-XVM-Y
real-time network state
real-time VM state
PS-1
PS-2
PDU-42
PDU-43
LLDP
real-time power-server state
powercords
Virtualizationservers
networklinks
LLDP
powerdistribution
units
router VM
IGPLLDP
LLD
PLLDP
Open source router code!
LLDP
Which is be`er?
• Virtualiza1on applied to rou1ng is the evolu1onary 1pping point in the network space
• open API (SDN) vs. open source (router VM)
5/29/13 BField / Comcast (NANOG June 2013) 21
BGP, ISIS, PIM, etc.
open source router code
Linux
COTS hw
Router VM stack
BGP, ISIS, PIM, etc.
Proprietary CLI
Proprietry OS/chassis
Proprietary ASICs
SDN APIs
SDN Router stack
Applying web principles to the network [making peanut bu`er cups]
Thanks! [email protected]
5/23/13 BField / Comcast (NANOG June 2013) 22