Accurate(yetlong(winded(1tle:( Exposing(network,(VMedge(and( … · 2018. 7. 27. ·...

22
Accurate yet long winded 1tle: Exposing network, VM edge and power topology via LLDP and BGP LinkState and possible implica1ons 5/23/13 BField / Comcast (NANOG June 2013) Brian Field / Comcast 1

Transcript of Accurate(yetlong(winded(1tle:( Exposing(network,(VMedge(and( … · 2018. 7. 27. ·...

Page 1: Accurate(yetlong(winded(1tle:( Exposing(network,(VMedge(and( … · 2018. 7. 27. · Step(2:(Expose(VMedge(topology(5/30/13 BField(/(Comcast(NANOG(June(2013)( 15 Network Router e

Accurate  yet  long  winded  1tle:    

Exposing  network,  VM  edge  and  power  topology  via  LLDP  and  BGP-­‐

LinkState    -­‐-­‐  and  possible  implica1ons  

5/23/13   BField  /  Comcast  (NANOG  June  2013)  

 Brian  Field  /  Comcast  

1  

Page 2: Accurate(yetlong(winded(1tle:( Exposing(network,(VMedge(and( … · 2018. 7. 27. · Step(2:(Expose(VMedge(topology(5/30/13 BField(/(Comcast(NANOG(June(2013)( 15 Network Router e

Applying  web  principles  to  the  network  

[control  plane  focus]    

Brian  Field  /  Comcast  

5/23/13   BField  /  Comcast  (NANOG  June  2013)   2  

Page 3: Accurate(yetlong(winded(1tle:( Exposing(network,(VMedge(and( … · 2018. 7. 27. · Step(2:(Expose(VMedge(topology(5/30/13 BField(/(Comcast(NANOG(June(2013)( 15 Network Router e

Conway’s  Law  •  “Any  organiza+on  that  designs  a  system  (defined  broadly)  will  produce  a  design  whose  structure  is  a  copy  of  the  organiza+on's  communica+on  structure.”  

•  What  does  this  mean?    –   Think  Reese’s  peanut  buEer  cups–chocolate  and  peanut  buEer  –  two  great  tastes  that  taste  great  together  

–  Conway’s  law  would  suggest  org  structures  hamper  crea+on  of  Reese’s  peanut  buEer  cups  

5/23/13   BField  /  Comcast  (NANOG  June  2013)   3  

Page 4: Accurate(yetlong(winded(1tle:( Exposing(network,(VMedge(and( … · 2018. 7. 27. · Step(2:(Expose(VMedge(topology(5/30/13 BField(/(Comcast(NANOG(June(2013)( 15 Network Router e

What  has  made  the  web  so  successful?  

–  HTTP  –  open  –  Apache  –  open  source  –  Linux–  open  source  –  COTS  hw  –  cheap    

5/23/13   BField  /  Comcast  (NANOG  June  2013)  

HTTP

Apache

Linux

COTS hw

Web stack4  

Page 5: Accurate(yetlong(winded(1tle:( Exposing(network,(VMedge(and( … · 2018. 7. 27. · Step(2:(Expose(VMedge(topology(5/30/13 BField(/(Comcast(NANOG(June(2013)( 15 Network Router e

Web  model  versus  router  model  

5/23/13   BField  /  Comcast  (NANOG  June  2013)  

HTTP

Apache

Linux

COTS hw

BGP, ISIS, PIM, etc.

Proprietary CLI

Proprietry OS/chassis

Proprietary ASICs

Web stack Router stack 5  

Page 6: Accurate(yetlong(winded(1tle:( Exposing(network,(VMedge(and( … · 2018. 7. 27. · Step(2:(Expose(VMedge(topology(5/30/13 BField(/(Comcast(NANOG(June(2013)( 15 Network Router e

Is  this  SDN?  

•  “open”  API  

•  manage  (“hide”)  proprietary  router  environment  

•  Can  we  do  be`er?  

5/23/13   BField  /  Comcast  (NANOG  June  2013)  

HTTP

Apache

Linux

COTS hw

BGP, ISIS, PIM, etc.

Proprietary CLI

Proprietry OS/chassis

Proprietary ASICs

SDN APIs

Web stack Router stack

6  

Page 7: Accurate(yetlong(winded(1tle:( Exposing(network,(VMedge(and( … · 2018. 7. 27. · Step(2:(Expose(VMedge(topology(5/30/13 BField(/(Comcast(NANOG(June(2013)( 15 Network Router e

Service  Providers  and  virtualiza1on  •  Virtualiza1on  

–  COTS  hw  –  Many  servers,  many  

loca1ons  

•  Apps  as  VMs  

•  App  could  run  across  mul1ple  CPs  (cloud  providers)  

 •  Agility  

5/28/13   BField  /  Comcast  (NANOG  June  2013)   7  

Router

VM-X

VM-Y

PS-1

PS-2

PDU-42

PDU-43

powercords

Virtualizationservers

networklinks

VM-Y

VM-Z

PS-1

PS-2

powerdistribution

units

Page 8: Accurate(yetlong(winded(1tle:( Exposing(network,(VMedge(and( … · 2018. 7. 27. · Step(2:(Expose(VMedge(topology(5/30/13 BField(/(Comcast(NANOG(June(2013)( 15 Network Router e

Applying  applica1on  thinking  to  the  network  

 1.  Router  VM  in  every  COTS  hw  virtualiza1on  

server  

2.  Rethink  how  we  build/encode  network  control  informa1on  

3.  Bigdata  thinking  applied  to  network–per  web  transac1on  mining  -­‐>  per  packet  mining  

5/23/13   BField  /  Comcast  (NANOG  June  2013)   8  

Page 9: Accurate(yetlong(winded(1tle:( Exposing(network,(VMedge(and( … · 2018. 7. 27. · Step(2:(Expose(VMedge(topology(5/30/13 BField(/(Comcast(NANOG(June(2013)( 15 Network Router e

Background  to  Rethinking  how  we  build/encode  network  control  informa1on  

•  Network/Ops:  – What  App/VMs  are  really  running  in  site  X  right  now?  

•  Facility:  – Not  all  sites  and  servers  are  iden1cally  configured  power-­‐wise  

•  Applica1on:  – Are  my  VMs  running  in  an  environment  that  has  sufficient  network/server/power  redundancy?  

 BField  /  Comcast  (NANOG  June  2013)  5/28/13   9  

Page 10: Accurate(yetlong(winded(1tle:( Exposing(network,(VMedge(and( … · 2018. 7. 27. · Step(2:(Expose(VMedge(topology(5/30/13 BField(/(Comcast(NANOG(June(2013)( 15 Network Router e

Three  infrastructure  topologies  related  to  cloud  applica1ons  

1.  Network  topology  2.  VM  “edge”  topology  3.  “power”  topology  

•  Who  owns  audi1ng  these  topologies?  – What  if  my  app  spans  mul1ple  cloud  providers?  

5/28/13   BField  /  Comcast  (NANOG  June  2013)   10  

Page 11: Accurate(yetlong(winded(1tle:( Exposing(network,(VMedge(and( … · 2018. 7. 27. · Step(2:(Expose(VMedge(topology(5/30/13 BField(/(Comcast(NANOG(June(2013)( 15 Network Router e

Who  owns  audi1ng  these  topologies?  

•  Past:  –  Some  org  or  the  network  folks  

•  This  isn’t  a  Comcast  problem,  this  isn’t  a  cloud  provider  problem  this  is  an  applica1on  problem  

•  Put  audi1ng  onus  on  the  apps    

Ø It’s  hard  to  audit  info  that  is  dynamic  and  isn’t  learned  in  real-­‐+me  

 5/23/13   BField  /  Comcast  (NANOG  June  2013)   11  

Page 12: Accurate(yetlong(winded(1tle:( Exposing(network,(VMedge(and( … · 2018. 7. 27. · Step(2:(Expose(VMedge(topology(5/30/13 BField(/(Comcast(NANOG(June(2013)( 15 Network Router e

How  do  we  dynamically  expose  these  infrastructure  topologies?  

 •  IGP  •  LLDP  •  BGP  LinkState  

5/23/13   BField  /  Comcast  (NANOG  June  2013)   12  

Page 13: Accurate(yetlong(winded(1tle:( Exposing(network,(VMedge(and( … · 2018. 7. 27. · Step(2:(Expose(VMedge(topology(5/30/13 BField(/(Comcast(NANOG(June(2013)( 15 Network Router e

Two  key  protocols  

•  BGP  LinkState  –  New  AF    –  Export  IGP  and  TE  state  north  bound  

–  Part  of  IETF  I2RS  WG  –  dral-­‐iem-­‐idr-­‐ls-­‐distribu1on-­‐02  

•  LLDP  –  Link  Layer  Discovery  Protocol  

–  TLV  based  ethernet  protocol  

–  Supported  in  linux  and  recent  router  code  

BField  /  Comcast  (NANOG  June  2013)  5/29/13   13  

Page 14: Accurate(yetlong(winded(1tle:( Exposing(network,(VMedge(and( … · 2018. 7. 27. · Step(2:(Expose(VMedge(topology(5/30/13 BField(/(Comcast(NANOG(June(2013)( 15 Network Router e

Step  1:  Expose  network  topology    

 

BField  /  Comcast  (NANOG  June  2013)  5/30/13   14  

Network

Router

BGP

Link S

tate

route reflector

BGP Link State

Tools, Apps

Router

IGP

VM-X

VM-Y

real-time network state

PS-1

PS-2

PDU-42

PDU-43

powercords

Virtualizationservers

networklinks

VM-Y

VM-Z

PS-1

PS-2

powerdistribution

units

Page 15: Accurate(yetlong(winded(1tle:( Exposing(network,(VMedge(and( … · 2018. 7. 27. · Step(2:(Expose(VMedge(topology(5/30/13 BField(/(Comcast(NANOG(June(2013)( 15 Network Router e

Step  2:  Expose  VM  edge  topology  

BField  /  Comcast  (NANOG  June  2013)  5/30/13   15  

Network

Router

BGP

Link S

tate

route reflector

BGP Link State

Tools, Apps

Router

IGP

VM-X

VM-YLLDP

real-time network state

real-time VM state

PS-1

PS-2

PDU-42

PDU-43

powercords

Virtualizationservers

networklinks

VM-Y

VM-Z

LLDP

LLDPPS-1

PS-2

powerdistribution

units

LLDP

Page 16: Accurate(yetlong(winded(1tle:( Exposing(network,(VMedge(and( … · 2018. 7. 27. · Step(2:(Expose(VMedge(topology(5/30/13 BField(/(Comcast(NANOG(June(2013)( 15 Network Router e

Step  3:  Expose  power  topology  

BField  /  Comcast  (NANOG  June  2013)  5/28/13   16  

Network

Router

BGP

Link S

tate

route reflector

BGP Link State

Tools, Apps

Router

IGP

VM-X

VM-YLLDP

real-time network state

real-time VM state

PS-1

PS-2

PDU-42

PDU-43

LLDP

real-time power-server state

powercords

Virtualizationservers

networklinks

VM-Y

VM-Z

LLDP

LLDPPS-1

PS-2

LLDP

LLDP

powerdistribution

units

LLDP

LLDP

LLDP

LLDP

Page 17: Accurate(yetlong(winded(1tle:( Exposing(network,(VMedge(and( … · 2018. 7. 27. · Step(2:(Expose(VMedge(topology(5/30/13 BField(/(Comcast(NANOG(June(2013)( 15 Network Router e

What  are  we  lel  with?  

•  A  real-­‐1me  database  of:  – Where  all  services  are  running  

–  App/VM-­‐>server-­‐>router  interface  mapping  

–  PDU-­‐>Power  Supply-­‐>server  mapping  

 •  Applica1on  Value:  –  Be`er  VM  placement  –  Enable  app  audi1ng  

RouterB

GP

Link

Sta

te

route reflector

BGP Link State

Tools, Apps

real-time network state

real-time VM statereal-time power-server state

5/28/13   BField  /  Comcast  (NANOG  June  2013)   17  

Page 18: Accurate(yetlong(winded(1tle:( Exposing(network,(VMedge(and( … · 2018. 7. 27. · Step(2:(Expose(VMedge(topology(5/30/13 BField(/(Comcast(NANOG(June(2013)( 15 Network Router e

Lots  more  info  to  encode  into    BGP  LinkState  

•  Encode  this  new  informa1on  in  bits/bytes?    •  Is  it  1me  to  think  about  something  a  bit  more  current?  

•  Like  XML/JSON?  – Hey,  the  web  guys  developed  and  use  that  stuff  don’t  they?      

– Aren’t  they  pre`y  successful  at  what  they  do?  

5/23/13   BField  /  Comcast  (NANOG  June  2013)   18  

Page 19: Accurate(yetlong(winded(1tle:( Exposing(network,(VMedge(and( … · 2018. 7. 27. · Step(2:(Expose(VMedge(topology(5/30/13 BField(/(Comcast(NANOG(June(2013)( 15 Network Router e

Web  thinking  applied  to  network  control  protocols  -­‐>  Make  BGP  RESTful  

•  Proposal:    –  Encode  BGP  LinkState  using  XML/JSON  –  Convert  BGP  LinkState  primi1ves  to  be  RESTful  

•  Result:  –  BGP  LinkState  operates  like  a  web  app  

•  Apply  web’s  solware  methodology,  scale  and  efficiency  in  the  network  control  protocol  space.      

•  Does  this  apply  to  the  IGPs  too?      

5/23/13   BField  /  Comcast  (NANOG  June  2013)   19  

Page 20: Accurate(yetlong(winded(1tle:( Exposing(network,(VMedge(and( … · 2018. 7. 27. · Step(2:(Expose(VMedge(topology(5/30/13 BField(/(Comcast(NANOG(June(2013)( 15 Network Router e

Remember  I  men1oned  router  VMs?  

BField  /  Comcast  (NANOG  June  2013)  5/30/13   20  

Network

Router

BGP

Link State

route reflector

BGP Link State

Tools, Apps

Router

IGP

VM-XVM-Y

real-time network state

real-time VM state

PS-1

PS-2

PDU-42

PDU-43

LLDP

real-time power-server state

powercords

Virtualizationservers

networklinks

LLDP

powerdistribution

units

router VM

IGPLLDP

LLD

PLLDP

Open source router code!

LLDP

Page 21: Accurate(yetlong(winded(1tle:( Exposing(network,(VMedge(and( … · 2018. 7. 27. · Step(2:(Expose(VMedge(topology(5/30/13 BField(/(Comcast(NANOG(June(2013)( 15 Network Router e

Which  is  be`er?  

•  Virtualiza1on  applied  to  rou1ng  is  the  evolu1onary  1pping  point  in  the  network  space  

•  open  API  (SDN)  vs.  open  source  (router  VM)  

5/29/13   BField  /  Comcast  (NANOG  June  2013)   21  

BGP, ISIS, PIM, etc.

open source router code

Linux

COTS hw

Router VM stack

BGP, ISIS, PIM, etc.

Proprietary CLI

Proprietry OS/chassis

Proprietary ASICs

SDN APIs

SDN Router stack

Page 22: Accurate(yetlong(winded(1tle:( Exposing(network,(VMedge(and( … · 2018. 7. 27. · Step(2:(Expose(VMedge(topology(5/30/13 BField(/(Comcast(NANOG(June(2013)( 15 Network Router e

Applying  web  principles  to  the  network  [making  peanut  bu`er  cups]  

 Thanks!    [email protected]  

5/23/13   BField  /  Comcast  (NANOG  June  2013)   22