OPEN%NETWORK%LINUX%UPDATES% · PDF fileOCP Platform V2 Unified Device Tree Repository Unified...

19
Rob Sherwood CTO, Big Switch Networks Open Compute Engineering Workshop: May, 2014 OPEN NETWORK LINUX UPDATES

Transcript of OPEN%NETWORK%LINUX%UPDATES% · PDF fileOCP Platform V2 Unified Device Tree Repository Unified...

Rob  Sherwood  CTO,  Big  Switch  Networks  Open  Compute  Engineering  Workshop:  May,  2014  

OPEN  NETWORK  LINUX  UPDATES    

©2014  B IG   SWITCH  NETWORKS ,   INC .          WWW.B IGSWITCH .COM   2

OUTLINE  

•  Mo3va3on  and  Code  •  Updates:    

•  Website  •  New  hardware  support  

•  Going  forward  •  X86  Support:  Interface  Masters  and  new  Accton  Box  •  Three  “forwarding  agents”:  OpenFlow,  OF-­‐DPA,  ORC  

•  Ques3ons  

MOTIVATION  

©2014  B IG   SWITCH  NETWORKS ,   INC .          WWW.B IGSWITCH .COM   4

ISN’T  NETWORKING  ALREADY  OPEN?  Faster  Throughput  =  More  commercial  value  =  More  Proprietary  

Aggregate  Throughput  à  

ß  Open  

10  Gb/s   100  Gb/s   1  Tb/s   10  Tb/s  

All  Hardware  Specs  Public   X86  Servers  

Closed  OS,  Open  APIs  for  Policy,  Stats  

Mul[-­‐chassis  Routers  

Closed  OS,  Open  Control  

Plane  APIs  

DC  –  1U  ToRs,  Spines  

Binary  SDK  for  Packet  

Forwarding    NPU,  FPGA,  SoC  

©2014  B IG   SWITCH  NETWORKS ,   INC .          WWW.B IGSWITCH .COM   5

ISN’T  NETWORKING  ALREADY  OPEN?  Faster  Throughput  =  More  commercial  value  =  More  Proprietary  

Aggregate  Throughput  à  

ß  Open  

10  Gb/s   100  Gb/s   1  Tb/s   10  Tb/s  

All  Hardware  Specs  Public   X86  Servers  

Closed  OS,  Open  APIs  for  Policy,  Stats  

Mul[-­‐chassis  Routers  

Closed  OS,  Open  Control  

Plane  APIs  

DC  –  1U  ToRs,  Spines  

Binary  SDK  for  Packet  

Forwarding    NPU,  FPGA,  SoC   DC  –  1U  

ToRs,  Spines  

This  project  

©2014  B IG   SWITCH  NETWORKS ,   INC .          WWW.B IGSWITCH .COM   6

MOTIVATION:  TOWER  OF  BABEL  IS  BAD  

OCP Platform V1

Hardware Layer

Device Tree #1 Initrd #1

Platform Dependent

Fedora Linux Kernel

Platform Independent

Stack #1 Stack #2 Stack #3

STP + MLAG

OCP Platform V2

Device Tree #2 Initrd #2

Std. Debian Linux Kernel

OpenFlow daemon

White box vendor

Device Tree #3 Initrd #3

BusyBox Linux Kernel

Quagga + hooks

Switch Agent(s)

©2014  B IG   SWITCH  NETWORKS ,   INC .          WWW.B IGSWITCH .COM   7

PROPOSAL:  COMMON  LINUX  PLATFORM  

OCP Platform V1

STP + MLAG

OCP Platform V2

Unified Device Tree Repository Unified Driver Repository

Standard packages, tools, etc. Stock Linux Kernel + any patches

OpenFlow daemon

White box vendor

Quagga + hooks

Keep differentiation in switch agents

Come together around the

common bits Maximize hardware

abstraction

©2014  B IG   SWITCH  NETWORKS ,   INC .          WWW.B IGSWITCH .COM   8

OPEN  SOURCE:  OPEN  NETWORK  LINUX  

•  Open-­‐sourced  commercial  code,  build  scripts,  drivers  from  Switch  Light  •  Part  of  Open  Compute  Project  (OCP)  

•  Project  goals:  •  Improve  percep[on/de-­‐risk  bare  metal  •  “Crowd  source”  larger  Switch  Light  HCL  

•  “Distribu3on”  dynamically  rebuilt  on  Emdebian  •  PlaWorm  driver  API/abstrac3on:  SFPs,  P/S,  Fans,  LED,  temp  sensors  

•  Switch  hardware  has  more  “variety”  then  servers  –  needs  new  drivers/tools  

•  Device  tree  source  files  for  plaWorms  that  need  it  (PPC  –  Yes,  x86  –  No)  

A  Linux  distribu[on  for  bare  metal  switches  

UPDATES  

©2013  B IG  SWITCH  NETWORKS ,   INC .          WWW.BIGSWITCH.COM   10

WEBSITE  IS  UP  

•  Documenta[on  •  Install  •  Build  •  Troubleshoo[ng  •  FAQ  

•  Mailing  list  •  Pointers  to  video  tutorials  

•  S[ll  a  work  in  progress  •  Two  posi[ons  open!      

©2013  B IG  SWITCH  NETWORKS ,   INC .          WWW.BIGSWITCH.COM   11

ONL  –  SUPPORTED  HARDWARE  

•  New:  Five  Accton/Edge-­‐Core  and  One  DNI/Agema  boxes  

•  Next  target  will  be  x86-­‐based  plaeorms  

©2013  B IG  SWITCH  NETWORKS ,   INC .          WWW.BIGSWITCH.COM   12

EXAMPLE  HARDWARE  PURCHASING  

Transparent  Pricing  

Streamlined  Procurement  

FORWARDING  AGENTS  

©2014  B IG   SWITCH  NETWORKS ,   INC .          WWW.B IGSWITCH .COM   14

WHAT  IS  A  FORWARDING  AGENT?  •  An  applica3on  that  ini3alizes/manages  the  packet  processing  

hardware  (e.g.,  ASIC)  •  Currently,  ONL  ships  with  no  forwarding  agent!  •  Hard:  all  code  that  touches  hardware  is  under  NDA  

•  Solu[on:  top  half/bofom  half  driver  model  •  Releasing  soon  (details  next  slides)  

•  OpenFlow  forwarding  agent  (based  on  Indigo2)  •  OF-­‐DPA  forwarding  agent  library  –  build  your  own  •  Open  Route  Cache  (ORC)  –  toy  router  forwarding  agent  

©2014  B IG   SWITCH  NETWORKS ,   INC .          WWW.B IGSWITCH .COM   15

OPENFLOW  FORWARDING  AGENT  

ONL  Linux  Kernel   ASIC  

LibC  on  Debian  Wheezy  Base  Distribu[on   ASIC  SDK  

SSH   Fan  Control   NTP   Syslog   SNMP  

CLI  

Indigo  

Indigo/ASIC  Driver  

OpenFlow  Agent  Loxi  

Legend  

Open  Network  Linux  

BSN  Open  

BSN  Closed  

3rd  Party  Closed  Source  

ZTN  Loader  

I2C   GPIO   Device  Trees  

Switch  Light  is  our  Indigo  OpenFlow  Agent  running  on  Open  Network  Linux  on  x86  or  ASIC-­‐based  hardware.  

Big  Network  Controllers  

©2014  B IG   SWITCH  NETWORKS ,   INC .          WWW.B IGSWITCH .COM   16

DIY  Forwarding  Agent:  OF-­‐DPA      

Chip  SDK  

OF-­‐DPA  

Indigo  driver  

closed  

OF-­‐DPA  API  open  

©2014  B IG   SWITCH  NETWORKS ,   INC .          WWW.B IGSWITCH .COM   17

OPEN  ROUTE  CACHE  (“ORC”)  FORWARDING  AGENT  

•  First:  If  you’re  working  on  something  similar  –  let’s  collaborate  •  Monitors  Linux  soeware  rou3ng  table  updates  

•  Via  RTNetlink  –  very  common  •  Copies  new  interfaces,  routes,  neighbor  entries  into  hardware  

•  Result:  hardware  accelerated  rou[ng  •  Compa3ble  with:  

•  Quagga,  Xorp,  Bird,  etc.  •  Manual  (`route  add  …`)/programma[c  (via  netlink)    

•  Code  quality:  Not  Produc3on!  

Turn  ONL  into  a  toy  router  

CONCLUSION  

©2014  B IG   SWITCH  NETWORKS ,   INC .          WWW.B IGSWITCH .COM   19

CONCLUSIONS  

•  ONL  is  an  ONIE-­‐compa3ble  NOS  for  OCP  hardware  •  Increasing  number  of  boxes  supported  •  Lots  of  progress:  website,  new  plaWorm  •  New  forwarding  agents  coming  soon  

•  OpenFlow,  OF-­‐DPA,  and  ORC  •  “OFTest”  Appliance  maybe  coming  soon  

•  “Feedback  welcome  but  patches  are  preferred”  

Addi3onal  Ques3ons?