EMFCamp 2012 Network Infrastructure

54
EMFCAMP 2012 Internet to a field Nat Morris and Will Hargrave UKNOF23 9 th October 2012

description

 

Transcript of EMFCamp 2012 Network Infrastructure

Page 1: EMFCamp 2012 Network Infrastructure

EMFCAMP  2012  Internet  to  a  field  

 Nat  Morris  and  Will  Hargrave  

 UKNOF23  9th  October  2012  

Page 2: EMFCamp 2012 Network Infrastructure

•  3  day  fes)val  –  Fri  31st  Aug  to  Sun  2nd  Sept  •  Ran  by  volunteers  •  Geeks  /  hackers  /  makers  •  500  licensed  capacity  –  sold  out  

What  was  EMFCamp  2012?  

Photo:  Russ  GarreL  

Page 3: EMFCamp 2012 Network Infrastructure

Site  locaNon  

Page 4: EMFCamp 2012 Network Infrastructure

Site  locaNon  

Rented  from  Milton  Keynes  Parks  Trust  -­‐  £1,900    

Page 5: EMFCamp 2012 Network Infrastructure

FesNval  site  

Talks  and  presenta)ons     Photo:  KiLy  Wong  

Page 6: EMFCamp 2012 Network Infrastructure

FesNval  site  

Photo:  Lionel  Montrieux    

Balloon  launch    

Page 7: EMFCamp 2012 Network Infrastructure

FesNval  site  

Photo:  Graham  Morris  

Radio  sta)on  and  video  streaming    

Page 8: EMFCamp 2012 Network Infrastructure

FesNval  site  

Photo:  NoRnghack  

Workshops    

Page 9: EMFCamp 2012 Network Infrastructure

FesNval  site  

Photo:  Russ  GarreL  

Licensed  bar  under  M1  bridge    

Page 10: EMFCamp 2012 Network Infrastructure

FesNval  site  

Photo:  Russ  GarreL  

Licensed  bar  under  M1  bridge    

Page 11: EMFCamp 2012 Network Infrastructure

FesNval  site  

Photo:  Andy  Brockhurst  

Retro  gaming  tent    

Page 12: EMFCamp 2012 Network Infrastructure

Badge  

Atmega328    Microcontroller  

2.4ghz  radio  

MicroUSB  

IR  rx  IR  tx  

Photo:  Lionel  Montrieux    

Sponsored  by  UCL    

Page 13: EMFCamp 2012 Network Infrastructure

Requirements:  •  100mbit+  •  Site-­‐wide  wireless  •  Ethernet  +  power  to  every  tent  •  Fully  dual  stack  •  Visibility  of  the  whole  network  •  Mul)cast  video  

Infrastructure  

Photo:  Andy  Brockhurst  

Page 14: EMFCamp 2012 Network Infrastructure

Infrastructure  

Jasper  Benny  

David  

Will   Claire   Nat  

Mat  

Graham  

Page 15: EMFCamp 2012 Network Infrastructure

AUempted  to  apply  for  temporary  address  space  from  RIPE  NCC,  sponsored  by  Goscomb.    Issued  ASN,  v4  +  v6  PI  then  retracted  by  hostmaster  a[er  they  realized  they  could  only  issue  it  7  days  before  the  event.  Far  too  late  –  equipment  was  already  configured  and  boxed  by  then.    RIPE-­‐526  –  broken  L    Going  back  to  address-­‐policy-­‐wg  to  alter  the  policy.    

Address  space  

Page 16: EMFCamp 2012 Network Infrastructure

CCC  /  Chaos  Computer  Club  to  the  rescue!    Loaned  us:  •  AS13020  •  2001:067c:20a1::/48  •  94.45.224.0/19    But  now  Google  is  in  German  and  BBC  website  carries  adverts  –  never  mind.  

Address  space  

Page 17: EMFCamp 2012 Network Infrastructure

Backhaul  

•  No  exis)ng  copper  or  fibre  •  BlueSquare  Milton  Keynes  (now  Pulsant)  •  2.9km  away  

Page 18: EMFCamp 2012 Network Infrastructure

Backhaul  

Page 19: EMFCamp 2012 Network Infrastructure

•  Hired  two  30m  mobile  masts  /  VersaTowers  – £1,440  for  7  days  inc  delivery  +  collec)on  

Backhaul  

Photo:  David  Cro]  

Page 20: EMFCamp 2012 Network Infrastructure

Backhaul  Jasper’s  cycling  jacket  

Photo:  Jasper  Wallace  

27m  cherry  picker  

Page 21: EMFCamp 2012 Network Infrastructure

Backhaul  

SpoRng  

Photo:  Mat  Burnham  

17m  cherry  picker  

Page 22: EMFCamp 2012 Network Infrastructure

Backhaul  

Photo:  Rapid  Wireless  

Looking  from  the  site  towards  Pulsant  

Frank  +  Mervyn  

Page 23: EMFCamp 2012 Network Infrastructure

Primary  link  •  DragonWave  Horizon  Compact  •  400mbit/s  full  duplex  •  18ghz  OFCOM  licensed  •  Hired  from  RapidWireless  -­‐  £2,300  

Backhaul  

Photo:  NoRnghack  

Page 24: EMFCamp 2012 Network Infrastructure

Secondary  link  •  Ubiqui)  Nanobridge  M  •  100mbit/s  •  5.4ghz  •  Bought  from  Linitx  -­‐  £112  (for  2)  

Backhaul  

Photo:  NoRnghack  

Page 25: EMFCamp 2012 Network Infrastructure

Backhaul  

•  2  x  Cisco  7206  NPE-­‐G2  •  Installed  in  June  /  July  

Page 26: EMFCamp 2012 Network Infrastructure

Goscomb  Transit  

Pulsant  Transit  

MK  L3  Switch  ME3400  

DragonWave  

UbiquiN   UbiquiN  

DragonWave  

Core  1  3750G  

Core  2  3750G  

OOB  

OOB  MK  Router  7206  NPE-­‐G2  

Backhaul  

LONAP  

V4  +  V6  Peering  

V4  MulNcast  

THDO  Router  7206  NPE-­‐G2  

1G  

100M  100M  

1G  

1G  

1G  

1G  

1G  

1G  

1G  

Telehouse  East  

Pineham  Park  

Page 27: EMFCamp 2012 Network Infrastructure

hLp://Nnyurl.com/emfcore  

Backhaul  

Page 28: EMFCamp 2012 Network Infrastructure

NOC  

£25  dona)on  to  the  Scouts     Photo:  David  Cro]  

Page 29: EMFCamp 2012 Network Infrastructure

NOC  

Network  required  power  so  ended  up  running  that    

Page 30: EMFCamp 2012 Network Infrastructure

NOC  

Page 31: EMFCamp 2012 Network Infrastructure

NOC  

Food  /  work  /  social  area    

Page 32: EMFCamp 2012 Network Infrastructure

NOC  

Data  centre  par))oning!    

Page 33: EMFCamp 2012 Network Infrastructure

NOC  

Core  rack    

Page 34: EMFCamp 2012 Network Infrastructure

NOC  

Nagvis    

Page 35: EMFCamp 2012 Network Infrastructure

NOC  

Bandwidth  monitor    

Page 36: EMFCamp 2012 Network Infrastructure

AutomaNon  

Google  Spreadsheet  -­‐  Schedule  -­‐  Budget  -­‐  IP  Plan  -­‐  DHCP  Scopes  -­‐  Monitoring  

Google  Data  API  

DNS  Zones  -­‐  Forward  -­‐  Reverse  -­‐  DNSSEC  Signing  

DHCP  Scopes  -­‐  dhcpd.conf    Nagios  -­‐  Services  per  host  

Rancid  

hLps://github.com/emfcamp/emfnoc  

Switch  IOS  config  

Page 37: EMFCamp 2012 Network Infrastructure

DistribuNon  

Page 38: EMFCamp 2012 Network Infrastructure

DistribuNon  

hLp://Nnyurl.com/emfdistro  

Page 39: EMFCamp 2012 Network Infrastructure

DistribuNon  

SFP’s  sponsored  by  FlexOp)x  

Page 40: EMFCamp 2012 Network Infrastructure

DistribuNon  

•  Staging  from  June  in  Nat’s  lo[  •  GRE  tunneled  back  to  MK  •  Config,  document  +  monitoring  

Page 41: EMFCamp 2012 Network Infrastructure

DistribuNon  

£60/wk  hire  Photo:  Paul  Miller  

Page 42: EMFCamp 2012 Network Infrastructure

DistribuNon  

Photo:  David  Cro]  

Page 43: EMFCamp 2012 Network Infrastructure

DistribuNon  

Page 44: EMFCamp 2012 Network Infrastructure

DistribuNon  

Typical  Datkenklo  

Page 45: EMFCamp 2012 Network Infrastructure

DistribuNon  

Raspberry  Pi  colo  

Page 46: EMFCamp 2012 Network Infrastructure

DistribuNon  

Mul)cast  video  •  BBC  R&D  trial  over  LONAP  •  On  wired  +  wireless  •  Local  SAP  server  

hUp://support.bbc.co.uk/mul)cast/  

Page 47: EMFCamp 2012 Network Infrastructure

Wireless  

Dual  Cisco  WLC  4402  Controllers  

Page 48: EMFCamp 2012 Network Infrastructure

Wireless  

WCS  AP  mapping  

Page 49: EMFCamp 2012 Network Infrastructure

Wireless  

Luke’s  AP  associa)on  hack  

hLp://stats.emfcamp.org/luke/  

Luke  Brookes  TwiUer:  @propuke  

Page 50: EMFCamp 2012 Network Infrastructure

Stats  

Page 51: EMFCamp 2012 Network Infrastructure

Stats  

More  at  hUp://stats.emfcamp.org  

Page 52: EMFCamp 2012 Network Infrastructure

Feedback  

Page 53: EMFCamp 2012 Network Infrastructure

What  next?  

Photo:  Andy  Davidson  

Page 54: EMFCamp 2012 Network Infrastructure

QuesNons?  

Photo:  Russ  GarreL