Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult...

66
3/16/2007 WWSNA - 2007 Opening the Sensornet Black Box Megan Wachs, Jung Woo Lee, Jung Il Choi, & Philip Levis Computer Systems Laboratory, Stanford University

Transcript of Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult...

Page 1: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Opening the

Sensornet Black Box

Megan Wachs, Jung Woo Lee, Jung Il Choi, & Philip Levis

Computer Systems Laboratory, Stanford University

Page 2: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

The Sensornet Black Box

● It is difficult to observe what occurs deep within a sensor network

● This is the direct result of energy constraints on a mote.

● This lack of visibility is the principal difficulty in development.

Page 3: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

The MNet Architecture

“Minimize the energy cost of diagnosing the cause of a failure

or behavior”

Page 4: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Outline

● Survey of Failures● The MNet Architecture● A Design Example● Further Implications

Page 5: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

What kinds of failures are observed in real deployments?

● System Interactions: software conflicts– Murphy Loves Potatoes– Vigilnet – A Line in the Sand– Unwired Wine

Page 6: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

What kinds of failures are observed in real deployments?

● System Interactions: software conflicts● Network Problems: Saturation &

Congestion– A Line in the Sand– TASK– Vigilnet– Sensorscope– The Heathland Experiment– Flush

Page 7: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

What kinds of failures are observed in real deployments?

● System Interactions: software conflicts● Network Problems: Saturation &

Congestion● Protocol Issues: Conflicts & Failures

– Murphy Loves Potatoes

Page 8: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

What kinds of failures are observed in real deployments?

● System Interactions: software conflicts● Network Problems: Saturation &

Congestion● Protocol Issues: Conflicts & Failures● Unknown

● Unwired Wine● TASK● Murphy Loves Potatoes● The Heathland Experiment

● Monitoring Volcanic Eruptions● Industrial Sensor Networks● A Line in the Sand

Page 9: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Effects of Failures on Deployment Performance

Great Duck Island: 58%

Peter Scott

R. Szewczyk, J. Polastre, A. Mainwaring, and D. Culler. An analysis of a large scale habitat monitoring application. In Proceedings of the Second ACM Conference On Embedded Networked Sensor Systems (SenSys), 2004.

Page 10: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Effects of Failures on Deployment Performance

Great Duck Island: 58%Redwoods : 40%

G. Tolle, J. Polastre, R. Szewczyk, D. Culler, N. Turner, K. Tu, S. Burgess, T. Dawson, P. Buonadonna, D. Gay, , and W. Hong. A macroscope in the redwoods. In Proceedings of the Third ACM Conference on Embedded Networked Sensor Systems (SenSys), 2005.

Page 11: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Effects of Failures on Deployment Performance

Great Duck Island: 58%Redwoods : 40% Potato Field: 2%

K. Langendoen, A. Baggio, and O. Visser. Murphy loves potatoes: Experiences from a pilot sensor network deployment in precision agriculture. In the Fourteenth Int. Workshop on Parallel and Distributed Real-Time Systems (WPDRTS), 2006.

Page 12: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Effects of Failures on Deployment Performance

Great Duck Island: 58%Redwoods : 40% Potato Field: 2%Volcan Reventador: 68%

G. Werner-Allen, K. Lorincz, J. Johnson, J. Leess, and M. Welsh. Monitoring volcanic eruptions with a wireless sensor network. In Proceedings of the Second European Workshop on Wireless Sensor Networks (EWSN), 2005.

Page 13: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Management and Debugging

● Sympathy ● Lightweight RPC● Network Snooping Tools

Page 14: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Management and Debugging

● Sympathy ● Lightweight RPC● Network Snooping Tools

Sympathy

Page 15: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Management and Debugging

● Sympathy ● Lightweight RPC● Network Snooping Tools

Sympathy

Page 16: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Outline

● Survey of Failures● The MNet Architecture● A Design Example● Further Implications

Page 17: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Visibility Metric

“Minimize the energy cost of diagnosing the cause of a failure or behavior”

Page 18: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

The Need For Isolation

Isolation simplifies reasoning.

Page 19: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

The Need For Isolation

Isolation simplifies reasoning.

Isolation alone is not enough, the network must also provide fairness.

Page 20: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

The Need For Isolation

Network Isolation between protocols:

Please be quiet!

Page 21: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Fair Waiting Protocol

Network Protocols

FWP

CSMA

Page 22: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Grant-To-Send

Page 23: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Grant-To-Send

Page 24: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Grant-To-Send

AB

C D

Page 25: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Grant-To-Send

AB

C D

Page 26: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Grant-To-Send

AB

C D

Page 27: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Grant-To-Send

AB

C D

Page 28: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Grant-To-Send

AB

C D

Page 29: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Grant-To-Send

AB

C D

Page 30: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Grant-To-Send

AB

C D

Page 31: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Grant-To-Send

AB

C D

Page 32: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Grant-To-Send

AB

C D

Page 33: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Grant-To-Send

AB

C D

Page 34: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

FWP IsolationM

edia

n C

ost

Page 35: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

FWP Fairness

Weighted Fair Queuing of protocols based on Grant-to-Send durations and packet lengths.

Page 36: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Outline

● Survey of Failures● The MNet Architecture● A Design Example● Further Implications

Page 37: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

A Design Example:Pull Collection Protocol

Page 38: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Common Causes of Packet Loss in a Collection Protocol

● Disconnection● Destruction● Reboot● Suppression● Queue Egress Drop● Queue Ingress Drop

Page 39: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Diagnosing Why Packets Were Lost

Page 40: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Diagnosing Why Packets Were Lost

Page 41: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Eliminating Ingress Drops

Traditional Rate Control

Page 42: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Eliminating Ingress Drops

Pull-Based Rate Control

Page 43: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Using FWP For Bursts

Page 44: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Using FWP For Bursts

Grant of 200ms

Page 45: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Using FWP For Bursts

Grant of 200ms

Page 46: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Using FWP For Bursts

Page 47: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Eliminating Ingress Drops

Page 48: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Eliminating Ingress Drops

Traverse the remainder with information included in packets, used

by the protocol itself

Page 49: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Outline

● Survey of Failures● The MNet Architecture● A Design Example● Further Implications

Page 50: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Extensions & Limitations-The Cost of Visibility

● Isolation and fairness introduce delay, increasing latencies

● Under light loads, we can use zero grant-to-send times.

Page 51: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Extensions & Limitations-Low Power

● Low-Power listening in conjunction with packet bursts.

Page 52: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Extensions & Limitations-Isolation & Fairness

● An individual mote must provide system isolation and fairness.

● Higher-layer network protocols can provide fairness across network flows

Page 53: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Comments & Questions?

[email protected]

Page 54: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Grant-To-Send

ABC

Page 55: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Grant-To-Send

ABC

Page 56: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Grant-To-Send

ABC

Page 57: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Grant-To-Send

ABC

Page 58: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Grant-To-Send

ABC

Page 59: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Grant-To-Send

ABC

Page 60: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Grant-To-Send

ABC

Page 61: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Grant-To-Send

ABC

Page 62: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Grant-To-Send

ABC

Page 63: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Grant-To-Send

ABC

Page 64: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

Grant-To-Send

ABC

Page 65: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

FWP Fairness

Network Protocols

FWP

150ms

90ms

20ms

0ms

50ms

CSMA

Page 66: Opening the Sensornet Black Box · 3/16/2007 WWSNA - 2007 The Sensornet Black Box It is difficult to observe what occurs deep within a sensor network This is the direct result of

3/16/2007 WWSNA - 2007

FWP Isolation

0

10

20

30

0 100 200 300Generation Rate (pps)

Med

ian

Cos

t

1 over CSMA1 over FWP2 Over CSMA2 over FWP

Med

ian

Cos

t


Black Box Micro

Black Box Micro

Black-box (oracle)

Black-box (oracle)

Black-Box Testing

Black-Box Testing

Black Box Testing Methodology SANS.ppt · PDF fileWhite Box vs. Black Box Testing Delivery Application Implementation Protocol Specification Function ... Black box testing Report:

Black Box Testing Methodology SANS.ppt · PDF fileWhite Box vs. Black Box Testing Delivery Application Implementation Protocol Specification Function ... Black box testing Report:

Illuminating the Black Box: Antidepressants, Youth and Suicidemedia-ns.mghcpd.org.s3.amazonaws.com/...pm...the-black-box-present.pdf · Illuminating the Black Box: Antidepressants,

Illuminating the Black Box: Antidepressants, Youth and Suicidemedia-ns.mghcpd.org.s3.amazonaws.com/...pm...the-black-box-present.pdf · Illuminating the Black Box: Antidepressants,

Black Magic to Black Box

Black Magic to Black Box

Jit- Black Box

Jit- Black Box

Black-box Tomography

Black-box Tomography

Presented by SensorNet Technologies and Real-world Deployments Frank DeNap SensorNet Program Computational Sciences and Engineering Division.

Presented by SensorNet Technologies and Real-world Deployments Frank DeNap SensorNet Program Computational Sciences and Engineering Division.

Black-Box Ripper: Copying black-box models using ... · Black-Box Ripper: Copying black-box models using generative evolutionary algorithms Antonio Barb˘ al˘ au˘ 1;, Adrian Cosma2,

Black-Box Ripper: Copying black-box models using ... · Black-Box Ripper: Copying black-box models using generative evolutionary algorithms Antonio Barb˘ al˘ au˘ 1;, Adrian Cosma2,

Black box informational

Black box informational

The Black Box inside The Black Box...Steyning Grammar School A day and boarding school The Black Box inside The Black Box Using technology to accelerate and improve assessment forThe

The Black Box inside The Black Box...Steyning Grammar School A day and boarding school The Black Box inside The Black Box Using technology to accelerate and improve assessment forThe

Wireless sensornet

Wireless sensornet

The Black Box

The Black Box

White Box and Black Box Testing

White Box and Black Box Testing

Black Box Report

Black Box Report

Black Box Presentation

Black Box Presentation

DeNap SensorNet SC07

DeNap SensorNet SC07

Black box & white-box testing technique

Black box & white-box testing technique

Black Box Catalog

Black Box Catalog