QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck...

39
QPROBE: DETECTING THE BOTTLENECK IN CELLULAR COMMUNICATION NIMANTHA BARANASURIYA NATIONAL UNIVERSITY OF SINGAPORE VISHNU NAVDA MICROSOFT RESEARCH INDIA VENKAT PADMANABHAN MICROSOFT RESEARCH INDIA SETH GILBERT NATIONAL UNIVERSITY OF SINGAPORE

Transcript of QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck...

Page 1: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

QPROBE: DETECTING THE BOTTLENECK IN

CELLULAR COMMUNICATION

NIMANTHA BARANASURIYANATIONAL UNIVERSITY OF SINGAPORE

VISHNU NAVDAMICROSOFT RESEARCH INDIA

VENKAT PADMANABHANMICROSOFT RESEARCH INDIA

SETH GILBERTNATIONAL UNIVERSITY OF SINGAPORE

Page 2: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations
Page 3: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations
Page 4: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations
Page 5: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

The Big Picture

Internet

CellularNetwork

YouTubeServer

Page 6: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Internet

CellularNetwork

YouTubeServer

The Big Picture

Page 7: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

The Big Picture

Internet

CellularNetwork

YouTubeServer

Page 8: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Where is the Bottleneck?

Page 9: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Wireless WAN

QProbe

Where is the Bottleneck?

Page 10: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Alternate connection (e.g., WiFi)

Downsize media content

Route around the bottleneck

Pick a different replica

Why Detect?

Wireless WAN

Page 11: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

PF Scheduler

Page 12: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

PF Scheduler

Packet scheduler in cellular base stations

Per-device vs FIFO queues

Fairness vs no notion of fairness

Existing tools are unusable

Page 13: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Internet

CellularNetwork

TCPServer

QXDM BackgroundDownloaders

Page 14: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Schedulingfrequencydecreaseswithincreasingloadatthebasestation

Effect of base station load on slot gaps

Page 15: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

QProbe Design

Page 16: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Internet

CellularNetwork

QProbeServer

1 2 ... 253t

QProbe PacketTrain

QProbeApp

UDP0BytePayload

Page 17: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Internet

CellularNetwork

QProbeServerQProbe

App

1 2 ... 253t

QProbe PacketTrain

1 2 ... 25

QProbe PacketTrain

3~t

Page 18: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Internet

CellularNetwork

QProbeServerQProbe

App

1 2 ... 253t

QProbe PacketTrain

1 2 25

QProbe PacketTrain

3 ...

Page 19: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Internet

CellularNetwork

QProbeServer

1 2 ... 253t

QProbe PacketTrain

Can also happen due tocross traffic in the WAN

1 2 25

QProbe PacketTrain

3 ...

QProbeApp

Page 20: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

#back-to-backpackets,itself,can’taccuratelydetectthebottlenecklocation.

#Back-to-back packets for Wireless and WAN bottlenecks

Wireless bottleneck WAN bottleneck

Page 21: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Internet

CellularNetwork

QProbeServer

1 ... 25

UDPMTUBytePayloadTTL=HopCount- 1

2t

Load Load...

QProbeApp

Page 22: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Withloadpackets,#back-to-backpacketscandetectwirelessbottlenecks.

#Back-to-back packets for Wireless and WAN bottlenecks

Wireless bottleneck WAN bottleneck

Page 23: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

1 ... 252t

Load Load

T

...

1 . .. 252Load Load...

ThinWANPipe

Stretch-factor =Received gaps

Sent gaps

Page 24: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Loadpacketsincreasesthestretch-factor.ThisallowsusdetectWANbottlenecks.

Stretch factors for Wireless and WAN bottlenecks

Wireless bottleneck WAN bottleneck

Page 25: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Wireless

Yes

QProbe Algorithm

No

Unclassified

Packetgapsatthereceiver

WAN

Yes

#back-to-back<

bb_threshold

#back-to-back>

bb_threshold

Stretch_factor>

sf_threshold

Yes No

Page 26: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Evaluation

Page 27: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Measurement Study

Evaluation

~500 runs for which the ground truth is known

Classification accuracy: 97.4%

Controlled Experiments

Classification model using a 10-cross validation decision tree

Page 28: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Measurement Study

Page 29: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

iPhone App implementation

15 well-provisioned Azure servers

51 PlanetLab servers

2 months of data

8116 runs of QProbe

Page 30: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

iPhone App implementation

15 well-provisioned Azure servers

51 PlanetLab servers

2 months of data

8116 runs of QProbe

Page 31: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

iPhone App implementation

15 well-provisioned Azure servers

51 PlanetLab servers

2 months of data

8116 runs of QProbe

Page 32: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

iPhone App implementation

15 well-provisioned Azure servers

51 PlanetLab servers

2 months of data

8116 runs of QProbe

Page 33: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

642 Users | 33 Countries | 51 ISPs

Page 34: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Technology Runs Wireless WAN

3G 2573 215 (8.35%) 97 (3.77%)

LTE 5480 441 (8.05%) 837 (15.27%)

Summary of QProbe Runs

Page 35: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

QProbe Results (3G)

Ground Truth Wireless WAN

Wireless 187 161(86.1%) 26(13.9%)

WAN 76 13(17.11%) 63(82.89%)

3G Classified Runs: 84.3%

QProbe Classification

Page 36: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

QProbe Results (LTE)

Ground Truth Wireless WAN

Wireless 330 307(93.03%) 23(6.97%)

WAN 708 116(16.38%) 592(83.62%)

LTE Classified Runs: 81.2%

QProbe Classification

Page 37: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

QProbe: lightweight, platform independent, bottleneck detection technique

Uses less than 4KB of data and runs in ~700ms

Extensive evaluations show >85% bottleneck detection accuracy

Data and code available atwww.comp.nus.edu.sg/~nimantha/qprobe.html

Page 38: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

http://cdn1.dottech.org/wp-content/uploads/2013/04/binary_tunnel_wallpaper.jpg?2b1f17http://www.clker.com/cliparts/P/C/k/o/0/k/router-down-hi.pnghttp://status.freeftpspace.net/assets/img/server.pnghttp://g-ec2.images-amazon.com/images/G/01/wireless/detail/nokia-lumia928-veriz-black-main-lg.jpghttp://yizhantech.com/wp-content/uploads/2014/01/Cell-towers.jpghttp://www.psdgraphics.com/wp-content/uploads/2013/01/round-rating-buttons.jpg

Image Credits

Page 39: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations