On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V...

32
10/2/2007 1 On Designing Improved Controllers for AQM Routers Supporting TCP flows By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne Atkins

Transcript of On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V...

Page 1: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 1

On Designing Improved Controllers for AQM Routers Supporting TCP flows

By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong

Presented byPushkaraj ChitreMeganne Atkins

Page 2: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 2

Outline•Introduction•Background•The Proportional Controller

•Experiments •Limitation

•PI Controller•Experiments•The Delay Utilization Trade-Off

•Conclusion and Future Work

Page 3: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 3

Introduction

• Uses Classical Control System Techniques for developing controllers.

• Proposes 2 designs– Proportional Controller– Proportional Integrator ControlUses NS-2 SimulationsPerformed control theoretic analysis of RED

Page 4: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 4

• 2 limitations of RED:-– Compromise speed for stability and vice versa– Direct coupling between queue length and

loss probability

Page 5: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 5

Background • Linearized the TCP model

Page 6: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 6

P(s)=PTCP(s)PQueue(s)

R0= Round Trip Time at the operating point

C= Link Capacity (packets/sec)

N= Load Factor (No of Connections)

Page 7: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 7

Page 8: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 8

The Proportional Controller

ωg=0.1min(ptcp,pqueue)• Lag in the low pass filter responsible for

the sluggishness of the RED controller• Not replacing the low pass filter by

proportional controller, the authors suggest designing of the stabilizing controller.

Page 9: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 9

• Design:-• K=∞

• ωg≈1.5 rad/sec• Note: the values are calculated in the Control

Theoretic analysis of RED”

Page 10: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 10

Experiments with propotional controller

• X-axis->time(sec)• Y-axis->Queue Size(packets)• Experiment 1:-

• 60 FTP flows• 180 http sessions• Link bandwidth=15Mb/s• Added time-varying dynamics• Buffer size=800 packets

Page 11: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 11

Comparison of RED and Proportional controller

Settling time

Sluggish responseOf RED

Page 12: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 12

• Experiment 2• Repeat the previous experiment by doubling

Round Trip Times.

Overshoots on RED

Page 13: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 13

Proportional controller with high gain

Page 14: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 14

Limitations of Proportional Controller

• For stable operation, a relatively shallow slope in the loss profile required.

• Reason-coupling between queue size and marking probability

• Solution – decouple by using integral control

• Steady state error

Page 15: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 15

Solution to limitations

• Use of proportional Integrator Controller• Steady state error=0• Can clamp queue size ro reference value “qref”• Much higher loop bandwidth=faster response

Page 16: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 16

The Proportional Integrator (PI) Controller

Higher loop bandwidth = faster response time

Page 17: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 17

Functional Form of the PI Controller

C(s) = KPI(s/z + 1)

s

Page 18: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 18

Digital Implementation

Difference Equation:

qref = desired queue length

Pseudo Code:

Page 19: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 19

Experiment Tools & Parameters

• Used ns simulator• Sampling frequency of 160 Hz• PI coefficients

– a = 1.822 (10) –5

– b = 1.816(10) –5

• qref = 200 packets• Buffer = 800 packets

Page 20: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 20

Experiment 3

Faster response timeRegulation of outputPI Controller insensitive to load level variations

PI Controller regulates the queue length to 200 packets

Page 21: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 21

Experiment 4

Faster response time

Page 22: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 22

Experiment 5

PI more robust at higher work loads

PI controller settles at ~10 millisecondsRED settles at ~ 115 milliseconds

Page 23: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 23

Experiment 6

RED experiences oscillations

PI still stable at lower work loads

Page 24: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 24

Experiment 7

PI controller is still at acceptable performance Response time has slowed (~ 40 milliseconds)RED and Proportional Controller “hit the roof”AQM system (with finite buffer) needs integral control

Page 25: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 25

Experiment 8

The RED controllers steady state error has increasedue to:

- Shorter RTT- Operating Point Queue Length Higher

Page 26: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 26

The Delay Utilization Tradeoff• Large buffers lead to:

– Higher utilization of the link– Larger queueing delays

• In RED the delay is controlled by:– minth– maxth– pmax

• q0 in the PI Controller controls the delay

Larger values of q0 = larger delays and utilization

Page 27: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 27

Delay Utilization Tradeoff

For (nearly) full utilization:-Small q0 for FTP ONLY-Large q0 for Mix (FTP/http)

Nearly linear relationship between q0 and delays

Page 28: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 28

RED vs PI

Delay in RED controlled by minthTo dynamic ranges (maxth –minth)used for RED: – Fig. 19 used 550– Fig. 20 used 55

Mixed flows were usedPI Controller capable of handling low delay and high utilization

Page 29: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 29

The Importance of ECN

• PI Controller can regulate the queue to a low level+ Lower Delay - less efficient performance

• Dropping packets leads to higher transmission completion timeAQM used with ECN produces an almost lossless system

Page 30: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 30

Conclusions• Two controllers:

– Proportional • Simple to implement• AQM response time better then REDs

– Proportional Integrator • Improves network performance• AQM response time better then REDs• Able to handle and regulate queue level

• Objectives:– Queue Usage– Latency Reduction

• PI Controller out performed RED

Page 31: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 31

Limitations and Future Work

• Limitations– Used linear models– Focused on classical control methods– Did not look at global or optimal results

• Future Work– More complex controllers

Page 32: On Designing Improved Controllers for AQM Routers ...rek/Adv_Nets/Fall2007/PI07.pdf · By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by Pushkaraj Chitre Meganne

10/2/2007 32

THANK YOU!