The Effect of Router Buffer Size on HighSpeedTCP...
Transcript of The Effect of Router Buffer Size on HighSpeedTCP...
![Page 1: The Effect of Router Buffer Size on HighSpeedTCP Performancepeople.csail.mit.edu/gsmaragd/publications/Globecom2004/Globeco… · The Effect of Router Buffer Size on HighSpeedTCP](https://reader030.fdocuments.in/reader030/viewer/2022040605/5eab8485460e0e7c792a0e3c/html5/thumbnails/1.jpg)
The Effect of Router Buffer Size on HighSpeed TCP
Performance
Dhiman Barman
Joint work with Georgios Smaragdakis and Ibrahim Matta
![Page 2: The Effect of Router Buffer Size on HighSpeedTCP Performancepeople.csail.mit.edu/gsmaragd/publications/Globecom2004/Globeco… · The Effect of Router Buffer Size on HighSpeedTCP](https://reader030.fdocuments.in/reader030/viewer/2022040605/5eab8485460e0e7c792a0e3c/html5/thumbnails/2.jpg)
2
Transferring scientific data from Geneva to Chicago (dataTAG)
GRID Super Computing and Future Internet
Human Genome Project and Future Analysis Project
Applications
![Page 3: The Effect of Router Buffer Size on HighSpeedTCP Performancepeople.csail.mit.edu/gsmaragd/publications/Globecom2004/Globeco… · The Effect of Router Buffer Size on HighSpeedTCP](https://reader030.fdocuments.in/reader030/viewer/2022040605/5eab8485460e0e7c792a0e3c/html5/thumbnails/3.jpg)
3
TCP in High Speed NetworksRegular TCP is too slow in High Speed Networks
0.000028333.35555.5=9 mins1000
0.00000283333.355555.5=1.5h10000
0.0002833.3555.51000.00283.355.510
0.028.35.51
LossesWindow sizeRTT between LossesThroughput (Mbps)
Packet size = 1500 bytes, RTT = 0.1s
A High Speed Protocol has to be:
- Scalable - Responsive- Stable - Intra protocol fair
![Page 4: The Effect of Router Buffer Size on HighSpeedTCP Performancepeople.csail.mit.edu/gsmaragd/publications/Globecom2004/Globeco… · The Effect of Router Buffer Size on HighSpeedTCP](https://reader030.fdocuments.in/reader030/viewer/2022040605/5eab8485460e0e7c792a0e3c/html5/thumbnails/4.jpg)
4
• HighSpeed TCP– First standardized HighSpeed TCP– AIAD in log-scale
• Scalable TCP– MIMD in linear scale
• BIC TCP – Binary search for available bandwidth
• FAST TCP – Reacts to both packet loss and queueing delay
High Speed Protocols
![Page 5: The Effect of Router Buffer Size on HighSpeedTCP Performancepeople.csail.mit.edu/gsmaragd/publications/Globecom2004/Globeco… · The Effect of Router Buffer Size on HighSpeedTCP](https://reader030.fdocuments.in/reader030/viewer/2022040605/5eab8485460e0e7c792a0e3c/html5/thumbnails/5.jpg)
5
• All High Speed variants of TCP scale over Gigabit linespeed with rule-of-thumb buffer size – Rule-of-thumb: Buffer Size = RTT * BW – Ideal static transmission window
– high utilization and minimal loss
• Focus has been given to improve other High Speed TCP features.
Motivation
![Page 6: The Effect of Router Buffer Size on HighSpeedTCP Performancepeople.csail.mit.edu/gsmaragd/publications/Globecom2004/Globeco… · The Effect of Router Buffer Size on HighSpeedTCP](https://reader030.fdocuments.in/reader030/viewer/2022040605/5eab8485460e0e7c792a0e3c/html5/thumbnails/6.jpg)
6
We investigate:
• Interaction between protocol and router buffer size and linespeed
• Do we need to increase buffer size linearly with linespeed ?
• How Router Buffer affects HighSpeedTCP behavior ?
Our Contribution
![Page 7: The Effect of Router Buffer Size on HighSpeedTCP Performancepeople.csail.mit.edu/gsmaragd/publications/Globecom2004/Globeco… · The Effect of Router Buffer Size on HighSpeedTCP](https://reader030.fdocuments.in/reader030/viewer/2022040605/5eab8485460e0e7c792a0e3c/html5/thumbnails/7.jpg)
7
• 10Gb/s linecard– Rule-of-thumb about 300Mbytes of buffer size– Read and write 40 byte packet every 32ns
• Memory technologies– SRAM: fast, require more devices, expensive,
energy consuming– DRAM: slow, require less devices, cheap, less
energy consuming• Problem gets severe
– At 40Gbps, 100Gbps, …– In an all-optical router for a backbone network where buffer
size is limited to 5-10 packets in delay lines
Why Router Buffer is a concern
![Page 8: The Effect of Router Buffer Size on HighSpeedTCP Performancepeople.csail.mit.edu/gsmaragd/publications/Globecom2004/Globeco… · The Effect of Router Buffer Size on HighSpeedTCP](https://reader030.fdocuments.in/reader030/viewer/2022040605/5eab8485460e0e7c792a0e3c/html5/thumbnails/8.jpg)
8
Joint Model of HighSpeed TCP and Router Buffer Size
Aggregated Throughput
Converged Utilization
Load Loss
•Compute Throughput as function of loss rate
•Compute Loss rate as function of Throughput
•Iterate to compute fixed-point .
![Page 9: The Effect of Router Buffer Size on HighSpeedTCP Performancepeople.csail.mit.edu/gsmaragd/publications/Globecom2004/Globeco… · The Effect of Router Buffer Size on HighSpeedTCP](https://reader030.fdocuments.in/reader030/viewer/2022040605/5eab8485460e0e7c792a0e3c/html5/thumbnails/9.jpg)
9
))log()log()log(
)log((
e)(low
low
high
low
high
low ppp
www
w
wp
+
=
5.0)5.0()log(
)log()(;
)(2)()(2)(
2
+−=−
= high
low
high
low b
wwww
wbwb
wpwbwwa
ssthRegular TCP
Wlow
Wp(1-bp)
Wp
Whigh
HighSpeed TCP Window Dynamics
HighSpeedTCP
⎪⎩
⎪⎨
⎧
>+≤≤+
<=+
lowttt
lowtt
tt
Rt
wwwawwwssthw
ssthwww
),(,1
,2
![Page 10: The Effect of Router Buffer Size on HighSpeedTCP Performancepeople.csail.mit.edu/gsmaragd/publications/Globecom2004/Globeco… · The Effect of Router Buffer Size on HighSpeedTCP](https://reader030.fdocuments.in/reader030/viewer/2022040605/5eab8485460e0e7c792a0e3c/html5/thumbnails/10.jpg)
10
ssth Regular TCP
Wlow
Wp(1-bp)
Wp
Whigh
HighSpeed TCP Window Dynamics
HighSpeedTCP
We derived Analytical Closed Form Expression for Throughput
)/log()/log(
12
lh
lhppww
l
ld
pp
RttN
⎟⎟⎠
⎞⎜⎜⎝
⎛≈
−=
ωλ
dN
))(2()()(2))(()( 2
wbRTTwpwbw
RTTtwa
dttdw
−==
1t 2t
![Page 11: The Effect of Router Buffer Size on HighSpeedTCP Performancepeople.csail.mit.edu/gsmaragd/publications/Globecom2004/Globeco… · The Effect of Router Buffer Size on HighSpeedTCP](https://reader030.fdocuments.in/reader030/viewer/2022040605/5eab8485460e0e7c792a0e3c/html5/thumbnails/11.jpg)
11
,),(10∑=
=N
iii RTTp
Cλρ
)11
1(2)(,1
)1(1 K
K
iiK
K
KC
MSSdkRpρ
ρρρ
ρρ−
−−
+=−−
= +
,)()(0∑=
=K
ired idip π
⎪⎩
⎪⎨
⎧
>−
−≤
=−−
= +th
thth
th
th
K
j
kpkk
kdjmin,
)min(max)min(
min,0)(,
1)1()( max1ρρρπ
Analytical Loss Rate Derivation
Drop Tail [M/M/1/K/FCFS]
RED [M/M/1/K/RED]
![Page 12: The Effect of Router Buffer Size on HighSpeedTCP Performancepeople.csail.mit.edu/gsmaragd/publications/Globecom2004/Globeco… · The Effect of Router Buffer Size on HighSpeedTCP](https://reader030.fdocuments.in/reader030/viewer/2022040605/5eab8485460e0e7c792a0e3c/html5/thumbnails/12.jpg)
12
.
.
.
.
.
.
• In traffic mix, long flows (elephants) dominate buffer requirements
• Buffer size varies as fraction of bandwidth-delayproduct
Simulation Setup
Senders
Gigabit Bottleneck
Receivers
![Page 13: The Effect of Router Buffer Size on HighSpeedTCP Performancepeople.csail.mit.edu/gsmaragd/publications/Globecom2004/Globeco… · The Effect of Router Buffer Size on HighSpeedTCP](https://reader030.fdocuments.in/reader030/viewer/2022040605/5eab8485460e0e7c792a0e3c/html5/thumbnails/13.jpg)
13
Rule-of-Thumb Buffer Sizing
High utilization is achieved for a single flow or synchronized flows
![Page 14: The Effect of Router Buffer Size on HighSpeedTCP Performancepeople.csail.mit.edu/gsmaragd/publications/Globecom2004/Globeco… · The Effect of Router Buffer Size on HighSpeedTCP](https://reader030.fdocuments.in/reader030/viewer/2022040605/5eab8485460e0e7c792a0e3c/html5/thumbnails/14.jpg)
14
Unfairness
Reduced Buffer Sizing
•Worse RTT fairness•Increased synchronization•High Utilization
![Page 15: The Effect of Router Buffer Size on HighSpeedTCP Performancepeople.csail.mit.edu/gsmaragd/publications/Globecom2004/Globeco… · The Effect of Router Buffer Size on HighSpeedTCP](https://reader030.fdocuments.in/reader030/viewer/2022040605/5eab8485460e0e7c792a0e3c/html5/thumbnails/15.jpg)
15
1Gbps bottleneck10 desynchronized flows
2.5 Gbps bottleneck10 desynchronized flows
Reduced Buffer Size (DropTail)
High Utilization even with small buffer size is due to aggregation
![Page 16: The Effect of Router Buffer Size on HighSpeedTCP Performancepeople.csail.mit.edu/gsmaragd/publications/Globecom2004/Globeco… · The Effect of Router Buffer Size on HighSpeedTCP](https://reader030.fdocuments.in/reader030/viewer/2022040605/5eab8485460e0e7c792a0e3c/html5/thumbnails/16.jpg)
16
1Gbps bottleneck10 desynchronized flows
2.5 Gbps bottleneck10 desynchronized flows
Reduced Buffer Size (RED)
High Utilization is still achieved even with conservative behavior of RED.
![Page 17: The Effect of Router Buffer Size on HighSpeedTCP Performancepeople.csail.mit.edu/gsmaragd/publications/Globecom2004/Globeco… · The Effect of Router Buffer Size on HighSpeedTCP](https://reader030.fdocuments.in/reader030/viewer/2022040605/5eab8485460e0e7c792a0e3c/html5/thumbnails/17.jpg)
17
• Buffer size ≈ 10% of BDP suffices to maintain high Utilization > 90%
• Under high aggregation the results are insensitive to– Queue Management– Router Linespeed
• Small buffer size – worsens fairness among flows (due to less delay variability)– leads to synchronization (unlikely due to high aggregation
and path diversity)
Summary
![Page 18: The Effect of Router Buffer Size on HighSpeedTCP Performancepeople.csail.mit.edu/gsmaragd/publications/Globecom2004/Globeco… · The Effect of Router Buffer Size on HighSpeedTCP](https://reader030.fdocuments.in/reader030/viewer/2022040605/5eab8485460e0e7c792a0e3c/html5/thumbnails/18.jpg)
18
• Analytically quantify degree of aggregation for our results to hold
• Improve model considering unsynchronized losses• Experiments with other HighSpeed TCP variants
– e.g., FAST TCP which reacts to both packet loss and queueing delay
• Model the effect of router buffer size on other High Speed TCP features– Stability, Responsiveness
Future Work
![Page 19: The Effect of Router Buffer Size on HighSpeedTCP Performancepeople.csail.mit.edu/gsmaragd/publications/Globecom2004/Globeco… · The Effect of Router Buffer Size on HighSpeedTCP](https://reader030.fdocuments.in/reader030/viewer/2022040605/5eab8485460e0e7c792a0e3c/html5/thumbnails/19.jpg)
19