Intelligent Proxy Server in TANET/TWAREN
Transcript of Intelligent Proxy Server in TANET/TWAREN
![Page 1: Intelligent Proxy Server in TANET/TWAREN](https://reader035.fdocuments.in/reader035/viewer/2022071602/613d5aaa736caf36b75c5599/html5/thumbnails/1.jpg)
Intelligent Proxy Serverin TANET/TWAREN
National Chi Nan University
Ya‐Ling Wang,
Ying‐Chieh Chang,
Quincy Wu
Chinese paper published in ITIA 2010.
![Page 2: Intelligent Proxy Server in TANET/TWAREN](https://reader035.fdocuments.in/reader035/viewer/2022071602/613d5aaa736caf36b75c5599/html5/thumbnails/2.jpg)
Introduction
• The choice of web proxy servers
• The best proxy server?
• Priori speed tests
• The fastest proxy server
• Experimental result : Better
2010/07/10 NCNU YaLing, Wang 2
![Page 3: Intelligent Proxy Server in TANET/TWAREN](https://reader035.fdocuments.in/reader035/viewer/2022071602/613d5aaa736caf36b75c5599/html5/thumbnails/3.jpg)
Default Proxy Server
2010/07/10 3NCNU YaLing, Wang
TANETProxy Server
NCNUProxy Server
TWAREN 線路
TANET 線路
TWARENProxy Server
USER
.edu .org .gov .jp .cn .hk .vn
.th .kr .in .my .ph .sg .ca .nz
TANETProxy Server
TWARENProxy Server
Foreign sitesTANET
TWARENTWAREN
TANET
NCNUProxy Server
![Page 4: Intelligent Proxy Server in TANET/TWAREN](https://reader035.fdocuments.in/reader035/viewer/2022071602/613d5aaa736caf36b75c5599/html5/thumbnails/4.jpg)
Intelligent Proxy Server
2010/07/10 NCNU YaLing, Wang 4
TANETProxy Server
TWARENProxy Server
NCNUProxy Server
USER
![Page 5: Intelligent Proxy Server in TANET/TWAREN](https://reader035.fdocuments.in/reader035/viewer/2022071602/613d5aaa736caf36b75c5599/html5/thumbnails/5.jpg)
System Components
• CentOS 5.4 – Linux operating system
• Squid version 3.1 – http proxy server
• Report generator– Webalizer
– Sarg
• Upstream proxy server– TWAREN : proxy1.twaren.net
– TANET : proxy.moe.edu.tw
2010/07/10 5NCNU YaLing, Wang
![Page 6: Intelligent Proxy Server in TANET/TWAREN](https://reader035.fdocuments.in/reader035/viewer/2022071602/613d5aaa736caf36b75c5599/html5/thumbnails/6.jpg)
Data Collection Process
2010/07/10 NCNU YaLing, Wang 6
Start
For each URL in the access log
Extract the hostname part
Perform the speed test
Depending on which proxy server provides the fastest service, save the hostname in
1. list.twaren2. list.tanet 3. list.ncnu
The squid access.log contains recently used URLs
Each site will be stored in the fastest proxy server list. There are three proxy servers, so at the end we shall have three lists.
root crontab:Perform the test at 4AM in every morning
Download a file from the host
![Page 7: Intelligent Proxy Server in TANET/TWAREN](https://reader035.fdocuments.in/reader035/viewer/2022071602/613d5aaa736caf36b75c5599/html5/thumbnails/7.jpg)
Data Collection Process
2010/07/10 NCNU YaLing, Wang 7
Remove the hostname from other lists if it is in those lists
Delete this host from other lists
YES
Merge squid.conf file
End
You can do reload later.
Get a site from the list of a proxy server, the new rules will be the fastest, to merge with the original profile.
NO
![Page 8: Intelligent Proxy Server in TANET/TWAREN](https://reader035.fdocuments.in/reader035/viewer/2022071602/613d5aaa736caf36b75c5599/html5/thumbnails/8.jpg)
Data Collection Process
2010/07/10 NCNU YaLing, Wang 8
Today
NCNU proxy server list
www.google.com
TWAREN proxy server list
TANET proxy server list
Yesterday
www.google.comwww.google.com
www.google.com
![Page 9: Intelligent Proxy Server in TANET/TWAREN](https://reader035.fdocuments.in/reader035/viewer/2022071602/613d5aaa736caf36b75c5599/html5/thumbnails/9.jpg)
Data Collection Process
2010/07/10 NCNU YaLing, Wang 9
A
B
![Page 10: Intelligent Proxy Server in TANET/TWAREN](https://reader035.fdocuments.in/reader035/viewer/2022071602/613d5aaa736caf36b75c5599/html5/thumbnails/10.jpg)
Data Collection Process
2010/07/10 NCNU YaLing, Wang 10
A
TANET proxy server list
TWAREN proxy server list
C
Squid ConfigBNCNU proxy server list
![Page 11: Intelligent Proxy Server in TANET/TWAREN](https://reader035.fdocuments.in/reader035/viewer/2022071602/613d5aaa736caf36b75c5599/html5/thumbnails/11.jpg)
Experimental Results
2010/07/10 11NCNU YaLing, Wang
NCNU school inflows rankings
![Page 12: Intelligent Proxy Server in TANET/TWAREN](https://reader035.fdocuments.in/reader035/viewer/2022071602/613d5aaa736caf36b75c5599/html5/thumbnails/12.jpg)
Experimental Results
2010/07/10 12NCNU YaLing, Wang
Date:2010/05/073191
![Page 13: Intelligent Proxy Server in TANET/TWAREN](https://reader035.fdocuments.in/reader035/viewer/2022071602/613d5aaa736caf36b75c5599/html5/thumbnails/13.jpg)
Experimental Results
2010/07/10 NCNU YaLing, Wang 13
Date:2010/05/11157
![Page 14: Intelligent Proxy Server in TANET/TWAREN](https://reader035.fdocuments.in/reader035/viewer/2022071602/613d5aaa736caf36b75c5599/html5/thumbnails/14.jpg)
Conclusion
• More User
• More Webpages
• More Accurate
• More Upstream Proxy Server
→ Automatic, Learning, Intelligent Proxy Server
2010/07/10 14NCNU YaLing, Wang
![Page 15: Intelligent Proxy Server in TANET/TWAREN](https://reader035.fdocuments.in/reader035/viewer/2022071602/613d5aaa736caf36b75c5599/html5/thumbnails/15.jpg)
Future Work
• Re‐use the perfSONAR system on Internet2 for bandwidth measurement.
• Re‐use network routing table to choose the “shortest” path.
2010/07/10 15NCNU YaLing, Wang
![Page 16: Intelligent Proxy Server in TANET/TWAREN](https://reader035.fdocuments.in/reader035/viewer/2022071602/613d5aaa736caf36b75c5599/html5/thumbnails/16.jpg)
Any Question?
ENDThanks for your listening
2010/07/10 16NCNU YaLing, Wang
![Page 17: Intelligent Proxy Server in TANET/TWAREN](https://reader035.fdocuments.in/reader035/viewer/2022071602/613d5aaa736caf36b75c5599/html5/thumbnails/17.jpg)
Measurement Tools
• http_ping –proxy ServerName:Port URL
2010/07/10 17NCNU YaLing, Wang
![Page 18: Intelligent Proxy Server in TANET/TWAREN](https://reader035.fdocuments.in/reader035/viewer/2022071602/613d5aaa736caf36b75c5599/html5/thumbnails/18.jpg)
Measurement Tools
• Useful options– http_ping –proxy ServerName:Port
– http_ping –count Number of retries
• Commands in our experiments
2010/07/10 18NCNU YaLing, Wang