Complex System Approach to Internet Measurements
Transcript of Complex System Approach to Internet Measurements
Complex System Approach to Internet Measurements
The EVERGROW Measurement and Virtual Observatory Programs
ETOMIC DIMES
��������������� ���������� ������� � ��������������� ��� ���������� ��������
Measure Internet as a Complex System
• Internet is complex:
1. Complex network topology
2. Complex traffic on the links of the network
��������������� ���������� ������� � ��������������� ��� ���������� ��������
Measure Internet as a Complex System
• Internet is complex:
1. Complex network topology
2. Complex traffic on the links of the network
Erd s-Rényi model (1960)
- Democratic
- Random
������������������� ������
p=1/6N=10 �k� ~ 1.5 Poisson distribution
Connect withprobability p
Expected
P(k) ~ k-γ
Found
������������� ��
��� ���������� ��
R. Albert, H. Jeong, A-L Barabási
��������������� ���������� ������� � ��������������� ��� ���������� ��������
The Internet Structure
routers
��������������� ���������� ������� � ��������������� ��� ���������� ��������
The Internet Structure
The AS graph
The Structure of the Internet Graph
[Wax88] E-R graph [FFF99] power law• Dramatically changed the way
researchers view the Internet
• Become the standard simulation topology
k
Pr(k)
<k>
0 2 4 6 8 10 120
2
4
6
8
10
12
14
log(degree)
log(
Pr(
degr
ee))
DIMES+BGP (Feb 05)
��������������� ���������� ������� � ��������������� ��� ���������� ��������
What is EVERGROW DIMES?
• Distributed Internet measurement and monitoring– Based on agents downloaded by volunteers
from www.netdimes.org
• Aims– Static Internet maps at all granularity level
• connectivity, delay, loss, bandwidth, jitter, ….
– Tracking the Internet evolution in time– Correlating social/ecomonic/political evolution
with the Internet evolution
��������������� ���������� ������� � ��������������� ��� ���������� ��������
How to get AS level data? (1)
• BGP listeners– Listen to as many as possible BGP announcers– RouteViews at University of Oregon: close to 70– Problems:
• What about non BGP connections:– static inter-domain connections
• Non broadcasted BGP entries• Many BGP links are filtered• biased
��������������� ���������� ������� � ��������������� ��� ���������� ��������
How to get AS level data? (2)
• Active traceroute from a few pointstoo many links are missed
measurements traffic is too dense
��������������� ���������� ������� � ��������������� ��� ���������� ��������
• Active traceroute from a few pointstoo many links are missed
measurements traffic is too dense
How to get AS level data? (2)
��������������� ���������� ������� � ��������������� ��� ���������� ��������
• Active traceroute from a few pointstoo many links are missed
measurements traffic is too dense
How to get AS level data? (2)
��������������� ���������� ������� � ��������������� ��� ���������� ��������
• Active traceroute from a few pointstoo many links are missed
measurements traffic is too dense
• Increase the number– Equipment & management costs are too high
– See NIMI
How to get AS level data? (2)
��������������� ���������� ������� � ��������������� ��� ���������� ��������
Our Solution
• Let the network measure itself• Persuade people to download our
measurement DIMES agent• Carry on experiments to measure and map
the Internet and track its growth.• Target:
– 1,000s of users in first year– ������s of users in three years
Agent screenshot
��������������� ���������� ������� � ��������������� ��� ���������� ��������
Current Status
• About 830 agents– 50 countries
– All continents
– Over 150 ASes
– More than 140 are active daily
• Over 150,000 measurements a day
Agents by CountryArgentina
Australia
Austria
Belgium
Brazil
Canada
China
Croatia
Czech Republic
Denmark
Egypt
Estonia
Finland
France
Germany
Greece
Hong Kong
Hungary
India
Israel
Italy
Japan
Korea (Republic of )
Latvia
Lithuania
Luxembourg
Malaysia
N/A
Namibia
Netherlands
USA
Israel
UK
Sweden
Ger.
Den .
Hun.
Fr.
Ita ly
Can.
Mar 2005
DIMES Agents in Europe
Iberia AS Map
Hungary AS Map
AS map on March 1st
BGP
• ~19,500 nodes
• ~48,400 edges
• <k> = 4.96
DIMES
• ~14,700 nodes
• ~38,750 edges
• <k> = 5.34
38,600 edges �So what has DIMES discovered?
9,800 edges
AS map on March 1st
BGP
• ~19,500 nodes
• ~48,400 edges
• <k> = 4.96
DIMES
• ~14,700 nodes
• ~38,750 edges
• <k> = 5.34
38,600 edges 27,400 in both maps
11,300 new edges9,800 edges +
59,700 edges <k> > 6.12
��������������� ���������� ������� � ��������������� ��� ���������� ��������
DIMES Future
• DIMES as a leading research tool
– Data will be available to all
– Easy to run distributed experiments• Fast deploy cycle
– Easy to add new measurement capabilities
• Plug-ins to improve applications– P2P communication
– Web download (in process)
Measure Internet as a Complex System
• Internet is complex:
1. Complex network topology
2. Complex traffic on the links of the network
��������������� ���������� ������� � ��������������� ��� ���������� ��������
What is ETOMIC ?
• Evergrow Traffic Observatory MeasurementInfrastruCturewww.etomic.org
• Measurement stationsdistributed in Europe, capableto carry out precise, global time synchronizedmeasurements
• Central management system, to carry uploadmeasurement code, reservemeasurement time, tocollect the results (no need to hack)
• high precision to inject super accurate flashesofpacket trains into thenetwork
Fukuda &Takayasu 1999
Router-to-router congestion propagation
Simulation results: 10 queues, 10 TCP
50 queues, 1 TCP/queuedeffect propagation
��������������� ���������� ������� � ��������������� ��� ���������� ��������
Interacting traffic flows
• Traffic flows crossing the same bottleneck can inherit Long RangeDependence from each other
Partsof themeasurement infrastructure
WANWAN
IBM BladeCenter
SWITCH/LAN
ETOM
RS 422 MAX. 100M
1000BaseTX for DAG
1000BaseTX LAN
1000BaseTX LAN
GPS
PCPC
��������������� ���������� ������� � ��������������� ��� ���������� ��������
The server PC of thestation• Intel Pentium4 2.6GHz• Intel S875WP1-E (Winterpack)
single motherboard, 800MHz FSB, dual ECC mem
• Kingston 1GB (2*512MB) ECC DDRAM 400 MHz
• 1 Gbit/s + 100Mbit/s Intel integrated NIC
• 2 channel integrated Serial ATA RAID
• 200Gb Serial ATA 7200 RPM 8MB cache Seagate Barracuda Winchester
��������������� ���������� ������� � ��������������� ��� ���������� ��������
The GPS receiver module
• Garmin 35HVS GPS reciver
• 1 us PPS signal
• RS 232 – RS 422 converter – max 100m cable
GPSRS232RS232-->422>422
RS422RS422-->232>232
Serial portSerial port
DAG PPSDAG PPS
PCPC
��������������� ���������� ������� � ��������������� ��� ���������� ��������
The EndaceDAG 3.6GE card
• PCI bus – 32 bit 33 Mhz
• Single port full packet captureat 10/100/1000 Mbit/s speed
• precise timestamping
��������������� ���������� ������� � ��������������� ��� ���������� ��������
Burst of Patterned Traffic Generator
• intended to send IPv4 Packets within Ethernet frames at full-rate 10/100/1000 Mbit/s using precisely defined frame sizes, frame contents and inter-frame delays
• Automatic ID increment and timestamps
• target applications: available bandwidth measurements (packet pair, quartet), network tomography, new fast transmit layer development
��������������� ���������� ������� � ��������������� ��� ���������� ��������
Measurement scenarios
• Passive– SPAN port, splitter, HUB or tap needed
• Active:– NIC to NIC
– NIC to DAG
– DAG to DAG
ETOMIC stations in Europe
Evergrow Traffic ObservatoryManagement System (ETOMS)
Your measurement is just a click away!
What can wemeasure?
• High precision propagation delay of IP packets
The ETOMIC overlay
SICSStockholm, Sweden
TeliaSoneraStockholm, Sweden
ELTEBudapest, Hungary
157.181.141.9
UNIVBudapest, Hungary
62.40.96.58
62.40.96.62
HUJIJerusalem, Israel
UniNavarraPamplona, Spain
EricssonStockholm, Sweden
0.0005 ms
0.012 ms
0.0921 ms
0.0085 ms
0.0754 ms
0.028 ms
0.0078 ms
0.086 ms
0.1617 ms
Network tomography
Plans for the future3-15 months
• ETOMS opens in June2005 for thegeneral public
• ETOMIC – ETOMIC network tomograpy (15 X 15)
• DIMES – ETOMIC network tomography (1000 X 15)
• a livemap of theEuropean network traffic from theautumn of 2005
• public databasebuilding
• network oriented databasebuilding
��������������� ���������� ������� � ��������������� ��� ���������� ��������
Possiblecollaborations with IPS MoMe
• Evergrow can contribute to the IPS MoMe dataset• Evergrow can collaborate on data standards• Evergrow can collaborateon analysis methods
• Jointly lobbying at GÉANT
• You can download DIMES from www.netdimes.org• You can host our ETOMIC station in your lab• You can design your activemeasurement on ETOMS
involving thestation of your lab• Wecan host your stations as well
EVERGROW needs you!
Join our effort! Deploy an ETOMIC box! Download a DIMES agent! Do your own measurement!
www.netdimes.org www.etomic.org
��������������� ���������� ������� � ��������������� ��� ���������� ��������
Speed of light in cableJ
��������������� ���������� ������� � ��������������� ��� ���������� ��������
Evergrow BladeCenters