Processing delay Information Theory and Networks

26
Information Theory and Networks Lecture 27: A Brief History of Networks Matthew Roughan <[email protected]> http://www.maths.adelaide.edu.au/matthew.roughan/ Lecture_notes/InformationTheory/ School of Mathematical Sciences, University of Adelaide September 20, 2013 Processing delay Matthew Roughan (School of Mathematical Sciences, Information Theory September 20, 2013 2 / 57 Section 1 Computer Networks Matthew Roughan (School of Mathematical Sciences, Information Theory September 20, 2013 3 / 57 Section 1 Computer Networks 2013-09-20 Information Theory Computer Networks Computer networks are a recent invention (in human history), but they have been around for longer than some of you may think. In this lecture we consider the underlying drivers in computer networks, and how this subject fits with the ongoing development of those networks.

Transcript of Processing delay Information Theory and Networks

Page 1: Processing delay Information Theory and Networks

Information Theory and NetworksLecture 27: A Brief History of Networks

Matthew Roughan<[email protected]>

http://www.maths.adelaide.edu.au/matthew.roughan/

Lecture_notes/InformationTheory/

School of Mathematical Sciences,University of Adelaide

September 20, 2013

Processing delay

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 2 / 57

Section 1

Computer Networks

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 3 / 57

Section 1

Computer Networks

20

13

-09

-20

Information Theory

Computer Networks

Computer networks are a recent invention (in human history), but they

have been around for longer than some of you may think. In this lecture

we consider the underlying drivers in computer networks, and how this

subject fits with the ongoing development of those networks.

Page 2: Processing delay Information Theory and Networks

Computer pre-history

The original “computers” were peopleI numerical algorithms performed with pencil and paperI later with mechanical adding machines

Algorithms were often parallelizedI multiple computers worked on same problem to speed up or check

calculationsI a “computer network” was result of passing bits of paper

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 4 / 57

Computer pre-history

The original “computers” were peopleI numerical algorithms performed with pencil and paperI later with mechanical adding machines

Algorithms were often parallelizedI multiple computers worked on same problem to speed up or check

calculationsI a “computer network” was result of passing bits of paper

20

13

-09

-20

Information Theory

Computer Networks

Computer pre-history

20th century

Computer networks:

First generation of electrical digital computers 1940s

Second generation – late 1950s and early 1960sI transistor invented in 1947 (at AT&T)I direct networks: peripherals such as printers directly attached to

computers

Third generation, post-1964I integrated circuitsI real computer networks start

1965, Moore’s law discoveredI computers get better and better ...

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 5 / 57

20th century

Computer networks:

First generation of electrical digital computers 1940s

Second generation – late 1950s and early 1960sI transistor invented in 1947 (at AT&T)I direct networks: peripherals such as printers directly attached to

computers

Third generation, post-1964I integrated circuitsI real computer networks start

1965, Moore’s law discoveredI computers get better and better ...

20

13

-09

-20

Information Theory

Computer Networks

20th century

Page 3: Processing delay Information Theory and Networks

Moore’s LawMoore’s law: the speed of digital hardware increases by a factor of twoevery 18 months, or the number of transistors on a chip doubles, or thecost halves [Moo65].

1970 1975 1980 1985 1990 1995 2000 2005 1000

10000

100000

1000000

10000000

100000000

1000000000

4004

80088080

8086

286386

486

PentiumPentiumII

PentiumIII

Pentium4

Itanium

Itanium2

Itanium2(a)

transis

tor

count

Actually looks more like a factor of 2 every 2 years.Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 6 / 57

Moore’s LawMoore’s law: the speed of digital hardware increases by a factor of twoevery 18 months, or the number of transistors on a chip doubles, or thecost halves [Moo65].

1970 1975 1980 1985 1990 1995 2000 2005 1000

10000

100000

1000000

10000000

100000000

1000000000

4004

80088080

8086

286386

486

PentiumPentiumII

PentiumIII

Pentium4

Itanium

Itanium2

Itanium2(a)

tra

nsis

tor

co

un

t

Actually looks more like a factor of 2 every 2 years.

20

13

-09

-20

Information Theory

Computer Networks

Moore’s Law

Intel’s pages on Moore’s law:http://www.intel.com/technology/mooreslaw/index.htm

ftp://download.intel.com/research/silicon/moorespaper.pdf

Other links to Moore’s law:http://en.wikipedia.org/wiki/Moore’s_law

http://www.thocp.net/biographies/papers/moores_law.htm

http://www.firstmonday.org/issues/issue7_11/tuomi/

http://www.hyperdictionary.com/computing/moore’s+law

http:

//www.physics.udel.edu/wwwusers/watson/scen103/intel.html

http://www.ziplink.net/~lroberts/Forecast69.htm

Gilder’s Law

Gilder’s law: theoretical transmission capacity of a link increases by afactor of two every 12 months.

http://www.seas.upenn.edu/~gaj1/promise.html

http://www.dtc.umn.edu/~odlyzko/doc/tv.internet.txt

http://telecomvisions.com/articles/beyondip/

transmission capacity is still behind storageI 2000, backbones in US carried 144 PB/year, total disk capacity 3000

PBF it would take 20 years to carry all the data

I 2005, 100 GB disk is common, 1.5 MbpsF it would take 6 days to carry all the data

I network is catching up?

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 7 / 57

Gilder’s Law

Gilder’s law: theoretical transmission capacity of a link increases by afactor of two every 12 months.

http://www.seas.upenn.edu/~gaj1/promise.html

http://www.dtc.umn.edu/~odlyzko/doc/tv.internet.txt

http://telecomvisions.com/articles/beyondip/

transmission capacity is still behind storageI 2000, backbones in US carried 144 PB/year, total disk capacity 3000

PBF it would take 20 years to carry all the data

I 2005, 100 GB disk is common, 1.5 MbpsF it would take 6 days to carry all the data

I network is catching up?20

13

-09

-20

Information Theory

Computer Networks

Gilder’s Law

”I returned, and saw under the sun, that the race is not to the swift, northe battle to the strong, neither yet bread to the wise, nor yet riches tomen of understanding, nor yet favor to men of skill; but time and chancehappeneth to them all.”

Ecclesiastes 9:11

The race is not always to the swift, nor the battle to the strong, butthat’s the way to bet.

Anon

Page 4: Processing delay Information Theory and Networks

Networking drivers

Moore’s law drives PC business

Gilder’s law drives networksI something suss here – lets discuss later

Metcalfe’s law also drives the InternetI The value of a network is proportional to the square of the number of

users.I hence the failure of many “video-phone” trials

F but success of most recent “camera phones”

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 8 / 57

Networking drivers

Moore’s law drives PC business

Gilder’s law drives networksI something suss here – lets discuss later

Metcalfe’s law also drives the InternetI The value of a network is proportional to the square of the number of

users.I hence the failure of many “video-phone” trials

F but success of most recent “camera phones”

20

13

-09

-20

Information Theory

Computer Networks

Networking drivers

The Internet

Leonard Kleinrock at MIT published the first paper on packetswitching theory in, July 1961 [L.K61].

J.C.R. Licklider of MIT wrote memos “Galactic Network”, and laterconvinced DARPA to fund, 1962.

Baran defence proposal for robust network was a packet switchednetwork, 1962 [Bar64].

Thomas Merrill, Larry Roberts, first network 1965

Roberts’s plan for the ”ARPANET”, published 1967

IMP’s (built by BBN) connected 1968-69

1972: First public demo, e-mail invented

Vinton Cerf and Robert Kahn, TCP/IP, 1973http://www.isoc.org/internet/history/brief.shtml

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 9 / 57

The Internet

Leonard Kleinrock at MIT published the first paper on packetswitching theory in, July 1961 [L.K61].

J.C.R. Licklider of MIT wrote memos “Galactic Network”, and laterconvinced DARPA to fund, 1962.

Baran defence proposal for robust network was a packet switchednetwork, 1962 [Bar64].

Thomas Merrill, Larry Roberts, first network 1965

Roberts’s plan for the ”ARPANET”, published 1967

IMP’s (built by BBN) connected 1968-69

1972: First public demo, e-mail invented

Vinton Cerf and Robert Kahn, TCP/IP, 1973http://www.isoc.org/internet/history/brief.shtml2

01

3-0

9-2

0

Information Theory

Computer Networks

The Internet

FEBRUARY, 2005: The Association for Computing Machinery (ACM)awarded Internet pioneers Vinton Cerf and Robert Kahn the TuringAward (often considered the Nobel Prize of Computing) for “pioneeringwork on internetworking, including the design and implementation of theInternet’s basic communications protocols, TCP/IP, and for inspiredleadership in networking.”http://www.acm.org/awards/turing_citations/cerf_kahn.html

Page 5: Processing delay Information Theory and Networks

The Early Internet

Paul Baran, 1960s, envisioned a comm.s network that would survive a major

enemy attack. The sketch shows three network topologies described in [Bar64].

decentralizedcentralized distributed

Original available athttp://www.cybergeography.org/atlas/historical.html

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 10 / 57

The Early Internet

Paul Baran, 1960s, envisioned a comm.s network that would survive a major

enemy attack. The sketch shows three network topologies described in [Bar64].

decentralizedcentralized distributed

Original available athttp://www.cybergeography.org/atlas/historical.html

20

13

-09

-20

Information Theory

Computer Networks

The Early Internet

The centralized network is highly vulnerable to damage to it centralnode, and other nodes will be detached from the network by link failures

The distributed network structure has best survivability.

The Early InternetA rough sketch map of the possible topology of ARPANET by LarryRoberts. Drawn in the late 1960s as part of the planning for thenetwork [HL96, p.50].

http://www.cybergeography.org/atlas/historical.html

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 11 / 57

The Early InternetA rough sketch map of the possible topology of ARPANET by LarryRoberts. Drawn in the late 1960s as part of the planning for thenetwork [HL96, p.50].

http://www.cybergeography.org/atlas/historical.html

20

13

-09

-20

Information Theory

Computer Networks

The Early Internet

Early on, the ARPANET was small enough to design on the back of an

envelope. This is rarely possible for todays networks.

Page 6: Processing delay Information Theory and Networks

The Early InternetThe first node on ARPANET at University California Los Angeles (UCLA)on the 2nd of September 1969 [CK90].

IMP = Interface Message Processorwhat we would call a router

TIP = Terminal IMPIMP to which terminals can directly connect

Host = computer (which provides services)

Available athttp://www.cybergeography.org/atlas/historical.html

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 12 / 57

The Early InternetThe first node on ARPANET at University California Los Angeles (UCLA)on the 2nd of September 1969 [CK90].

IMP = Interface Message Processorwhat we would call a router

TIP = Terminal IMPIMP to which terminals can directly connect

Host = computer (which provides services)

Available athttp://www.cybergeography.org/atlas/historical.html

20

13

-09

-20

Information Theory

Computer Networks

The Early Internet

The Early InternetDec 1969 ”ARPA NETWORK”. 4 nodes: Uni. of California Los Angeles (UCLA),

Uni. of California Santa Barbara (UCSB), Uni. of Utah and the Stanford

Research Institute (SRI) [CK90].

Available athttp://www.cybergeography.org/atlas/historical.html

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 13 / 57

The Early InternetDec 1969 ”ARPA NETWORK”. 4 nodes: Uni. of California Los Angeles (UCLA),

Uni. of California Santa Barbara (UCSB), Uni. of Utah and the Stanford

Research Institute (SRI) [CK90].

Available athttp://www.cybergeography.org/atlas/historical.html

20

13

-09

-20

Information Theory

Computer Networks

The Early Internet

The first letters transmitted on the Internet were “lo”, transmittedbetween SRI and UCLA on October 29, 1969. The letters were thebeginning of “login” of which only the first two letters were sent beforethe system crashed.

http://www.lk.cs.ucla.edu/first_words.html

Page 7: Processing delay Information Theory and Networks

The Internet: the 80’s

new developmentsI Personal Computers (PCs)

⇒ lots more computers to networkI Ethernet (1973, Robert Metcalfe) creates LANs

the InternetI TCP/IP provides a way to hook up the LANs and PC over wide areas

(standard in 1980)I scale gets bigger

F numbers increaseF becomes international

I partitioningF ARPANET splits into MILNET and ARPANET in early 80’s, followed

by further additions

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 14 / 57

The Internet: the 80’s

new developmentsI Personal Computers (PCs)

⇒ lots more computers to networkI Ethernet (1973, Robert Metcalfe) creates LANs

the InternetI TCP/IP provides a way to hook up the LANs and PC over wide areas

(standard in 1980)I scale gets bigger

F numbers increaseF becomes international

I partitioningF ARPANET splits into MILNET and ARPANET in early 80’s, followed

by further additions20

13

-09

-20

Information Theory

Computer Networks

The Internet: the 80’s

The Internet: the 80’sARPANET/MILNET [CK90].

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 15 / 57

The Internet: the 80’sARPANET/MILNET [CK90].

20

13

-09

-20

Information Theory

Computer Networks

The Internet: the 80’s

Page 8: Processing delay Information Theory and Networks

The Internet: the 90’s

ARPANET decommissioned 1990I NSF Backbone connects many other networks

F Australia connected in 1990 [Abb99]

It was the first, and being first, was best,

but now we lay it down to rest.

Now pause with me a moment, shed some tears.

For auld lange syne, for love, for years and years

of faithful service, duty done, I weep.

Lay down thy packet, now, O friend, and sleep.

Vinton Cerf, 1989commercial Internet services evolve

I 1995 NSFNET terminated (replaced by vBNS)I effectively fully privatised InternetI links through exchange points

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 16 / 57

The Internet: the 90’s

ARPANET decommissioned 1990I NSF Backbone connects many other networks

F Australia connected in 1990 [Abb99]

It was the first, and being first, was best,

but now we lay it down to rest.

Now pause with me a moment, shed some tears.

For auld lange syne, for love, for years and years

of faithful service, duty done, I weep.

Lay down thy packet, now, O friend, and sleep.

Vinton Cerf, 1989commercial Internet services evolve

I 1995 NSFNET terminated (replaced by vBNS)I effectively fully privatised InternetI links through exchange points

20

13

-09

-20

Information Theory

Computer Networks

The Internet: the 90’s

The Internet: the 90’sAustralia’s network 1991

http://www.ucs.ed.ac.uk/fmd/unix/edftp/pub/maps/

New networkhttp://www.aarnet.edu.au/engineering/aarnet3/

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 17 / 57

The Internet: the 90’sAustralia’s network 1991

http://www.ucs.ed.ac.uk/fmd/unix/edftp/pub/maps/

New networkhttp://www.aarnet.edu.au/engineering/aarnet3/

20

13

-09

-20

Information Theory

Computer Networks

The Internet: the 90’s

Page 9: Processing delay Information Theory and Networks

The Internet: the 90’s

http://www.w3.org/History.html

1990: World Wide WebTim Berners-Lee created HyperText Markup Language, or HTML.Along with URL (Uniform Resource Locators), and HTTP(HyperText Transfer Protocol), created the web. Based on earlierwork at CERN (1980).

1993: Mosaic (Marc Andreesen, NCSA)Mosaic became the first popular web browser. It was not only easy touse to access the World Wide Web, but it was also extremely easy todownload and install!

Killer app =¿ the Internet takes off in a big way

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 18 / 57

The Internet: the 90’s

http://www.w3.org/History.html

1990: World Wide WebTim Berners-Lee created HyperText Markup Language, or HTML.Along with URL (Uniform Resource Locators), and HTTP(HyperText Transfer Protocol), created the web. Based on earlierwork at CERN (1980).

1993: Mosaic (Marc Andreesen, NCSA)Mosaic became the first popular web browser. It was not only easy touse to access the World Wide Web, but it was also extremely easy todownload and install!

Killer app =¿ the Internet takes off in a big way20

13

-09

-20

Information Theory

Computer Networks

The Internet: the 90’s

Early Internet Bandwidth Growth

All the time backbone link speeds have been growing1969: 50kbps

1988: NSFNET backbone upgraded to T1 (1.544Mbps)

1991: NSFNET backbone upgraded to T3 (44.736Mbps)

1996: MCI upgrades Internet backbone 622Mbps

1999: MCI/Worldcom begins upgrading the US backbone to 2.5 Gbps(OC48)

circa 2003: 10 Gbps (OC192)Backbone speeds are behind limits of transmission tech.http://www.zakon.org/robert/internet/timeline/

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 19 / 57

Early Internet Bandwidth Growth

All the time backbone link speeds have been growing1969: 50kbps

1988: NSFNET backbone upgraded to T1 (1.544Mbps)

1991: NSFNET backbone upgraded to T3 (44.736Mbps)

1996: MCI upgrades Internet backbone 622Mbps

1999: MCI/Worldcom begins upgrading the US backbone to 2.5 Gbps(OC48)

circa 2003: 10 Gbps (OC192)Backbone speeds are behind limits of transmission tech.http://www.zakon.org/robert/internet/timeline/

20

13

-09

-20

Information Theory

Computer Networks

Early Internet Bandwidth Growth

Page 10: Processing delay Information Theory and Networks

Backbone link speed growth

Roughly doubles every two years (45% per year)

Backbone link bandwidth in kbps

1960 1980 2000 2020

101

103

105

107

109

backbone bandwidth in kbps

Note that extra links are added every year

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 20 / 57

Backbone link speed growth

Roughly doubles every two years (45% per year)

Backbone link bandwidth in kbps

1960 1980 2000 2020

101

103

105

107

109

backbone bandwidth in kbps

Note that extra links are added every year

20

13

-09

-20

Information Theory

Computer Networks

Backbone link speed growth

Early Internet Bandwidth Growth

Access link speeds grow as well

Nielsen’s Law of Internet BandwidthI a high-end user’s connection speed grows by 50% per yearI http://www.useit.com/alertbox/980405.html

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 21 / 57

Early Internet Bandwidth Growth

Access link speeds grow as well

Nielsen’s Law of Internet BandwidthI a high-end user’s connection speed grows by 50% per yearI http://www.useit.com/alertbox/980405.html

20

13

-09

-20

Information Theory

Computer Networks

Early Internet Bandwidth Growth

Page 11: Processing delay Information Theory and Networks

Internet Traffic GrowthTraffic roughly doubles every year [Odl03].

Traffic in TB per month

1990 1995 2000 200510

0

101

102

103

104

105

106

Combination of new users and higher bandwidth!Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 22 / 57

Internet Traffic GrowthTraffic roughly doubles every year [Odl03].

Traffic in TB per month

1990 1995 2000 200510

0

101

102

103

104

105

106

Combination of new users and higher bandwidth!

20

13

-09

-20

Information Theory

Computer Networks

Internet Traffic Growth

Internet traffic was believed to overtake telephone traffic around 2002.

Extrapolated Internet growth from 90’s data.

http://www.cc.gatech.edu/gvu/stats/NSF/Extrap.GIF

Australian Traffic Growth

2000 2002 2004 2006 2008 2010 2012 201410

−1

100

101

102

103

traffic

(P

B/q

uart

er)

www.abs.gov.au

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 23 / 57

Australian Traffic Growth

2000 2002 2004 2006 2008 2010 2012 201410

−1

100

101

102

103

tra

ffic

(P

B/q

ua

rte

r)

www.abs.gov.au

20

13

-09

-20

Information Theory

Computer Networks

Australian Traffic Growth

Measurements taken from the Australian Bureau of Statistics: seehttp://www.abs.gov.au/ausstats/[email protected]/mf/8153.0/

2000 2002 2004 2006 2008 2010 2012 20140

100

200

300

400

500

600

traffic

(P

B/q

uart

er)

Page 12: Processing delay Information Theory and Networks

Part I

A Brief History of Communications Networks

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 24 / 57

You know what they say. Those of us who fail history, aredoomed to repeat it in summer school.

Buffy (the Vampire Slayer), “After Life” (Season6, Ep. 3), 2001

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 25 / 57

You know what they say. Those of us who fail history, aredoomed to repeat it in summer school.

Buffy (the Vampire Slayer), “After Life” (Season6, Ep. 3), 2001

20

13

-09

-20

Information Theory

Why bother?

� ideas have their time

– most things are invented for a need– this gives insight into network design

� most things in networking are reinvented again and again

– can save a lot of time if you already know the answer

� gentle introduction to some concepts

Dumb network designOne link between every pair who wish to speak

N=4

L=6

N=5

L=9

2

1

3

54

1 2

43

N nodes, then we have L=N(N-1)/2 linksMatthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 26 / 57

Page 13: Processing delay Information Theory and Networks

Dumb network designOne link between every pair who wish to speak

N=4

L=6

N=5

L=9

2

1

3

54

1 2

43

N nodes, then we have L=N(N-1)/2 links

20

13

-09

-20

Information Theory

Dumb network design

Dumb network design

Pratt, Kansas

http://www.bellsystemmemorial.com/oldphotos_6.html

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 27 / 57

Dumb network design

Pratt, Kansas

http://www.bellsystemmemorial.com/oldphotos_6.html

20

13

-09

-20

Information Theory

Dumb network design

PUT BACK PARTS ON SWITCHING

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 28 / 57

Page 14: Processing delay Information Theory and Networks

Towards modern telephony

switchingI electronic switch (instead of electromechanical)I 4ESS (like a building)

http://www.att.com/history/nethistory/switching.html

networks become hierachicalI long distance versus local

reliability and redundancy become importantI alternate routing

billing systemsI harder than you think!

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 28 / 57

Towards modern telephony

switchingI electronic switch (instead of electromechanical)I 4ESS (like a building)

http://www.att.com/history/nethistory/switching.html

networks become hierachicalI long distance versus local

reliability and redundancy become importantI alternate routing

billing systemsI harder than you think!

20

13

-09

-20

Information Theory

Towards modern telephony

Some additional linksMore detailed telephony timelines can be found athttp://www.telephonetribute.com/timeline.htmlhttp://www2.fht-esslingen.de/telehistory/http://www.webbconsult.com/hist-time.htmlhttp://www.ieee.org/organizations/history_center/comsoc/

timelines.htmlhttp://williamstallings.com/Extras/Telecom.htmlhttp://aronsson.se/hist.html

Histories of computing and computer networkshttp://en.wikipedia.org/wiki/Computing_timelinehttp://www.isoc.org/internet/history/http://www.isoc.org/internet/history/brief.shtmlhttp://www.dei.isep.ipp.pt/docs/arpa.htmlhttp://www.zakon.org/robert/internet/timeline/http://en.wikipedia.org/wiki/History_of_the_Internethttp://goldenink.com/computersandnetworks.shtmlhttp://www.davesite.com/webstation/net-history.shtmlhttp://www.computerhistory.org/exhibits/internet_history/http://www.tranquileye.com/cyber/

Australian telecoms historyhttp://www.caslon.com.au/timeline.htmhttp://www.anu.edu.au/people/Roger.Clarke/II/OzIHist.html

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 29 / 57

Section 2

Computer Networks

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 30 / 57

Page 15: Processing delay Information Theory and Networks

Section 2

Computer Networks

20

13

-09

-20

Information Theory

Computer Networks

Computer networks are a recent invention (in human history), but they

have been around for longer than some of you may think. In this lecture

we consider the underlying drivers in computer networks, and how this

subject fits with the ongoing development of those networks.

Computer pre-history

The original “computers” were peopleI numerical algorithms performed with pencil and paperI later with mechanical adding machines

Algorithms were often parallelizedI multiple computers worked on same problem to speed up or check

calculationsI a “computer network” was result of passing bits of paper

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 31 / 57

Computer pre-history

The original “computers” were peopleI numerical algorithms performed with pencil and paperI later with mechanical adding machines

Algorithms were often parallelizedI multiple computers worked on same problem to speed up or check

calculationsI a “computer network” was result of passing bits of paper

20

13

-09

-20

Information Theory

Computer Networks

Computer pre-history

20th century

Computer networks:

First generation of electrical digital computers 1940s

Second generation – late 1950s and early 1960sI transistor invented in 1947 (at AT&T)I direct networks: peripherals such as printers directly attached to

computers

Third generation, post-1964I integrated circuitsI real computer networks start

1965, Moore’s law discoveredI computers get better and better ...

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 32 / 57

Page 16: Processing delay Information Theory and Networks

20th century

Computer networks:

First generation of electrical digital computers 1940s

Second generation – late 1950s and early 1960sI transistor invented in 1947 (at AT&T)I direct networks: peripherals such as printers directly attached to

computers

Third generation, post-1964I integrated circuitsI real computer networks start

1965, Moore’s law discoveredI computers get better and better ...

20

13

-09

-20

Information Theory

Computer Networks

20th century

Networking drivers

Moore’s law drives PC business

Gilder’s law drives networksI something suss here – lets discuss later

Metcalfe’s law also drives the InternetI The value of a network is proportional to the square of the number of

users.I hence the failure of many “video-phone” trials

F but success of most recent “camera phones”

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 33 / 57

Networking drivers

Moore’s law drives PC business

Gilder’s law drives networksI something suss here – lets discuss later

Metcalfe’s law also drives the InternetI The value of a network is proportional to the square of the number of

users.I hence the failure of many “video-phone” trials

F but success of most recent “camera phones”

20

13

-09

-20

Information Theory

Computer Networks

Networking drivers

The Internet

Leonard Kleinrock at MIT published the first paper on packetswitching theory in, July 1961 [L.K61].

J.C.R. Licklider of MIT wrote memos “Galactic Network”, and laterconvinced DARPA to fund, 1962.

Baran defence proposal for robust network was a packet switchednetwork, 1962 [Bar64].

Thomas Merrill, Larry Roberts, first network 1965

Roberts’s plan for the ”ARPANET”, published 1967

IMP’s (built by BBN) connected 1968-69

1972: First public demo, e-mail invented

Vinton Cerf and Robert Kahn, TCP/IP, 1973http://www.isoc.org/internet/history/brief.shtml

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 34 / 57

Page 17: Processing delay Information Theory and Networks

The Internet

Leonard Kleinrock at MIT published the first paper on packetswitching theory in, July 1961 [L.K61].

J.C.R. Licklider of MIT wrote memos “Galactic Network”, and laterconvinced DARPA to fund, 1962.

Baran defence proposal for robust network was a packet switchednetwork, 1962 [Bar64].

Thomas Merrill, Larry Roberts, first network 1965

Roberts’s plan for the ”ARPANET”, published 1967

IMP’s (built by BBN) connected 1968-69

1972: First public demo, e-mail invented

Vinton Cerf and Robert Kahn, TCP/IP, 1973http://www.isoc.org/internet/history/brief.shtml2

01

3-0

9-2

0

Information Theory

Computer Networks

The Internet

FEBRUARY, 2005: The Association for Computing Machinery (ACM)awarded Internet pioneers Vinton Cerf and Robert Kahn the TuringAward (often considered the Nobel Prize of Computing) for “pioneeringwork on internetworking, including the design and implementation of theInternet’s basic communications protocols, TCP/IP, and for inspiredleadership in networking.”http://www.acm.org/awards/turing_citations/cerf_kahn.html

The Early Internet

Kleinrock’s insight [L.K61]

computer traffic is bursty (it comes in spurts)

more efficient to transmit packets of data on-demand than to reservecircuits between computers

I setting up a circuit takes time (high latency)I keeping up a circuit set up is inefficient

F not used most of the time

I all you want to do is send one little chunk of dataF example: typing – one character at a timeF even a whole email is quite small

I alternative: send data as packets

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 35 / 57

The Early Internet

Kleinrock’s insight [L.K61]

computer traffic is bursty (it comes in spurts)

more efficient to transmit packets of data on-demand than to reservecircuits between computers

I setting up a circuit takes time (high latency)I keeping up a circuit set up is inefficient

F not used most of the time

I all you want to do is send one little chunk of dataF example: typing – one character at a timeF even a whole email is quite small

I alternative: send data as packets

20

13

-09

-20

Information Theory

Computer Networks

The Early Internet

The Early Internet

Paul Baran, 1960s, envisioned a comm.s network that would survive a major

enemy attack. The sketch shows three network topologies described in [Bar64].

decentralizedcentralized distributed

Original available athttp://www.cybergeography.org/atlas/historical.html

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 36 / 57

Page 18: Processing delay Information Theory and Networks

The Early Internet

Paul Baran, 1960s, envisioned a comm.s network that would survive a major

enemy attack. The sketch shows three network topologies described in [Bar64].

decentralizedcentralized distributed

Original available athttp://www.cybergeography.org/atlas/historical.html

20

13

-09

-20

Information Theory

Computer Networks

The Early Internet

The centralized network is highly vulnerable to damage to it centralnode, and other nodes will be detached from the network by link failures

The distributed network structure has best survivability.

The Early InternetA rough sketch map of the possible topology of ARPANET by LarryRoberts. Drawn in the late 1960s as part of the planning for thenetwork [HL96, p.50].

http://www.cybergeography.org/atlas/historical.html

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 37 / 57

The Early InternetA rough sketch map of the possible topology of ARPANET by LarryRoberts. Drawn in the late 1960s as part of the planning for thenetwork [HL96, p.50].

http://www.cybergeography.org/atlas/historical.html

20

13

-09

-20

Information Theory

Computer Networks

The Early Internet

Early on, the ARPANET was small enough to design on the back of an

envelope. This is rarely possible for todays networks.

The Early InternetThe first node on ARPANET at University California Los Angeles (UCLA)on the 2nd of September 1969 [CK90].

IMP = Interface Message Processorwhat we would call a router

TIP = Terminal IMPIMP to which terminals can directly connect

Host = computer (which provides services)

Available athttp://www.cybergeography.org/atlas/historical.html

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 38 / 57

Page 19: Processing delay Information Theory and Networks

The Early InternetThe first node on ARPANET at University California Los Angeles (UCLA)on the 2nd of September 1969 [CK90].

IMP = Interface Message Processorwhat we would call a router

TIP = Terminal IMPIMP to which terminals can directly connect

Host = computer (which provides services)

Available athttp://www.cybergeography.org/atlas/historical.html

20

13

-09

-20

Information Theory

Computer Networks

The Early Internet

The Early InternetDec 1969 ”ARPA NETWORK”. 4 nodes: Uni. of California Los Angeles (UCLA),

Uni. of California Santa Barbara (UCSB), Uni. of Utah and the Stanford

Research Institute (SRI) [CK90].

Available athttp://www.cybergeography.org/atlas/historical.html

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 39 / 57

The Early InternetDec 1969 ”ARPA NETWORK”. 4 nodes: Uni. of California Los Angeles (UCLA),

Uni. of California Santa Barbara (UCSB), Uni. of Utah and the Stanford

Research Institute (SRI) [CK90].

Available athttp://www.cybergeography.org/atlas/historical.html

20

13

-09

-20

Information Theory

Computer Networks

The Early Internet

The first letters transmitted on the Internet were “lo”, transmittedbetween SRI and UCLA on October 29, 1969. The letters were thebeginning of “login” of which only the first two letters were sent beforethe system crashed.

http://www.lk.cs.ucla.edu/first_words.html

The Early Internet

a lot of effort went into design of the protocols, and architecture

the actual network was designed more by constraints: geographic,cost, political, (i.e. who had funding to participate)

I some formal optimization (Howard Frank in particular)

you can design a network on the back of an envelope when it has 4nodes.

I not so easy with 100

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 40 / 57

Page 20: Processing delay Information Theory and Networks

The Early Internet

a lot of effort went into design of the protocols, and architecture

the actual network was designed more by constraints: geographic,cost, political, (i.e. who had funding to participate)

I some formal optimization (Howard Frank in particular)

you can design a network on the back of an envelope when it has 4nodes.

I not so easy with 100

20

13

-09

-20

Information Theory

Computer Networks

The Early Internet

Formal optimization of computer networks reputedly first appeared in

“Optimal Design of Centralized Computer Networks”, H.Frank,

I.T.Frisch, R.Van Slyke, and W.S.Chou, Networks, Vol.1, No.1, pp.43–58,

1971, but I haven’t been able to obtain a copy as yet.

The Early InternetThe map above shows the logical topology of ARPANET in April 1971.(computers connect direct to IMPs) [CK90].

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 41 / 57

The Early InternetARPANET grew rapidly as more sites are connected [CK90].

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 42 / 57

The Early InternetARPANET grew rapidly as more sites are connected [CK90].

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 43 / 57

Page 21: Processing delay Information Theory and Networks

The Early InternetARPANET grew rapidly as more sites are connected [CK90].

http://www.cybergeography.org/atlas/historical.html

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 44 / 57

The Internet: the 80’s

new developmentsI Personal Computers (PCs)

⇒ lots more computers to networkI Ethernet (1973, Robert Metcalfe) creates LANs

the InternetI TCP/IP provides a way to hook up the LANs and PC over wide areas

(standard in 1980)I scale gets bigger

F numbers increaseF becomes international

I partitioningF ARPANET splits into MILNET and ARPANET in early 80’s, followed

by further additions

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 45 / 57

The Internet: the 80’s

new developmentsI Personal Computers (PCs)

⇒ lots more computers to networkI Ethernet (1973, Robert Metcalfe) creates LANs

the InternetI TCP/IP provides a way to hook up the LANs and PC over wide areas

(standard in 1980)I scale gets bigger

F numbers increaseF becomes international

I partitioningF ARPANET splits into MILNET and ARPANET in early 80’s, followed

by further additions20

13

-09

-20

Information Theory

Computer Networks

The Internet: the 80’s

The Internet: the 80’sARPANET/MILNET [CK90].

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 46 / 57

Page 22: Processing delay Information Theory and Networks

The Internet: the 80’sARPANET/MILNET [CK90].

20

13

-09

-20

Information Theory

Computer Networks

The Internet: the 80’s

Early Internet Growth

1980 1982 1984 1986 1988 1990 19920

100000

200000

300000

400000

500000

600000

700000

800000

900000

1000000

1980 1982 1985 1987 1990 199210

2

103

104

105

106

hosts

RFC 1296 ftp://ftp.isi.edu/in-notes/rfc1296.txt

Date (mm/yy) hosts08/1981 21301/1992 727,000

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 47 / 57

Early Internet Growth

1980 1982 1984 1986 1988 1990 19920

100000

200000

300000

400000

500000

600000

700000

800000

900000

1000000

1980 1982 1985 1987 1990 199210

2

103

104

105

106

hosts

RFC 1296 ftp://ftp.isi.edu/in-notes/rfc1296.txt

Date (mm/yy) hosts08/1981 21301/1992 727,000

20

13

-09

-20

Information Theory

Computer Networks

Early Internet Growth

The Early InternetState of the core of the Internet in August 1987.

http://www.cybergeography.org/atlas/historical.html

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 48 / 57

Page 23: Processing delay Information Theory and Networks

Networks of networksThese maps show the structure of JANET, the UK’s academic andresearch network, in 1992.

http://www.cybergeography.org/atlas/historical.html

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 49 / 57

The Internet: the 90’s

ARPANET decommissioned 1990I NSF Backbone connects many other networks

F Australia connected in 1990 [Abb99]

It was the first, and being first, was best,

but now we lay it down to rest.

Now pause with me a moment, shed some tears.

For auld lange syne, for love, for years and years

of faithful service, duty done, I weep.

Lay down thy packet, now, O friend, and sleep.

Vinton Cerf, 1989commercial Internet services evolve

I 1995 NSFNET terminated (replaced by vBNS)I effectively fully privatised InternetI links through exchange points

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 50 / 57

The Internet: the 90’s

ARPANET decommissioned 1990I NSF Backbone connects many other networks

F Australia connected in 1990 [Abb99]

It was the first, and being first, was best,

but now we lay it down to rest.

Now pause with me a moment, shed some tears.

For auld lange syne, for love, for years and years

of faithful service, duty done, I weep.

Lay down thy packet, now, O friend, and sleep.

Vinton Cerf, 1989commercial Internet services evolve

I 1995 NSFNET terminated (replaced by vBNS)I effectively fully privatised InternetI links through exchange points

20

13

-09

-20

Information Theory

Computer Networks

The Internet: the 90’s

The Internet: the 90’sAustralia’s network 1991

http://www.ucs.ed.ac.uk/fmd/unix/edftp/pub/maps/

New networkhttp://www.aarnet.edu.au/engineering/aarnet3/

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 51 / 57

Page 24: Processing delay Information Theory and Networks

The Internet: the 90’sAustralia’s network 1991

http://www.ucs.ed.ac.uk/fmd/unix/edftp/pub/maps/

New networkhttp://www.aarnet.edu.au/engineering/aarnet3/

20

13

-09

-20

Information Theory

Computer Networks

The Internet: the 90’s

The Internet: the 90’s

http://www.w3.org/History.html

1990: World Wide WebTim Berners-Lee created HyperText Markup Language, or HTML.Along with URL (Uniform Resource Locators), and HTTP(HyperText Transfer Protocol), created the web. Based on earlierwork at CERN (1980).

1993: Mosaic (Marc Andreesen, NCSA)Mosaic became the first popular web browser. It was not only easy touse to access the World Wide Web, but it was also extremely easy todownload and install!

Killer app =¿ the Internet takes off in a big way

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 52 / 57

The Internet: the 90’s

http://www.w3.org/History.html

1990: World Wide WebTim Berners-Lee created HyperText Markup Language, or HTML.Along with URL (Uniform Resource Locators), and HTTP(HyperText Transfer Protocol), created the web. Based on earlierwork at CERN (1980).

1993: Mosaic (Marc Andreesen, NCSA)Mosaic became the first popular web browser. It was not only easy touse to access the World Wide Web, but it was also extremely easy todownload and install!

Killer app =¿ the Internet takes off in a big way20

13

-09

-20

Information Theory

Computer Networks

The Internet: the 90’s

Internet Traffic GrowthTraffic roughly doubles every year [Odl03].

Traffic in TB per month

1990 1995 2000 200510

0

101

102

103

104

105

106

Combination of new users and higher bandwidth!Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 53 / 57

Page 25: Processing delay Information Theory and Networks

Internet Traffic GrowthTraffic roughly doubles every year [Odl03].

Traffic in TB per month

1990 1995 2000 200510

0

101

102

103

104

105

106

Combination of new users and higher bandwidth!

20

13

-09

-20

Information Theory

Computer Networks

Internet Traffic Growth

Internet traffic was believed to overtake telephone traffic around 2002.

Extrapolated Internet growth from 90’s data.

http://www.cc.gatech.edu/gvu/stats/NSF/Extrap.GIF

Australian Traffic Growth

2000 2002 2004 2006 2008 2010 2012 201410

−1

100

101

102

103

traffic

(P

B/q

uart

er)

www.abs.gov.au

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 54 / 57

Australian Traffic Growth

2000 2002 2004 2006 2008 2010 2012 201410

−1

100

101

102

103

tra

ffic

(P

B/q

ua

rte

r)

www.abs.gov.au

20

13

-09

-20

Information Theory

Computer Networks

Australian Traffic Growth

Measurements taken from the Australian Bureau of Statistics: seehttp://www.abs.gov.au/ausstats/[email protected]/mf/8153.0/

2000 2002 2004 2006 2008 2010 2012 20140

100

200

300

400

500

600

traffic

(P

B/q

uart

er)

Other computer networks

The history of computer communications is not just about the Internetother technologies, e.g.

I packet radio (Hawaii)I ATM/FramerelayI x.25I IBM’s SNAI Appletalk

other countries, e.g.I FranceI UK

people: I haven’t talked about them, but many individuals’contributions were critical [HL96, Abb99, Sal95].

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 55 / 57

Page 26: Processing delay Information Theory and Networks

Other computer networks

The history of computer communications is not just about the Internetother technologies, e.g.

I packet radio (Hawaii)I ATM/FramerelayI x.25I IBM’s SNAI Appletalk

other countries, e.g.I FranceI UK

people: I haven’t talked about them, but many individuals’contributions were critical [HL96, Abb99, Sal95].

20

13

-09

-20

Information Theory

Computer Networks

Other computer networks

BIT MORE ON HOW PACKET NETWORKS WORK

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 56 / 57

Further reading I

Janet Abbate, Inventing the internet, MIT Press, 1999.

Paul Baran, On distributed communications: 1. introduction to distributedcommunications network, RAND Memorandum, August 1964.

V. Cerf and B. Kahn, Selected ARPANET maps, Computer CommunicationsReview (CCR) 20 (1990), 81–110.

Katie Hafner and Matthew Lyon, Where wizards stay up late: The origins of theinternet, Touchstone, 1996.

L.Kleinrock, Information flow in large communication networks, RLE QuarterlyProgress Report, July 1961.

Gordon E. Moore, Cramming more components into integrated circuits, Electronics38 (1965), no. 8.

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 56 / 57

Further reading II

A. M. Odlyzko, Internet traffic growth: Sources and implications, OpticalTransmission Systems and Equipment for WDM Networking II, Proc. SPIE, vol.5247, 2003, pp. 1–15.

Peter H. Salus, Casting the net: From ARPANET to Internet and beyond...,Addison-Wesley, 1995.

Matthew Roughan (School of Mathematical Sciences, University of Adelaide)Information Theory September 20, 2013 57 / 57