Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A....

52

Transcript of Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A....

Page 1: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.
Page 2: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

Networks, Complexity and Economic Development

Characterizing the Structure of Networks

Cesar A. Hidalgo PhD

Page 3: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

Over 3 billion documents

R. Albert, H. Jeong, A-L Barabasi, Nature, 401 130 (1999).

Expected

P(k) ~ k-

FoundSca

le-f

ree N

etw

ork

Exponenti

al N

etw

ork

Page 4: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

Take home messages

-Networks might look messy, but are not random.-Many networks in nature are Scale-Free (SF), meaning that just a few nodes have a disproportionately large number of connections.-Power-law distributions are ubiquitous in nature.-While power-laws are associated with critical points in nature, systems can self-organize to this critical state.- There are important dynamical implications of the Scale-Free topology.-SF Networks are more robust to failures, yet are more vulnerable to targeted attacks.-SF Networks have a vanishing epidemic threshold.

Page 5: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

Local Measures

Page 6: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

CENTRALITY MEASURES

Measure the “importance”of a node in a network.

Page 7: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.
Page 8: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

8

Rod Steiger

Click on a name to see that person's table. Steiger, Rod (2.678695) Lee, Christopher (I) (2.684104) Hopper, Dennis (2.698471) Sutherland, Donald (I) (2.701850) Keitel, Harvey (2.705573) Pleasence, Donald (2.707490) von Sydow, Max (2.708420) Caine, Michael (I) (2.720621) Sheen, Martin (2.721361) Quinn, Anthony (2.722720) Heston, Charlton (2.722904) Hackman, Gene (2.725215) Connery, Sean (2.730801) Stanton, Harry Dean (2.737575) Welles, Orson (2.744593) Mitchum, Robert (2.745206) Gould, Elliott (2.746082) Plummer, Christopher (I) (2.746427) Coburn, James (2.746822) Borgnine, Ernest (2.747229)

Hollywood Revolves Around

Page 9: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

XXX

Most Connected Actors in Hollywood(measured in the late 90’s)

A-L Barabasi, “Linked”, 2002

Mel Blanc 759Tom Byron 679

Marc Wallice 535Ron Jeremy 500Peter North 491

TT Boy 449Tom London 436Randy West 425

Mike Horner 418Joey Silvera 410

Page 10: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

DEGREE CENTRALITY

K= number of links

Where Aij = 1 if nodes i and j are connected and 0 otherwise

Page 11: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

BETWENNESS CENTRALITY

BC= number of shortestPaths that go through a

node.

A B H

I

J

K

DG

E

C

F

BC(G)=0

N=11

BC(D)=9+1/2=9.5

BC(B)=4*6=24

BC(A)=5*5+4=29

Page 12: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

CLOSENESS CENTRALITY

C= Average Distanceto neighbors

A B H

I

J

K

DG

E

C

F

N=11

C(G)=1/10(1+2*3+2*3+4+3*5)C(G)=3.2

C(A)=1/10(4+2*3+3*3)C(A)=1.9

C(B)=1/10(2+2*6+2*3)C(B)=2

Page 13: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

EIGENVECTOR CENTRALITY

Consider the Adjacency Matrix Aij = 1 if node i is connected to node jand 0 otherwise.

Consider the eigenvalue problem:

Ax=x

Then the eigenvector centrality of a node is defined as:

where is the largest eigenvalue associated with A.

Page 14: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

PAGE RANK

PR=Probability that a randomwalker with interspersedJumps would visit that node.PR=Each page votes forits neighbors.

A E F

G

H

I

BK

C

J

D

PR(A)=PR(B)/4 + PR(C)/3 + PR(D)+PR(E)/2A random surfer eventually stops clicking

PR(X)=(1-d)/N + d(PR(y)/k(y))

Page 15: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

PAGE RANK

PR=Probability that a randomWalker would visit that node.PR=Each page votes forits neighbors.

Page 16: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

CLUSTERING MEASURES

Measure the densityof a group of nodes in a

Network

Page 17: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

Clustering Coefficient

A B H

I

J

K

DG

E

C

F

Ci=2/k(k-1)

CA=2/12=1/6 CC=2/2=1 CE=4/6=2/3

Page 18: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

Topological OverlapMutual Clustering

A B H

I

J

K

DG

E

C

F

TO(A,B)=Overlap(A,B)/NormalizingFactor(A,B)TO(A,B)=N(A,B)/max(k(A),k(B))

TO(A,B)=N(A,B)/ (k(A)xk(B))1/2

TO(A,B)=N(A,B)/min(k(A),k(B))

TO(A,B)=N(A,B)/(k(A)+k(B))

Page 19: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

Topological OverlapMutual Clustering

A B H

I

J

K

DG

E

C

F

TO(A,B)=N(A,B)/max(k(A),k(B))

TO(A,B)=0TO(A,D)=1/4TO(E,D)=2/4

Page 20: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

MOTIFS

Page 21: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

Motifs

Page 22: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.
Page 23: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

Structural Equivalence

Page 24: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

Global Measures

Page 25: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

The Distribution of any of the previously introduced measures

Page 26: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.
Page 27: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

Giant ComponentComponents

S=NumberOfNodesInGiantComponent/TotalNumberOfNodes

Page 28: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

Diameter

Page 29: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

A B H

I

J

K

DG

E

C

F

Diameter=Maximum Distance Between Elements in a Set

Diameter=D(G,J)=D(C,J)=D(G,I)=…=5

Page 30: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

A B

DG

E

C

F

Average Path Length

A B C D E F G

ABCDEFG

1 2 1 1 1 2 3 2 2 2 3 1 1 3 2 1 2 1 2 2 3

D(1)=8D(2)=9D(3)=4

L=(8+2x9+3x4)/(8+9+4) L=1.8

Page 31: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

Degree CorrelationsAre Hubs Connected to Hubs?

Page 32: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

Phys. Rev. Lett. 87, 258701 (2001)

Page 33: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.
Page 34: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.
Page 35: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.
Page 36: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

Wait:are we comparing to the right thing

Page 37: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.
Page 38: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

Compared to what?Randomized Network

AB

HI

J K

DG

EC

F AB

HI

J K

DG

EC

F AB

HI

J K

DG

EC

F

Page 39: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

Internet

Randomized Network

Physica A 333, 529-540 (2004)

Page 40: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

Connectivity Pattern/Randomized Z-score Connectivity Pattern/Randomized

Page 41: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.
Page 42: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

Data

Models

Page 43: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

After Controlling for Randomized Network

Data

Models

Page 44: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

Fractal Networks

Page 45: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

Mandelbrot BB

Page 46: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

GeneratingKoch Curve

Measuring the Dimension of Koch Curve

Page 47: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.
Page 48: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.
Page 49: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

White Noise

Pink Noise

Brown Noise

Page 50: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.
Page 51: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

Attack Tolerance

Fractal Network

Non Fractal Network

Page 52: Networks, Complexity and Economic Development Characterizing the Structure of Networks Cesar A. Hidalgo PhD.

Take Home Messages-To characterize the structure of a Network we need many different measures-This measures allow us to differentiate between the different networks in natureToday we saw:Local MeasuresCentrality measures (degree, closeness, betweenness, eigenvector, page-rank)Clustering measures (Clustering, Topological Overlap or Mutual Clustering)MotifsGlobal Measures Degree Correlations, Correlation Profile.Hierarchical StructureFractal Structure

Connections Between Local and Global Measures