The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005...

33
The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn (KAIST) Fabian Roth (ETH, Switzerlan d) Matthew Silver (MIT) Marie-Helen Cloutier (Canad a) Peter Ittzes (Collegium Buda pest) Hawoong Jeong(KAIST) CSSPL

Transcript of The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005...

Page 1: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

The Price of Anarchy on Boston road

13th Statphy workshop. Aug 11, 2005

NECSI summer school 2005

HyeJin Youn (KAIST)

Fabian Roth (ETH, Switzerland)

Matthew Silver (MIT)

Marie-Helen Cloutier (Canada)

Peter Ittzes (Collegium Budapest)

Hawoong Jeong(KAIST)

CSSPL

Page 2: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

A basic traffic problem

• agents from S to T at minimum cost

S T

C(x) = Ax+B

CSSPL

Latency function C(X) = AX + B

Page 3: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

Two Optimization Strategies• Two types of mindsets

CSSPL

Decentralised control: Each agent minimizes

personal cost

There always exists a user-equilibrium/Nash equilibrium (Beckmann 1956)

Global Optimisation

User optimizations

Centralised controlMinimising Global Cost

Page 4: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

The “Price of Anarchy”

CSSPL

Decentralised control: Each agent minimizes

personal cost

There always exists a user-equilibrium/Nash equilibrium (Beckmann 1956)

Global Optimum

User Optimum

Centralised controlMinimising Global Cost

Price of Anarchy

Koutsoupias & Papadimitriou, 1999

Price of Anarchy <= 4/3 (Roughgarden & Tardos, 2000)

• Examples: Road Traffic, Network Routing, Prisoners Dilemma

Page 5: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

Price of Anarchy: Simple Example

S E

C=10

C(X) = X

Global Optimum = ?

10 Agents from S EC = latency function (cost)

CSSPL

Global Optimum

Page 6: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

S E

C=10

C(X) = X

Global Optimum = 5x10 + 5x5 = 75

X = 5

X = 5

CSSPL

Price of Anarchy: Simple Example

10 Agents from S EC = latency function (cost)

Global Optimum

Page 7: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

S E

C=10

C(X) = X

User Equilibrium = ?

X = 5

X = 5

CSSPL

10 Agents from S EC = latency function (cost)

User Optimum

Price of Anarchy: Simple Example

Page 8: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

S E

C=10

C(X) = X

X = 5 + 1

X = 5 - 1

+1

CSSPL

10 Agents from S EC = latency function (cost)

User Optimum

user cost = 5 + 1 < 10

Price of Anarchy: Simple Example

Page 9: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

S E

C=10

C(X) = X

X = 6 + 1

X = 4 - 1

CSSPL

10 Agents from S EC = latency function (cost)

User Optimum

again+1

user cost = 6 + 1 < 10

Price of Anarchy: Simple Example

Page 10: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

S E

C=10

C(X) = X

X = 8

X = 2

CSSPL

10 Agents from S EC = latency function (cost)

User Optimum

user cost = 7 + 1 < 10

Price of Anarchy: Simple Example

again+1

Page 11: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

S E

C=10

C(X) = X

X = 9

X = 1

CSSPL

10 Agents from S EC = latency function (cost)

User Optimum

user cost = 8 + 1 < 10

Price of Anarchy: Simple Example

again+1

Page 12: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

S E

C=10

C(X) = X

He is indifferent: C = 9 + 1 = 10

X = 10

X = 0

CSSPL

10 Agents from S EC = latency function (cost)

User Optimum

Price of Anarchy: Simple Example

Page 13: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

S E

C=10

C(X) = X

User Equilibrium = 10 x10 = 100

X = 10

X = 0

Global Optimum = 5x10 + 5x5 = 75

CSSPL

10 Agents from S EC = latency function (cost)

User Optimum

Price of Anarchy: Simple Example

4/3= upper bound of Price of Anarchy

Page 14: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

Braess’s Paradox

S T

x

x1

1

0

Send 1 Unit of Flow

User Equilibrium without middle arc = 1.5

User Equilibrium with middle arc = 2

CSSPL

Increasing user optimum at extra cost

Price of Anarchy = 2/1.5 = 4/34/3

Page 15: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

Simulation Questions

• Price of Anarchy on a real world– the Boston Road Network

• Control factors– # of Agents– Topology

• Reducing the Price of Anarchy without raising Global Optimum– Semi-centralised control (Akella et al, ~2004)

– Network Redesign: Destroy Arcs (Braess’s paradox)

CSSPL

Page 16: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

Boston Road Map

CSSPL

Page 17: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

Boston Road Network

Start

End

CSSPL

(node 59, edges 108, regular-like ) Latency function = ax + b

Width1, 2, 3 length

Page 18: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

User Equilibrium Global Optimum

Number of Agents: 1

CSSPL

Page 19: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

User Equilibrium Global Optimum

Number of Agents: 2

CSSPL

Page 20: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

User Equilibrium Global Optimum

Number of Agents: 3

CSSPL

Page 21: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

User Equilibrium Global Optimum

Number of Agents: 4

CSSPL

Page 22: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

User Equilibrium Global Optimum

Number of Agents: 10

CSSPL

Page 23: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

User Equilibrium Global Optimum

Number of Agents: 5

CSSPL

Page 24: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

User Equilibrium Global Optimum

Number of Agents: 6

CSSPL

Page 25: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

User Equilibrium Global Optimum

Number of Agents: 7

CSSPL

Page 26: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

User Equilibrium Global Optimum

Number of Agents: 8

CSSPL

Page 27: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

User Equilibrium Global Optimum

Number of Agents: 9

CSSPL

Page 28: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

User Equilibrium Global Optimum

Number of Agents: 15

CSSPL

Page 29: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

User Equilibrium Global Optimum

Number of Agents: 20

CSSPL

Page 30: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

Variation of POA with Agent #

# of Agents

POA

Reminder: POA = UE/GO

CSSPL

Page 31: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

Affect of Arc Removal on UE

Arc

Total Agent Cost

CSSPL

Page 32: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

Affect of an Arc Removal on UE

Severe increase

Increase

Mild to no increase

Decrease

Start

End

CSSPL

Page 33: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

Conclusions• Price of Anarchy on a real world

– the Boston Road Network• Control factors

– # of Agents• Reducing the Price of Anarchy without raising Global Optimum

– Network Redesign: Destroy Arcs (Braess’s paradox)

CSSPL

Flow from to Central Square to Copley Square could be improved by removing some streets

• Importance of Dynamics of fitness landscape ( how topology matters? )• Removal of a node flattening rugged fitness landscape

–Enlarging search spaces –how to map on prisoner’s dilemma–prisoner’s dilemma get agents better when they look further.

but traffic doesn’t have such a benefit to cooperators ( tax? )