Download - The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

Transcript
Page 1: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

The Price of Anarchy on Boston road

13th Statphy workshop. Aug 11, 2005

NECSI summer school 2005

HyeJin Youn (KAIST)

Fabian Roth (ETH, Switzerland)

Matthew Silver (MIT)

Marie-Helen Cloutier (Canada)

Peter Ittzes (Collegium Budapest)

Hawoong Jeong(KAIST)

CSSPL

Page 2: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

A basic traffic problem

• agents from S to T at minimum cost

S T

C(x) = Ax+B

CSSPL

Latency function C(X) = AX + B

Page 3: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

Two Optimization Strategies• Two types of mindsets

CSSPL

Decentralised control: Each agent minimizes

personal cost

There always exists a user-equilibrium/Nash equilibrium (Beckmann 1956)

Global Optimisation

User optimizations

Centralised controlMinimising Global Cost

Page 4: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

The “Price of Anarchy”

CSSPL

Decentralised control: Each agent minimizes

personal cost

There always exists a user-equilibrium/Nash equilibrium (Beckmann 1956)

Global Optimum

User Optimum

Centralised controlMinimising Global Cost

Price of Anarchy

Koutsoupias & Papadimitriou, 1999

Price of Anarchy <= 4/3 (Roughgarden & Tardos, 2000)

• Examples: Road Traffic, Network Routing, Prisoners Dilemma

Page 5: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

Price of Anarchy: Simple Example

S E

C=10

C(X) = X

Global Optimum = ?

10 Agents from S EC = latency function (cost)

CSSPL

Global Optimum

Page 6: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

S E

C=10

C(X) = X

Global Optimum = 5x10 + 5x5 = 75

X = 5

X = 5

CSSPL

Price of Anarchy: Simple Example

10 Agents from S EC = latency function (cost)

Global Optimum

Page 7: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

S E

C=10

C(X) = X

User Equilibrium = ?

X = 5

X = 5

CSSPL

10 Agents from S EC = latency function (cost)

User Optimum

Price of Anarchy: Simple Example

Page 8: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

S E

C=10

C(X) = X

X = 5 + 1

X = 5 - 1

+1

CSSPL

10 Agents from S EC = latency function (cost)

User Optimum

user cost = 5 + 1 < 10

Price of Anarchy: Simple Example

Page 9: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

S E

C=10

C(X) = X

X = 6 + 1

X = 4 - 1

CSSPL

10 Agents from S EC = latency function (cost)

User Optimum

again+1

user cost = 6 + 1 < 10

Price of Anarchy: Simple Example

Page 10: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

S E

C=10

C(X) = X

X = 8

X = 2

CSSPL

10 Agents from S EC = latency function (cost)

User Optimum

user cost = 7 + 1 < 10

Price of Anarchy: Simple Example

again+1

Page 11: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

S E

C=10

C(X) = X

X = 9

X = 1

CSSPL

10 Agents from S EC = latency function (cost)

User Optimum

user cost = 8 + 1 < 10

Price of Anarchy: Simple Example

again+1

Page 12: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

S E

C=10

C(X) = X

He is indifferent: C = 9 + 1 = 10

X = 10

X = 0

CSSPL

10 Agents from S EC = latency function (cost)

User Optimum

Price of Anarchy: Simple Example

Page 13: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

S E

C=10

C(X) = X

User Equilibrium = 10 x10 = 100

X = 10

X = 0

Global Optimum = 5x10 + 5x5 = 75

CSSPL

10 Agents from S EC = latency function (cost)

User Optimum

Price of Anarchy: Simple Example

4/3= upper bound of Price of Anarchy

Page 14: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

Braess’s Paradox

S T

x

x1

1

0

Send 1 Unit of Flow

User Equilibrium without middle arc = 1.5

User Equilibrium with middle arc = 2

CSSPL

Increasing user optimum at extra cost

Price of Anarchy = 2/1.5 = 4/34/3

Page 15: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

Simulation Questions

• Price of Anarchy on a real world– the Boston Road Network

• Control factors– # of Agents– Topology

• Reducing the Price of Anarchy without raising Global Optimum– Semi-centralised control (Akella et al, ~2004)

– Network Redesign: Destroy Arcs (Braess’s paradox)

CSSPL

Page 16: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

Boston Road Map

CSSPL

Page 17: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

Boston Road Network

Start

End

CSSPL

(node 59, edges 108, regular-like ) Latency function = ax + b

Width1, 2, 3 length

Page 18: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

User Equilibrium Global Optimum

Number of Agents: 1

CSSPL

Page 19: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

User Equilibrium Global Optimum

Number of Agents: 2

CSSPL

Page 20: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

User Equilibrium Global Optimum

Number of Agents: 3

CSSPL

Page 21: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

User Equilibrium Global Optimum

Number of Agents: 4

CSSPL

Page 22: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

User Equilibrium Global Optimum

Number of Agents: 10

CSSPL

Page 23: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

User Equilibrium Global Optimum

Number of Agents: 5

CSSPL

Page 24: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

User Equilibrium Global Optimum

Number of Agents: 6

CSSPL

Page 25: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

User Equilibrium Global Optimum

Number of Agents: 7

CSSPL

Page 26: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

User Equilibrium Global Optimum

Number of Agents: 8

CSSPL

Page 27: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

User Equilibrium Global Optimum

Number of Agents: 9

CSSPL

Page 28: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

User Equilibrium Global Optimum

Number of Agents: 15

CSSPL

Page 29: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

User Equilibrium Global Optimum

Number of Agents: 20

CSSPL

Page 30: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

Variation of POA with Agent #

# of Agents

POA

Reminder: POA = UE/GO

CSSPL

Page 31: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

Affect of Arc Removal on UE

Arc

Total Agent Cost

CSSPL

Page 32: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

Affect of an Arc Removal on UE

Severe increase

Increase

Mild to no increase

Decrease

Start

End

CSSPL

Page 33: The Price of Anarchy on Boston road 13 th Statphy workshop. Aug 11, 2005 NECSI summer school 2005 HyeJin Youn ( KAIST ) Fabian Roth ( ETH, Switzerland.

Conclusions• Price of Anarchy on a real world

– the Boston Road Network• Control factors

– # of Agents• Reducing the Price of Anarchy without raising Global Optimum

– Network Redesign: Destroy Arcs (Braess’s paradox)

CSSPL

Flow from to Central Square to Copley Square could be improved by removing some streets

• Importance of Dynamics of fitness landscape ( how topology matters? )• Removal of a node flattening rugged fitness landscape

–Enlarging search spaces –how to map on prisoner’s dilemma–prisoner’s dilemma get agents better when they look further.

but traffic doesn’t have such a benefit to cooperators ( tax? )