Graphical Models for Game Theory Undirected graph G capturing local interactions Each player...
-
date post
21-Dec-2015 -
Category
Documents
-
view
216 -
download
0
Transcript of Graphical Models for Game Theory Undirected graph G capturing local interactions Each player...
![Page 1: Graphical Models for Game Theory Undirected graph G capturing local interactions Each player represented by a vertex N_i(G) = neighbors.](https://reader038.fdocuments.in/reader038/viewer/2022110322/56649d5f5503460f94a3edd3/html5/thumbnails/1.jpg)
![Page 2: Graphical Models for Game Theory Undirected graph G capturing local interactions Each player represented by a vertex N_i(G) = neighbors.](https://reader038.fdocuments.in/reader038/viewer/2022110322/56649d5f5503460f94a3edd3/html5/thumbnails/2.jpg)
![Page 3: Graphical Models for Game Theory Undirected graph G capturing local interactions Each player represented by a vertex N_i(G) = neighbors.](https://reader038.fdocuments.in/reader038/viewer/2022110322/56649d5f5503460f94a3edd3/html5/thumbnails/3.jpg)
![Page 4: Graphical Models for Game Theory Undirected graph G capturing local interactions Each player represented by a vertex N_i(G) = neighbors.](https://reader038.fdocuments.in/reader038/viewer/2022110322/56649d5f5503460f94a3edd3/html5/thumbnails/4.jpg)
![Page 5: Graphical Models for Game Theory Undirected graph G capturing local interactions Each player represented by a vertex N_i(G) = neighbors.](https://reader038.fdocuments.in/reader038/viewer/2022110322/56649d5f5503460f94a3edd3/html5/thumbnails/5.jpg)
![Page 6: Graphical Models for Game Theory Undirected graph G capturing local interactions Each player represented by a vertex N_i(G) = neighbors.](https://reader038.fdocuments.in/reader038/viewer/2022110322/56649d5f5503460f94a3edd3/html5/thumbnails/6.jpg)
![Page 7: Graphical Models for Game Theory Undirected graph G capturing local interactions Each player represented by a vertex N_i(G) = neighbors.](https://reader038.fdocuments.in/reader038/viewer/2022110322/56649d5f5503460f94a3edd3/html5/thumbnails/7.jpg)
![Page 8: Graphical Models for Game Theory Undirected graph G capturing local interactions Each player represented by a vertex N_i(G) = neighbors.](https://reader038.fdocuments.in/reader038/viewer/2022110322/56649d5f5503460f94a3edd3/html5/thumbnails/8.jpg)
![Page 9: Graphical Models for Game Theory Undirected graph G capturing local interactions Each player represented by a vertex N_i(G) = neighbors.](https://reader038.fdocuments.in/reader038/viewer/2022110322/56649d5f5503460f94a3edd3/html5/thumbnails/9.jpg)
![Page 10: Graphical Models for Game Theory Undirected graph G capturing local interactions Each player represented by a vertex N_i(G) = neighbors.](https://reader038.fdocuments.in/reader038/viewer/2022110322/56649d5f5503460f94a3edd3/html5/thumbnails/10.jpg)
Graphical Models for Game Theory
• Undirected graph G capturing local interactions• Each player represented by a vertex• N_i(G) = neighbors of i in G (includes i)• Assume: M_i(a) expressible as M’_i(a’) over only N_i(G)• Graphical game: (G,{M’_i})• Compact representation of game• Exponential in max degree (<< # of players)• Ex’s: geography, organizational structure, networks• Analogy to Bayes nets: special structure
2
4
3
5
8
7
6
1
![Page 11: Graphical Models for Game Theory Undirected graph G capturing local interactions Each player represented by a vertex N_i(G) = neighbors.](https://reader038.fdocuments.in/reader038/viewer/2022110322/56649d5f5503460f94a3edd3/html5/thumbnails/11.jpg)
An Abstract Tree Algorithm
• Downstream Pass:– Each node V receives
T(v,ui) from each Ui– V computes T(w,v) and
witness lists for each T(w,v) = 1
• Upstream Pass:– V receives values (w,v)
from W s.t. T(w,v) = 1– V picks witness u for
T(w,v), passes (v,ui) to Ui
U1 U2 U3
W
V
T(w,v) = 1 <--> an “upstream” Nash where V = v given W = w <--> u: T(v,ui) = 1 for all i, and v is a best response to u,w
How to represent?How to compute?
![Page 12: Graphical Models for Game Theory Undirected graph G capturing local interactions Each player represented by a vertex N_i(G) = neighbors.](https://reader038.fdocuments.in/reader038/viewer/2022110322/56649d5f5503460f94a3edd3/html5/thumbnails/12.jpg)
An Approximation Algorithm
• Discretize u and v in T(v,u), 1 represents approximate Nash
• Main technical lemma: If k is max degree, grid resolution ~ /k preserves global -Nash equilibria
• An efficient algorithm:– Polynomial in n (fixed k)– Represent an approx. to every Nash– Can generate random Nash, or specific
Nash
U1 U2 U3
W
V
![Page 13: Graphical Models for Game Theory Undirected graph G capturing local interactions Each player represented by a vertex N_i(G) = neighbors.](https://reader038.fdocuments.in/reader038/viewer/2022110322/56649d5f5503460f94a3edd3/html5/thumbnails/13.jpg)
• Table dimensions are probability of playing 0• Black shows T(v,u) = 1• Ms want to match, Os to unmatch• Relative value modulated by parent values• =0.01, = 0.05
![Page 14: Graphical Models for Game Theory Undirected graph G capturing local interactions Each player represented by a vertex N_i(G) = neighbors.](https://reader038.fdocuments.in/reader038/viewer/2022110322/56649d5f5503460f94a3edd3/html5/thumbnails/14.jpg)
Extension to exact algorithm:each table is a finite union ofrectangles, exponential in depth
![Page 15: Graphical Models for Game Theory Undirected graph G capturing local interactions Each player represented by a vertex N_i(G) = neighbors.](https://reader038.fdocuments.in/reader038/viewer/2022110322/56649d5f5503460f94a3edd3/html5/thumbnails/15.jpg)
NashProp for Arbitrary Graphs
• Two-phase algorithm:– Table-passing phase– Assignment-passing phase
• Table-passing phase:– Initialization: T[0](w,v) = 1 for all (w,v)– Induction: T[r+1](w,v) = 1 iff u:
• T[r](v,ui) = 1 for all i• V=v a best response to W=w, U=u
• Table consistency stronger than best response
U1 U2 U3
W
V
![Page 16: Graphical Models for Game Theory Undirected graph G capturing local interactions Each player represented by a vertex N_i(G) = neighbors.](https://reader038.fdocuments.in/reader038/viewer/2022110322/56649d5f5503460f94a3edd3/html5/thumbnails/16.jpg)
Convergence of Table-Passing
• Table-passing obeys contraction:– {(w,v):T[r+1](w,v) = 1} contained in {(w,v):T[r](w,v) = 1}
• Tables converge and are balanced• Discretization scheme: tables converge quickly• Never eliminate an equilibrium• Tables give a reduced search space• Assignment-passing phase:
– Use graph to propagate a solution consistent with tables– Backtracking local search
• Allow and to be parameters• Alternative approach [Vickrey&Koller]:
– Constraint propagation on junction tree
![Page 17: Graphical Models for Game Theory Undirected graph G capturing local interactions Each player represented by a vertex N_i(G) = neighbors.](https://reader038.fdocuments.in/reader038/viewer/2022110322/56649d5f5503460f94a3edd3/html5/thumbnails/17.jpg)
![Page 18: Graphical Models for Game Theory Undirected graph G capturing local interactions Each player represented by a vertex N_i(G) = neighbors.](https://reader038.fdocuments.in/reader038/viewer/2022110322/56649d5f5503460f94a3edd3/html5/thumbnails/18.jpg)
![Page 19: Graphical Models for Game Theory Undirected graph G capturing local interactions Each player represented by a vertex N_i(G) = neighbors.](https://reader038.fdocuments.in/reader038/viewer/2022110322/56649d5f5503460f94a3edd3/html5/thumbnails/19.jpg)
![Page 20: Graphical Models for Game Theory Undirected graph G capturing local interactions Each player represented by a vertex N_i(G) = neighbors.](https://reader038.fdocuments.in/reader038/viewer/2022110322/56649d5f5503460f94a3edd3/html5/thumbnails/20.jpg)
![Page 21: Graphical Models for Game Theory Undirected graph G capturing local interactions Each player represented by a vertex N_i(G) = neighbors.](https://reader038.fdocuments.in/reader038/viewer/2022110322/56649d5f5503460f94a3edd3/html5/thumbnails/21.jpg)
![Page 22: Graphical Models for Game Theory Undirected graph G capturing local interactions Each player represented by a vertex N_i(G) = neighbors.](https://reader038.fdocuments.in/reader038/viewer/2022110322/56649d5f5503460f94a3edd3/html5/thumbnails/22.jpg)
![Page 23: Graphical Models for Game Theory Undirected graph G capturing local interactions Each player represented by a vertex N_i(G) = neighbors.](https://reader038.fdocuments.in/reader038/viewer/2022110322/56649d5f5503460f94a3edd3/html5/thumbnails/23.jpg)
Graphical Games: Related Work
• Koller and Milch: graphical influence diagrams• La Mura: game networks• Vickrey & Koller: other methods on graphical games• Leyton-Brown: action-graph games