Introduction to Game Theory: Static Gamescslui/CSC6480/static_games.pdf · Introduction to Game...

53
Introduction to Game Theory: Static Games John C.S. Lui Department of Computer Science & Engineering The Chinese University of Hong Kong John C.S. Lui (CUHK) Advanced Topics in Network Analysis 1 / 60

Transcript of Introduction to Game Theory: Static Gamescslui/CSC6480/static_games.pdf · Introduction to Game...

Introduction to Game Theory: Static Games

John C.S. Lui

Department of Computer Science & EngineeringThe Chinese University of Hong Kong

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 1 / 60

Outline

Outline

1 Interactive Decision Problem

2 Description of Static Game

3 Solving Games using Dominance

4 Nash Equilibria

5 Existence of NE

6 The Problem of Multiple Equilibria

7 Classification of Games

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 2 / 60

Interactive Decision Problem

Introduction

An interactive decision problemInvolves two or more playersEach make a decision in which the payoff depends on everyplayersBroadly speaking, two types of game:

Zero-sum game: have winners and losersnon-zero-sum game: Can be all winners, or all losers, or both.

DefinitionA static game is one in which a single decision is made by each player,and each player has no knowledge of the decision made by the otherplayers before making their own decision. Decisions are madesimultaneously (or order is irrelevant).

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 4 / 60

Interactive Decision Problem

Prisoners’ DilemmaTwo crooks caught by the policeman.

Prisoner 2 Prisoner 2(not confess) (confess)

Prisoner 1 -2, -2 -5, 0(not confess)

Prisoner 1 0, -5 -4, -4(confess)

What should each prisoner do?Consider prisoner 1, what is the proper response?Consider prisoner 2, what is the proper response?The outcome is both will confess.This outcome is not socially efficient (from the prisoners’perspective).

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 5 / 60

Interactive Decision Problem

DefinitionA solution is Pareto optimal if no player’s payoff can be increasedwithout decreasing the payoff to another player. Such solution are alsotermed socially efficient.

Standardized Prisoner’s DilemmaAny game of the form

Prisoner 2 Prisoner 2(silence) (defection)

Prisoner 1 r,r s, t(silence)Prisoner 1 t, s p, p(defection)

with t > r > p > s is called a Prisoner’s Dilemma where t(temptation),r (reward), p(punishment), s(sucker)., e.g., t = 5, r = 3,p = 1 ands = 0. Outcome is socially inefficient.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 6 / 60

Description of Static Game

DescriptionThe set of players, indexed by i ∈ {1,2, . . . , };A pure strategy S i for player i ;Payoff for each player for every possible combination of purestrategies used by all players. Payoff of player i is (assuming twoplayers only):

πi(s1, s2) ∀si ∈ S i .

Or we can use the following notation:

πi(si , s−i) ∀si ∈ S i .

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 8 / 60

Description of Static Game

DefinitionA tabular description of a game, using pure strategies, is called thenormal form or strategic form of a game.

Remark: For a static game, there is no real distinction between purestrategies and actions. In dynamic games, the distinction will becomeimportant.

Example:For the prisoners’ dilemma, the pure strategy sets areS1 = S2 = {C̄,C} and the payoffs are π1(C̄, C̄) = −2, π1(C̄,C) = −5,π2(C̄,C) = 0.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 9 / 60

Description of Static Game

DefinitionA mixed strategy for player i gives the probabilities that action s ∈ S iwill be played. A mixed strategy is denoted as σi and the set of allpossible mixed strategies for player i is denoted by

∑i .

RemarkIf a player has a set of strategies S = {sa, sb, sc , . . .}, then a mixedstrategy can be represented as a vector of probabilities:

σ = (p(sa),p(sb),p(sc), . . .).

A pure strategy can be represented as: sb = (0,1,0, . . .).Mixed strategies can be represented as linear combination of purestrategies

σ =∑s∈S

p(s)s.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 10 / 60

Description of Static Game

Remark: continueIf player 1 (player 2) chooses pure strategy s with probability p(s)(q(s)), the payoff for mixed strategy are:

πi(σ1, σ2) =∑

s1∈S1

∑s2∈S2

p(s1)q(s2)πi(s1, s2).

HW: Exercise 4.1.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 11 / 60

Solving Games using Dominance

DefinitionA strategy for player 1, σ1, is strictly dominated by σ

1 if

π1(σ′

1, σ2) > π1(σ1, σ2) σ2 ∈∑

2.

DefinitionA strategy for player 1, σ1, is weakly dominated by σ

1 if

π1(σ′

1, σ2) ≥ π1(σ1, σ2) σ2 ∈∑

2,

and∃σ′2 s.t. π1(σ

1, σ′

2) > π1(σ1, σ′

2).

A similar definition applies for player 2.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 13 / 60

Solving Games using Dominance

Example 1

P2 (L) P2 (R)P1 (U) 3,3 2,2P1 (D) 2,1 2,1

AssumptionsPlayers are rational.Common knowledge of rationality (CKR).For player 1, U weakly dominates D.For player 2, L weakly dominates R.Consequently, player 1 will not play D and player 2 will not play R,leaving solution (U,L).

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 14 / 60

Solving Games using Dominance

Example 2

Find the outcome of the following game.P2 (L) P2 (M) P2 (R)

P1 (U) 1,0 1,2 0,1P1 (D) 0,3 0,1 2,0

Solution: (U,M).

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 15 / 60

Solving Games using Dominance

Example 3

The following example shows that for weakly dominatedstrategies, the solution may depend on the order in whichstrategies are eliminated.Find the outcome of the following game.

P2 (L) P2 (M) P2 (R)P1 (U) 10,0 5,1 4,−2P1 (D) 10,1 5,0 1,−1

If player 1 goes first, the outcome is (U,M).If player 2 goes first, he eliminates R, there is no dominatedstrategy. Four possible solutions: (U,L), (U,M), (D,L) and (D,M).

HW: Exercise 4.2.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 16 / 60

Nash Equilibria

Example AConsider the following game:

P2 (L) P2 (M) P2 (R)P1 (U) 1,3 4,2 2,2P1 (C) 4,0 0,3 4,1P1 (D) 2,5 3,4 5,6

Neither player has any dominated strategies.Nevertheless, there is an "obvious" solution, (D,R), whichmaximizes the payoff of both players.Is it possible to define a solution in terms of something other thanthe elimination of dominated strategies that both identifies suchobvious solutions, and keep many of the results derived usingdominance techniques? Yes.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 18 / 60

Nash Equilibria

DefinitionA Nash equilibrium (for two player games) is a pair of strategies(σ∗1, σ

∗2) such that

π1(σ∗1, σ∗2) ≥ π1(σ1, σ

∗2) ∀σ1 ∈

∑1

andπ2(σ∗1, σ

∗2) ≥ π2(σ∗1, σ2) ∀σ2 ∈

∑2.

RemarkIn other words, given the strategy adopted by the other player, neitherplayer could do strictly better (i.e., increase their payoff) by adoptinganother strategy.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 19 / 60

Nash Equilibria

Solution to Example A

SolutionLet σ∗2 = R and let σ1 = (p,q,1− p − q). We have

π1(σ1,R) = 2p + 4q + 5(1− p − q) = 5− 3p − q≤ 5 = π1(D,R).

let σ∗1 = D and let σ2 = (p,q,1− p − q). We have

π2(D, σ2) = 5p + 4q + 6(1− p − q) = 6− p − 2q≤ 6 = π2(D,R).

Consequently, the pair (D,R) constitutes a Nash equilibrium.

HW: Exercise 4.3.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 20 / 60

Nash Equilibria

CommentsNash equilibrium never includes strictly dominated strategies.It may include weakly dominated strategies.

Nash EquilibriumWhat we had is a procedure to "check" whether a point is a Nashequilibrium.It will be good to have an alternative method (or definition) to findthe Nash equilibrium.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 21 / 60

Nash Equilibria

DefinitionA strategy for player 1, σ̂1, is a best response to some (fixed) strategyfor player 2, σ2, if

σ̂1 ∈ argmaxσ1∈∑

1π1(σ1, σ2).

Similarly, σ̂2, is a best response to some σ1 if

σ̂2 ∈ argmaxσ2∈∑

2π1(σ1, σ2).

DefinitionA pair of strategies (σ∗1, σ

∗2) is a Nash equilibrium if

σ∗1 ∈ argmaxσ1∈∑

1π1(σ1, σ

∗2).

andσ∗2 ∈ argmax

σ2∈∑

1π1(σ∗1, σ2).

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 22 / 60

Nash Equilibria

How to find Nash Equilibrium

Matching PenniesTwo players each play a penny on a table. Either "heads up" or"tails up". If the pennies match, player 1 wins the pennies; if thepennies differ, then player 2 wins the pennies.Game representation

P2 (H) P2 (T)P1 (H) 1,−1 −1,1P1 (T) −1,1 1,−1

Is there any pure strategy pair that is a Nash equilibrium? (gothrough the loop !).

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 23 / 60

Nash Equilibria

AnalysisLet σ1 = (p,1− p) and σ2 = (q,1− q).Payoff of player 1 is

π1(σ1, σ2) = pq − p(1− q)− (1− p)q + (1− p)(1− q)

= 1− 2q + 2p(2q − 1)

Clearly, if q < 1/2, player 1’s best response is p = 0 (i.e.,σ̂1 = (0,1), "play Tails").If q > 1/2, player 1’s best response is p = 1 (i.e., σ̂1 = (1,0), "playHeads").If q = 1/2, then every mixed (and pure) strategy is a bestresponse.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 24 / 60

Nash Equilibria

Analysis: continueConsider player 2’s payoff:

π2(σ1, σ2) = −pq + p(1− q) + (1− p)q − (1− p)(1− q)

= −1 + 2p + 2q(1− 2p)

Clearly, if p < 1/2, player 2’s best response is q = 1 (i.e.,σ̂2 = (1,0), "play Heads").If p > 1/2, player 2’s best response is q = 0 (i.e., σ̂2 = (0,1), "playTails").If p = 1/2, then every mixed (and pure) strategy is a bestresponse.

SolutionSo the only pair of strategies for which each is the best response:σ∗1 = σ∗2 = (1/2,1/2). The expected payoffs for each player areπi(σ

∗1, σ∗2) = 0.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 25 / 60

Nash Equilibria

Homework: Exercise 4.4.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 26 / 60

Nash Equilibria

TheoremSuppose there exists a pair of pure strategies (s∗1, s

∗2) such that

π1(s∗1, s∗2) ≥ π1(s1, s∗2) ∀s1 ∈ S1, and

π2(s∗1, s∗2) ≥ π1(s∗1, s2) ∀s2 ∈ S2,

then (s∗1, s∗2) is a Nash equilibrium.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 27 / 60

Nash Equilibria

ProofFor all σ1 ∈

∑1 we have

π1(σ1, s∗2) =∑

s∈S1

p(s)π1(s1, s∗2)

≤∑

s∈S1

p(s)π1(s∗1, s∗2) = π1(s∗1, s

∗2).

For all σ2 ∈∑

2 we have

π2(σ∗1, s2) =∑

s∈S2

q(s)π2(s∗1, s2)

≤∑

s∈S2

q(s)π2(s∗1, s∗2) = π2(s∗1, s

∗2).

Hence, (s∗1, s∗2) is a Nash equilibrium.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 28 / 60

Nash Equilibria

ExampleConsider the following game:

P2 (L) P2 (M) P2 (R)P1 (U) 1,3 4,2 2,2P1 (C) 4,0 0,3 4,1P1 (D) 2,5 3,4 5,6

Payoffs corresponding to a pure strategy that is a best response toone of the opponent’s pure strategies are underlined.Two underlinings coincide for entry (5,6) or entry (D,R).So, D is the best response to R and vice versa.(D,R) is the Nash equilibrium.

HW: Exercise 4.5.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 29 / 60

Nash Equilibria

Exercise

A man has two sons. When he dies, the value of his estate is $1000.In his will it states the two sons must each specify an amount si thatthey are willing to accept. If s1 + s2 ≤ 1000, then each gets the moneyhe asked for and the remainder goes to a church. If s1 + s2 > 1000,then neither son receives any money and $1000 goes to a church.Assume (a) the two men care only the amount they will get; (b) theycan only ask in unit of a dollar. Find all the pure strategy Nashequilibria of the game.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 30 / 60

Nash Equilibria

In the game of matching pennies, we discovered that any strategy is abest response to the Nash equilibrium strategy of the other players. Letus show this in general. To begin we, we need the following definition.

DefinitionThe support of a strategy σ is the set S(σ) ⊆ S for all the strategies forwhich σ specifies p(s) > 0.

ExampleSuppose an individual’s pure strategy set is S = {L,M,R}. Consider amixed strategy of the form σ = (p,1− p,0) and 0 < p < 1.S(σ) = {L,M}.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 31 / 60

Nash Equilibria

Theorem: Equality of PayoffsLet (σ∗1, σ

∗2) be a Nash equilibrium, and let S∗1 be the support of σ∗1.

Then π1(s, σ∗2) = π1(σ∗1, σ∗2), ∀s ∈ S∗1.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 32 / 60

Nash Equilibria

ProofIf S∗1 contains one strategy, then it is trivial. When S∗1 contains morethan one strategy, if the theorem is not true, then at least one strategygives higher payoff to player 1 than π1(σ∗1, σ

∗2). Let s′ be that strategy,

then

π1(σ∗1, σ∗2) =

∑s∈S∗1

p∗(s)π1(s, σ∗2)

=∑s 6=s′

p∗(s)π1(s, σ∗2) + p∗(s′)π1(s′, σ∗2)

<∑s 6=s′

p∗(s)π1(s′, σ∗2) + p∗(s′)π1(s′, σ∗2) = π1(s′, σ∗2).

This contradicts the original assumption that (σ∗1, σ∗2) is a Nash

equilibrium.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 33 / 60

Nash Equilibria

Comment

Since all strategies s ∈ S∗1 give the same payoff as therandomized strategy σ∗1, why does player 1 need to randomize?If player 1 were to deviate from σ∗1, then σ∗2 would no longer be abest response and the equilibrium would disintegrate.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 34 / 60

Nash Equilibria

ExampleConsider the "Matching Pennies" Game. Suppose player 2 playsH with probability q and T with 1− q.If player 1 is playing a mixed strategy at the NE, then

π1(H, σ∗2) = π1(T , σ∗2)

⇔ qπ1(H,H) + (1− q)π1(H,T ) = qπ1(T ,H) + (1− q)π1(T ,T )

⇔ q − (1− q) = −q + (1− q)

⇔ 4q = 2

⇔ q =12

The same argument applies with the players swapped over. Sothe NE is (σ∗1, σ

∗2) = ((1/2,1/2), (1/2,1/2)).

HW: Exercise 4.7.John C.S. Lui (CUHK) Advanced Topics in Network Analysis 35 / 60

Existence of NE

Nash’s TheoremEvery game that has a finite strategic form (i.e., with finite number ofplayers and finite number of pure strategies for each player) has atleast one Nash equilibrium (involving pure or mixed strategies).

RemarkFor formal proof, please refer to the book by Fudenberg and Tirole.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 37 / 60

Existence of NE

Existence of NE for a simple caseEvery two player, two action game has at least one Nash equilibrium.

ProofConsider the following game

P2 (L) P2 (R)P1 (U) a,b c,dP1 (D) e, f g,h

First, consider pure-strategy NE: if a ≥ e and b ≥ d , then (U,L) isa NE; if e ≥ a and f ≥ h, then (D,L) is a NE; if c ≥ g and d ≥ b,then (U,R) is a NE; if g ≥ c and h ≥ f , then (D,R) is a NE.There is no pure strategy NE if:

a < e, f < h and g < c and d < b, ora > e, f > h and g > c and d > b.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 38 / 60

Existence of NE

Proof: continue with mixed strategyUsing the "Equality of Payoff" Theorem. let σ∗1 = (p∗,1− p∗) andσ∗2 = (q∗,1− q∗), then

π1(U, σ∗2) = π1(D, σ∗2)

⇔ aq∗ + c(1− q∗) = eq∗ + g(1− q∗)

⇔ q∗ =(c − g)

(c − g) + (e − a)

Similarly

π2(σ∗1,L) = π2(σ∗1,R)

⇔ bp∗ + f (1− p∗) = dp∗ + h(1− p∗)

⇔ p∗ =(h − f )

(h − f ) + (b − d)

In both cases, we require 0 < p∗,q∗ < 1 for a mixed strategy NE.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 39 / 60

Existence of NE

HomeworkConsider the following game with 2 players:

P2 (A) P2 (B)P1 (A) a,a b, cP1 (B) c,b d ,d

Show that such a game has at least one symmetric NashEquilibrium.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 40 / 60

The Problem of Multiple Equilibria

ExampleThe following game is "Battle of the Sexes": Husband prefers towatch the football (F), wife prefers to watch the soap opera (S).

Wife (F ) Wife (S)Husband (F ) 3,2 1,1Husband (S) 0,0 2,3

Using the "best response method", there are two pure-strategyNash equilibria: (F ,F ), (S,S).Using the "Equality of Payoffs Theorem", we can find a mixedstrategy at Nash equilibrium (σ∗h, σ

∗w ) with

σ∗h = (p(F ),p(S)) = (3/4,1/4) andσ∗w = (q(F ),q(S)) = (1/4,3/4).Although we have three NEs, how should player decide?For the randomizing NE, the asymmetric outcomes can occur(e.g., (F,S) or (S,F)). The most likely outcome is (F ,S) whichoccurs with probability 9/16.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 42 / 60

Classification of Games

DefinitionA generalized affine transformation of the payoffs for player 1 is

π′

1(s1, s2) = α1π1(s1, s2) + β1(s2) ∀s1 ∈ S1, α1 > 0, β1(s2) ∈ IR.

Similarly, an affine transformation of the payoffs for player 2 is

π′

2(s1, s2) = α2π2(s1, s2) + β2(s1) ∀s2 ∈ S2, α2 > 0, β2(s1) ∈ IR.

Example

P2(L) P2(R)P1 (U) 3,3 0,0P1 (D) −1,2 2,8

=⇒P2(L) P2(R)

P1 (U) 2,1 0,0P1 (D) 0,0 1,2

where α1 = 1/2, β1(L) = 1/2, β1(R) = 0, α2 = 1/3, β2(U) = 0,β2(D) = −2/3. What are their NEs? Do they use the same strategies?

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 44 / 60

Classification of Games

TheoremIf the payoff table is altered by generalized affine transformations, theset of Nash equilibria is unaffected (although the payoffs at thoseequilibria do change).

Proof

π′

1(σ∗1 , σ∗2) ≥ π

1(σ1, σ∗2),

∑s1

∑s2

p∗(s1)q∗(s2)π′

1(s1, s2) ≥∑s1

∑s2

p(s1)q∗(s2)π′

1(s1, s2),

α1

∑s1

∑s2

p∗(s1)q∗(s2)π1(s1, s2) +∑s1

∑s2

p∗(s1)q∗(s2)β2(s2)

≥ α1

∑s1

∑s2

p(s1)q∗(s2)π1(s1, s2) +∑s1

∑s2

p(s1)q∗(s2)β2(s2),

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 45 / 60

Classification of Games

Proof: continue

α1

∑s1

∑s2

p∗(s1)q∗(s2)π1(s1, s2) +∑s2

q∗(s2)β2(s2)

≥ α1

∑s1

∑s2

p(s1)q∗(s2)π1(s1, s2) +∑s2

q∗(s2)β2(s2),

α1

∑s1

∑s2

p∗(s1)q∗(s2)π1(s1, s2) ≥ α1

∑s1

∑s2

p(s1)q∗(s2)π1(s1, s2)∑s1

∑s2

p∗(s1)q∗(s2)π1(s1, s2) ≥∑s1

∑s2

p(s1)q∗(s2)π1(s1, s2)

π1(σ∗1 , σ∗2) ≥ π1(σ1, σ

∗2)

The analogous argument for player 2 completes the proof.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 46 / 60

Classification of Games

Generic and Non-generic Games

DefinitionA generic game is one in which a small change ( or non-affinetransformation) of any one of the payoffs does not introduce new Nashequilibria or remove existing ones. In practice, this means that thereshould be no equalities between payoffs that are compared todetermine a Nash equilibrium.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 47 / 60

Classification of Games

Example of non-generic gameGames we have examined (e.g., prisoners dilemma, matchingpennies, battles of sexes) have been generic.Consider the following non-generic game:

P2 (L) P2 (M) P2 (R)P1 (U) 10,0 5,1 4,−2P1 (D) 10,1 5,0 1,−1

It is non-generic(D,L) is a NE, but player 1 gets the same payoff by playing Urather than D (against L).Similarly, (U,M) is a NE, but player 1 gets the same payoff byplaying D rather than U (against M).

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 48 / 60

Classification of Games

Oddness TheoremAll generic games have an "odd" number of Nash equilibria.

RemarkA formal proof is rather difficult. Reading assignment.Consider the following illustration of the "Battle of Sexes":

1

1

q

p

In contrast, the number of Nash equilibria in a non-generic gameis (usually) infinite !!!

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 49 / 60

Classification of Games

Consider the previous "non-generic" game. Let σ1 = (p,1− p)and σ2 = (q, r ,1− q − r), then

π1(σ1, σ2) = 1 + 9q + 4r + 3p(1− q − r)

π2(σ1, σ2) = −(1 + p) + 2q + r(1 + 2p).

The best responses are

σ̂1 =

{(1,0) if q + r < 1,(x ,1− x) if q + r = 1, with x ∈ [0,1].

σ̂2 =

(1,0,0) if p < 1/2,(0,1,0) if p > 1/2,(y ,1− y ,0) if p = 1/2, with y ∈ [0,1].

NEs: (1) σ∗1 = (x ,1− x) with x ∈ [0,1/2) and σ∗2 = (1,0,0), (2)σ∗1 = (x ,1− x) with x ∈ (1/2,1] and σ∗2 = (0,1,0), (3)σ∗1 = (1/2,1/2) and σ∗2 = (y ,1− y ,0) with y ∈ [0,1].

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 50 / 60

Classification of Games

HW: Exercise 4.10.

Zero-sum GamesA zero-sum game is one in which the payoffs to the players add upto zero, e.g., "Matching Pennies" is a zero-sum game. If player 1uses a strategy σ1 = (p,1− p) and player 2 uses a strategyσ2 = (q,1− q), we have:

π1(σ1, σ2) = pq +−p(1− q)− (1− p)q + (1− p)(1− q)

= (2p − 1)(2q − 1) = −π2(σ1, σ2)

In other words, the interests of the players are exactly opposed:one only wins what the other loses.Zero-sum games were first type of games to be studied (before J.Nash).Zero-sum games were solved by finding the "minimax" solution.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 51 / 60

Classification of Games

Claim:Define π(σ1, σ2) = π1(σ1, σ2) = −π2(σ1, σ2). The NE conditions:

π1(σ∗1, σ∗2) ≥ π1(σ1, σ

∗2) ∀σ1 ∈

∑1

π2(σ∗1, σ∗2) ≥ π2(σ∗1, σ2) ∀σ2 ∈

∑2.

The above NE conditions can be rewritten:

π(σ∗1, σ∗2) = max

σ1∈∑

1

π(σ1, σ∗2)

π(σ∗1, σ∗2) = min

σ∗2∈∑

2

π(σ∗1, σ2).

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 52 / 60

Classification of Games

Claim continueSince both players should play a best response to the other’sstrategy, these two conditions can be combined as:

π(σ∗1, σ∗2) = max

σ1∈∑

1

π(σ1, σ∗2) = max

σ1∈∑

1

minσ2∈∑

2

π(σ1, σ2).

Equivalently,

π(σ∗1, σ∗2) = min

σ2∈∑

2

π(σ∗1, σ2) = minσ2∈∑

2

maxσ1∈∑

1

π(σ1, σ2).

In other words, player 1 uses the "maximin" while player 2 usesthe "minimax".

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 53 / 60

Classification of Games

Application of Min-max algorithmConsider the following game:

A B C DA 4, -4 3, -3 2, -2 5, -5 2B -10,10 2, -2 0, 0 -1, 1 -10C 7,-7 5, -5 1, -1 3, -3 1D 0,0 8, -8 -4, 4 -5, 5 -5

7 8 2 5Player 1: choose minimum for each row, then find maximum entry(or the maximin operation).Player 2: choose maximum for each column, then find minimumentry (or the minimax operation).If maximin = minimax, it is the Nash equilibrium.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 54 / 60

Classification of Games

Comment on the Min-max algorithmIn general, zero-sum game can have multiple NE.

A B C DA 3, -3 2, -2 2, -2 5, -5 2B 2,-2 -10,10 0, 0 -1, 1 -10C 5,-5 2, -2 2, -2 3, -3 2D 8,-8 0,0 8 -4, 4 -5, 5 -5

8 2 2 5Same payoff in every NE.Strategies are interchangeable. Example, strategies (A,B) and(C,C) are NE, then (A,C) and (C,B) are also NE.

Note that for zero-sum game without pure strategies NE, we have toconsider mixed strategies.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 55 / 60

Classification of Games

Application of the Equality of Payoffs Theorem

ExerciseAn "Ace-King-Queen" game with two players. Each player bets $5.Each player chooses a card from the set {Ace(A),King(K),Queen(Q)}.The winning rule is: A beats K; K beats Q; Q beats A. The winningplayer takes the $10 in the pot. If both players choose the same card(both A, both K, or both Q), the game is drawn and $5 stake is returnedto each player. What is the unique Nash equilibrium for this game?

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 56 / 60

Classification of Games

Theorem on Zero-sum GameA generic zero-sum game has a unique solution.

ProofRefer to Von Neuman and Morgenstern, "Theory of Games andEconomic Behavior", 3rd edition, Princeton University, 1953.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 57 / 60

Classification of Games

Games with n−players

Label player by i ∈ {1,2, . . . ,n}.Player i has a set of pure strategies S i and the correspondingmixed strategies

∑i .

Payoff of player i depends on the list of strategies σ1, σ2, . . . , σn.We also use σ−i to denote the list of strategies used by all playersexcept player i . So payoff for player i is πi(σi , σ−i).Suppose player i uses a mixed strategy σi which specifies playingpure strategies s ∈ S i with pi(s). Payoff is

πi (σi , σ−i ) =∑

s1∈S1

· · ·∑

sn∈Sn

p1(s1) · · · pn(sn)πi (s1, . . . , sn).

A NE in a n−player game is a list of mixed strategies σ∗1, . . . , σ∗n

such that

σ∗i ∈ argmaxσi∈P

iπi(σi , σ

∗−i) ∀i ∈ {1,2, . . . ,n}.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 58 / 60

Classification of Games

ExampleA static three-player game: P1 chooses U and D; P2 chooses Land R; P3 chooses A and B.Instead of representing a 3−dimensional payoff table, we have thefollowing payoff tables: when P3 plays A or B:

A P2(L) P2(R)P1 (U) 1,1,0 2,2,3P1 (D) 2,2,3 3,3,0

B P2(L) P2(R)P1 (U) −1,−1,2 2,0,2P1 (D) 0,2,2 1,1,2

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 59 / 60

Classification of Games

Continue:Suppose P3 chooses A, the best responses for P1 and P2 arestrategies σ̂1 = σ̂2 = (0,1). Note that this is NOT a NE becausechoosing A may not be the best response of P3.Suppose P3 chooses B, the best responses for P1 and P2 arestrategies σ̂1 = σ̂2 = (1/2,1/2).By playing B, P3 gains 2.The NE (σ∗1, σ

∗2, σ∗3) with

σ∗1 = (1/2,1/2); σ∗2 = (1/2,1/2); σ∗3 = (0,1).

HW: Exercise 4.14.

John C.S. Lui (CUHK) Advanced Topics in Network Analysis 60 / 60