Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos...

88
Online Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/ ~ ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation (MPLA) Wednesday 17 th September, 2008 ygiannak (MPLA) Online Mechanism Design 17/09/2008 1 / 41

Transcript of Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos...

Page 1: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Online Mechanism DesignM.Sc. Thesis

Yiannis Giannakopoulosusers.uoa.gr/~ygiannak

University of AthensGraduate Program in Logic, Algorithms and Computation (MPLA)

Wednesday 17th September, 2008

ygiannak (MPLA) Online Mechanism Design 17/09/2008 1 / 41

Page 2: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Motivation

Online Auctions:I Bidders arrive dynamically over timeI Auctioneer has no knowledge of future eventsI His decisions can only be based on past events

Examples:I eBay auctionsI selling airplane seats or theater ticketsI scheduling computer jobs on a shared serverI Allocating and pricing network resources (e.g. access to a WiFi

network)

“Decision Making under Uncertainty” problems

We choose the framework of Game Theory to study it because weassume our agents (bidders) are

I Selfish → they only care about their own “happiness”I Rational → they always do the right choices to maximize this happiness

ygiannak (MPLA) Online Mechanism Design 17/09/2008 2 / 41

Page 3: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Motivation

Online Auctions:I Bidders arrive dynamically over timeI Auctioneer has no knowledge of future eventsI His decisions can only be based on past events

Examples:I eBay auctionsI selling airplane seats or theater ticketsI scheduling computer jobs on a shared serverI Allocating and pricing network resources (e.g. access to a WiFi

network)

“Decision Making under Uncertainty” problems

We choose the framework of Game Theory to study it because weassume our agents (bidders) are

I Selfish → they only care about their own “happiness”I Rational → they always do the right choices to maximize this happiness

ygiannak (MPLA) Online Mechanism Design 17/09/2008 2 / 41

Page 4: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Motivation

Online Auctions:I Bidders arrive dynamically over timeI Auctioneer has no knowledge of future eventsI His decisions can only be based on past events

Examples:I eBay auctionsI selling airplane seats or theater ticketsI scheduling computer jobs on a shared serverI Allocating and pricing network resources (e.g. access to a WiFi

network)

“Decision Making under Uncertainty” problems

We choose the framework of Game Theory to study it because weassume our agents (bidders) are

I Selfish → they only care about their own “happiness”I Rational → they always do the right choices to maximize this happiness

ygiannak (MPLA) Online Mechanism Design 17/09/2008 2 / 41

Page 5: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Outline

1 Online Problems

2 Game Theory and Mechanism Design

3 Online Mechanism Design

4 Online Auctions

ygiannak (MPLA) Online Mechanism Design 17/09/2008 3 / 41

Page 6: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Outline

1 Online Problems

2 Game Theory and Mechanism Design

3 Online Mechanism Design

4 Online Auctions

ygiannak (MPLA) Online Mechanism Design 17/09/2008 3 / 41

Page 7: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Outline

1 Online Problems

2 Game Theory and Mechanism Design

3 Online Mechanism Design

4 Online Auctions

ygiannak (MPLA) Online Mechanism Design 17/09/2008 3 / 41

Page 8: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Outline

1 Online Problems

2 Game Theory and Mechanism Design

3 Online Mechanism Design

4 Online Auctions

ygiannak (MPLA) Online Mechanism Design 17/09/2008 3 / 41

Page 9: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Presentation Progress

1 Online Problems

2 Game Theory and Mechanism Design

3 Online Mechanism Design

4 Online Auctions

ygiannak (MPLA) Online Mechanism Design 17/09/2008 4 / 41

Page 10: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Optimization Problems

Computer Science → optimization problemsI goal: maximize or minimize an objective functionI Examples: bin packing, shortest paths, ...I Running time (minimization)

Approximation Algorithms:I Optimal solutions can be determined mathematically but many times

are “hard” to compute (NP-hard)I What if we could easily compute an almost optimal solution?I Algorithm A is c-approximate if it performs within a factor of c with

respect to the optimal (c > 1)I Performance benchmark: optimal algorithm

ygiannak (MPLA) Online Mechanism Design 17/09/2008 5 / 41

Page 11: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Optimization Problems

Computer Science → optimization problemsI goal: maximize or minimize an objective functionI Examples: bin packing, shortest paths, ...I Running time (minimization)

Approximation Algorithms:I Optimal solutions can be determined mathematically but many times

are “hard” to compute (NP-hard)I What if we could easily compute an almost optimal solution?I Algorithm A is c-approximate if it performs within a factor of c with

respect to the optimal (c > 1)I Performance benchmark: optimal algorithm

ygiannak (MPLA) Online Mechanism Design 17/09/2008 5 / 41

Page 12: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Online (Optimization) Problems

“Traditional” (offline) Algorithmic Design: the input is known inadvance and in full

Online Algorithms: the input is revealed gradually over time. Thus,decisions must be based only on information already received in thepast.

I many interesting problems are online by their nature: paging, loadbalancing, k-server, etc.

I online versions of offline problems, e.g. bin packing.

Uncertainty about future → things can go really bad...

What benchmark shall we use to measure performance?

ygiannak (MPLA) Online Mechanism Design 17/09/2008 6 / 41

Page 13: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Online (Optimization) Problems

“Traditional” (offline) Algorithmic Design: the input is known inadvance and in full

Online Algorithms: the input is revealed gradually over time. Thus,decisions must be based only on information already received in thepast.

I many interesting problems are online by their nature: paging, loadbalancing, k-server, etc.

I online versions of offline problems, e.g. bin packing.

Uncertainty about future → things can go really bad...

What benchmark shall we use to measure performance?

ygiannak (MPLA) Online Mechanism Design 17/09/2008 6 / 41

Page 14: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Online (Optimization) Problems

“Traditional” (offline) Algorithmic Design: the input is known inadvance and in full

Online Algorithms: the input is revealed gradually over time. Thus,decisions must be based only on information already received in thepast.

I many interesting problems are online by their nature: paging, loadbalancing, k-server, etc.

I online versions of offline problems, e.g. bin packing.

Uncertainty about future → things can go really bad...

What benchmark shall we use to measure performance?

ygiannak (MPLA) Online Mechanism Design 17/09/2008 6 / 41

Page 15: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Competitive Analysis

Notation:I online optimization (maximization, w.l.o.g.) problem PI set of possible instances (inputs) XI for each x ∈ X a set F (x) of feasible solutions (outcomes)I Objective function σ(x , y) ∈ R≥0, x ∈ X , y ∈ F (x).

Every algorithm A for P computes a solution A(x) ∈ F (x) given inputx and achieves σ(x ,A(x)).

Benchmark: an (unrealizable) optimal offline algorithm that has fullknowledge of the future (and x).

ygiannak (MPLA) Online Mechanism Design 17/09/2008 7 / 41

Page 16: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Competitive Analysis

Notation:I online optimization (maximization, w.l.o.g.) problem PI set of possible instances (inputs) XI for each x ∈ X a set F (x) of feasible solutions (outcomes)I Objective function σ(x , y) ∈ R≥0, x ∈ X , y ∈ F (x).

Every algorithm A for P computes a solution A(x) ∈ F (x) given inputx and achieves σ(x ,A(x)).

Benchmark: an (unrealizable) optimal offline algorithm that has fullknowledge of the future (and x).

ygiannak (MPLA) Online Mechanism Design 17/09/2008 7 / 41

Page 17: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Competitive Analysis (cont.)

We will say that online algorithm A is c-competitive, if

σ(x ,OPT(x))

σ(x ,A(x))≤ c for all x ∈ X .

c > 1 (for minimization problems, invert fraction)

What is the best (minimum) c we can achieve? (best performanceguarantee)

Definition

Let A be an online algorithm for some (online) maximization problem Pwith objective function σ. The competitive ratio of A is

CRP(A) = supx∈X

σ(x ,OPT(x))

σ(x ,A(x)).

ygiannak (MPLA) Online Mechanism Design 17/09/2008 8 / 41

Page 18: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Competitive Analysis (cont.)

We will say that online algorithm A is c-competitive, if

σ(x ,OPT(x))

σ(x ,A(x))≤ c for all x ∈ X .

c > 1 (for minimization problems, invert fraction)

What is the best (minimum) c we can achieve? (best performanceguarantee)

Definition

Let A be an online algorithm for some (online) maximization problem Pwith objective function σ. The competitive ratio of A is

CRP(A) = supx∈X

σ(x ,OPT(x))

σ(x ,A(x)).

ygiannak (MPLA) Online Mechanism Design 17/09/2008 8 / 41

Page 19: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Competitive Analysis (cont.)

supx∈XOPT(x)

A(x) → “competing” against a malicious, almightyadversary who tries to destroy us...

Competitive ratio of a problem:

CRP = infA

supx∈X

σ(x ,OPT(x))

σ(x ,A(x))

We first design the best algorithm A we can (without knowing x) andthen the adversary chooses the worst input x .

Worst-case analysis framework (CS) vs. average-case (Bayesian,distribution assumptions) analysis (Economics)

ygiannak (MPLA) Online Mechanism Design 17/09/2008 9 / 41

Page 20: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Competitive Analysis (cont.)

supx∈XOPT(x)

A(x) → “competing” against a malicious, almightyadversary who tries to destroy us...

Competitive ratio of a problem:

CRP = infA

supx∈X

σ(x ,OPT(x))

σ(x ,A(x))

We first design the best algorithm A we can (without knowing x) andthen the adversary chooses the worst input x .

Worst-case analysis framework (CS) vs. average-case (Bayesian,distribution assumptions) analysis (Economics)

ygiannak (MPLA) Online Mechanism Design 17/09/2008 9 / 41

Page 21: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Presentation Progress

1 Online Problems

2 Game Theory and Mechanism Design

3 Online Mechanism Design

4 Online Auctions

ygiannak (MPLA) Online Mechanism Design 17/09/2008 10 / 41

Page 22: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Games

“game”: players, strategies, payoffs (rewards)

The Prisoner’s Dilemma

Prisoner 2

confess silent

Prisoner 1confess −1, −10

silent −10, −1 −2, −2

“rational” game solution (outcome)?I Stable equilibrium

ygiannak (MPLA) Online Mechanism Design 17/09/2008 11 / 41

Page 23: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Games

“game”: players, strategies, payoffs (rewards)

The Prisoner’s Dilemma

Prisoner 2

confess silent

Prisoner 1confess −5, −5 −1, −10

silent −10, −1 −2, −2

“rational” game solution (outcome)?I Stable equilibrium

ygiannak (MPLA) Online Mechanism Design 17/09/2008 11 / 41

Page 24: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Games

“game”: players, strategies, payoffs (rewards)

The Prisoner’s Dilemma

Prisoner 2

confess silent

Prisoner 1confess −5, −5 −1, −10

silent −10, −1 −2, −2

“rational” game solution (outcome)?

I Stable equilibrium

ygiannak (MPLA) Online Mechanism Design 17/09/2008 11 / 41

Page 25: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Games

“game”: players, strategies, payoffs (rewards)

The Prisoner’s Dilemma

Prisoner 2

confess silent

Prisoner 1confess −5, −5 −1, −10

silent −10, −1 −2, −2

“rational” game solution (outcome)?I Stable equilibrium

ygiannak (MPLA) Online Mechanism Design 17/09/2008 11 / 41

Page 26: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Dominant Strategy Equilibria

Game (strategic, in normal form):I a finite set of players N = {1, 2, . . . ,N}I for every player i ∈ N , a set of strategies Si andI for every player i , a utility function ui : S −→ R where, S =

∏Ni=1 Si is

the set of all possible strategy profiles.

Definition

A strategy profile (s∗1 , s∗2 , . . . , s

∗N) is a dominant strategy equilibrium for

our game G if, for every i ∈ N , s∗i is a dominant strategy for player i , i.e.

ui (s∗i , s−i ) ≥ ui (si , s−i ) for all si ∈ Si , s−i ∈ S−i .

Whatever s−i the other players choose to play, s∗i is the best choice forplayer i : very strong solution concept (compare Nash or pure Nashequilibria).

ygiannak (MPLA) Online Mechanism Design 17/09/2008 12 / 41

Page 27: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Dominant Strategy Equilibria

Game (strategic, in normal form):I a finite set of players N = {1, 2, . . . ,N}I for every player i ∈ N , a set of strategies Si andI for every player i , a utility function ui : S −→ R where, S =

∏Ni=1 Si is

the set of all possible strategy profiles.

Definition

A strategy profile (s∗1 , s∗2 , . . . , s

∗N) is a dominant strategy equilibrium for

our game G if, for every i ∈ N , s∗i is a dominant strategy for player i , i.e.

ui (s∗i , s−i ) ≥ ui (si , s−i ) for all si ∈ Si , s−i ∈ S−i .

Whatever s−i the other players choose to play, s∗i is the best choice forplayer i : very strong solution concept (compare Nash or pure Nashequilibria).

ygiannak (MPLA) Online Mechanism Design 17/09/2008 12 / 41

Page 28: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Mechanism Design

Games are extremely useful “gadgets” to model/predict strategicbehaviour, but “passive”. We cannot interfere.

Players have full information of the games elements (other players’utilities)

We need to express much more complex environments, set rules,make decisions.

Model uncertainty

ygiannak (MPLA) Online Mechanism Design 17/09/2008 13 / 41

Page 29: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Mechanism Design

Games are extremely useful “gadgets” to model/predict strategicbehaviour, but “passive”. We cannot interfere.

Players have full information of the games elements (other players’utilities)

We need to express much more complex environments, set rules,make decisions.

Model uncertainty

ygiannak (MPLA) Online Mechanism Design 17/09/2008 13 / 41

Page 30: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Direct-revelation Mechanisms

We have a set of possible decisions (outcomes) OEach player i has a piece of private information θi , her type.

A direct-revelation mechanism asks all players to report their typesand, based on the type profile θ = (θ1, θ2, . . . , θN)

I makes a decision x(θ) ∈ OI collects payment pi (θ) ∈ R from every player i

Every player i has a value vi (θi , o) for every outcome o ∈ O andreceives utility ui = vi − pi ,

ui (θi , x(θ)) = vi (θi , x(θ))− pi (θ)

ygiannak (MPLA) Online Mechanism Design 17/09/2008 14 / 41

Page 31: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Direct-revelation Mechanisms

We have a set of possible decisions (outcomes) OEach player i has a piece of private information θi , her type.

A direct-revelation mechanism asks all players to report their typesand, based on the type profile θ = (θ1, θ2, . . . , θN)

I makes a decision x(θ) ∈ OI collects payment pi (θ) ∈ R from every player i

Every player i has a value vi (θi , o) for every outcome o ∈ O andreceives utility ui = vi − pi ,

ui (θi , x(θ)) = vi (θi , x(θ))− pi (θ)

ygiannak (MPLA) Online Mechanism Design 17/09/2008 14 / 41

Page 32: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Direct-revelation Mechanisms

We have a set of possible decisions (outcomes) OEach player i has a piece of private information θi , her type.

A direct-revelation mechanism asks all players to report their typesand, based on the type profile θ = (θ1, θ2, . . . , θN)

I makes a decision x(θ) ∈ OI collects payment pi (θ) ∈ R from every player i

Every player i has a value vi (θi , o) for every outcome o ∈ O andreceives utility ui = vi − pi ,

ui (θi , x(θ)) = vi (θi , x(θ))− pi (θ)

ygiannak (MPLA) Online Mechanism Design 17/09/2008 14 / 41

Page 33: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Truthfulness

Why payments? Give (negative) incentives to players to report θitruthfully. We need it to make the “right” decisions.

Players are strategic and will lie (without regret) by reporting someother type θi if this gets her a better utility

ui (θi , x(θi , θ−i )),

where (θi , θ−i ) = (θ1, . . . , θi−1, θi , θi+1, . . . , θN).

Definition (Truthfulness)

A (direct-revelation) mechanism M = (x , p) is called truthful (or DSIC) if,for all possible type profiles θ = (θ1, θ2, . . . , θN), every player’s i beststrategy is to report her type truthfully, i.e.

ui (θi , x(θi , θ′−i )) ≥ ui (θi , x(θi , θ

′−i )),

for all θ′−i , θi .

ygiannak (MPLA) Online Mechanism Design 17/09/2008 15 / 41

Page 34: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Truthfulness

Why payments? Give (negative) incentives to players to report θitruthfully. We need it to make the “right” decisions.

Players are strategic and will lie (without regret) by reporting someother type θi if this gets her a better utility

ui (θi , x(θi , θ−i )),

where (θi , θ−i ) = (θ1, . . . , θi−1, θi , θi+1, . . . , θN).

Definition (Truthfulness)

A (direct-revelation) mechanism M = (x , p) is called truthful (or DSIC) if,for all possible type profiles θ = (θ1, θ2, . . . , θN), every player’s i beststrategy is to report her type truthfully, i.e.

ui (θi , x(θi , θ′−i )) ≥ ui (θi , x(θi , θ

′−i )),

for all θ′−i , θi .

ygiannak (MPLA) Online Mechanism Design 17/09/2008 15 / 41

Page 35: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Vickrey Auction

Consider a single-item, sealed-bid auction. Let p > q be the twohighest submitted bids.

Obviously, we want to give the item to the bidder that desires it themost (i.e. bids p).

But how much is she going to pay us?

First-price auctions: The highest bidding player gets allocated andpays p. Utility= p-p=0.

I NOT truthful! She could have (mis)reported some p′ with p > p′ > qfor a higher utility of p − p′ > 0.

Vickrey (second-price) auction: Again, allocate the highest bidder,but for a payment of q. Utility p − q >> 0

I Truthful! If she reports p′ > q she still gets the item for the sameutility p − q and if she reports p′ < q she loses the item.

W. Vickrey [1961]

ygiannak (MPLA) Online Mechanism Design 17/09/2008 16 / 41

Page 36: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Vickrey Auction

Consider a single-item, sealed-bid auction. Let p > q be the twohighest submitted bids.

Obviously, we want to give the item to the bidder that desires it themost (i.e. bids p).

But how much is she going to pay us?

First-price auctions: The highest bidding player gets allocated andpays p. Utility= p-p=0.

I NOT truthful! She could have (mis)reported some p′ with p > p′ > qfor a higher utility of p − p′ > 0.

Vickrey (second-price) auction: Again, allocate the highest bidder,but for a payment of q. Utility p − q >> 0

I Truthful! If she reports p′ > q she still gets the item for the sameutility p − q and if she reports p′ < q she loses the item.

W. Vickrey [1961]

ygiannak (MPLA) Online Mechanism Design 17/09/2008 16 / 41

Page 37: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Vickrey Auction

Consider a single-item, sealed-bid auction. Let p > q be the twohighest submitted bids.

Obviously, we want to give the item to the bidder that desires it themost (i.e. bids p).

But how much is she going to pay us?

First-price auctions: The highest bidding player gets allocated andpays p. Utility= p-p=0.

I NOT truthful! She could have (mis)reported some p′ with p > p′ > qfor a higher utility of p − p′ > 0.

Vickrey (second-price) auction: Again, allocate the highest bidder,but for a payment of q. Utility p − q >> 0

I Truthful! If she reports p′ > q she still gets the item for the sameutility p − q and if she reports p′ < q she loses the item.

W. Vickrey [1961]

ygiannak (MPLA) Online Mechanism Design 17/09/2008 16 / 41

Page 38: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Efficiency

Efficiency → combined “social welfare” (satisfaction).

E (θ) =N∑

i=1

vi (θi , x(θ))

Revenue: R(θ) =∑N

i=1 pi (x(θ)).

The “big” ideas behind the Vickrey auction:I every player’s payment is independent of her report θi .I decision x(θ) is the best possible outcome for every player.

We want to design truthful mechanisms for general settings that alsomaximize efficiency. Based on the Vickrey ideas:

ygiannak (MPLA) Online Mechanism Design 17/09/2008 17 / 41

Page 39: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Efficiency

Efficiency → combined “social welfare” (satisfaction).

E (θ) =N∑

i=1

vi (θi , x(θ))

Revenue: R(θ) =∑N

i=1 pi (x(θ)).

The “big” ideas behind the Vickrey auction:I every player’s payment is independent of her report θi .I decision x(θ) is the best possible outcome for every player.

We want to design truthful mechanisms for general settings that alsomaximize efficiency. Based on the Vickrey ideas:

ygiannak (MPLA) Online Mechanism Design 17/09/2008 17 / 41

Page 40: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

VCG mechanisms

VCG mechanism (x , p):I x maximizes efficiency

I payments:

pi (θ) =

maxo∈O

∑j 6=i

vj(θj , o)

−∑j 6=i

vj(θj , x(θ)).

Each player submits a payment equal to the damage that herpresence causes to the other players. “Internalize the externalities”.W. Vickrey[1961], E. H. Clark [1971], T. Groves[1973]

Generally, every truthful mechanism is a simple variation of the VCGmechanism: weighted VCG (affine maximizers)

ygiannak (MPLA) Online Mechanism Design 17/09/2008 18 / 41

Page 41: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

VCG mechanisms

VCG mechanism (x , p):I x maximizes efficiencyI payments:

pi (θ) =

maxo∈O

∑j 6=i

vj(θj , o)

−∑j 6=i

vj(θj , x(θ)).

Each player submits a payment equal to the damage that herpresence causes to the other players. “Internalize the externalities”.W. Vickrey[1961], E. H. Clark [1971], T. Groves[1973]

Generally, every truthful mechanism is a simple variation of the VCGmechanism: weighted VCG (affine maximizers)

ygiannak (MPLA) Online Mechanism Design 17/09/2008 18 / 41

Page 42: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

VCG mechanisms

VCG mechanism (x , p):I x maximizes efficiencyI payments:

pi (θ) =

maxo∈O

∑j 6=i

vj(θj , o)

−∑j 6=i

vj(θj , x(θ)).

Each player submits a payment equal to the damage that herpresence causes to the other players. “Internalize the externalities”.W. Vickrey[1961], E. H. Clark [1971], T. Groves[1973]

Generally, every truthful mechanism is a simple variation of the VCGmechanism: weighted VCG (affine maximizers)

ygiannak (MPLA) Online Mechanism Design 17/09/2008 18 / 41

Page 43: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Presentation Progress

1 Online Problems

2 Game Theory and Mechanism Design

3 Online Mechanism Design

4 Online Auctions

ygiannak (MPLA) Online Mechanism Design 17/09/2008 19 / 41

Page 44: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Online Mechanism Design

Model:

Discrete time periods T = {1 < 2 < 3 < . . . }, indexed by t

Agents arrive dynamically, having types

θi = (ai , di ,wi )

I ai : arrival timeI di : departure timeI wi : valuation component

An online mechanism makes enforces a sequence of decisionsx(θ) = (x1(θ), x2(θ), x3(θ), . . . )

I x t(θ) has to be decided knowing only types θi with ai ≤ tI payments pi (θ) have to be collected before di .

ygiannak (MPLA) Online Mechanism Design 17/09/2008 20 / 41

Page 45: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Online Mechanism Design

Model:

Discrete time periods T = {1 < 2 < 3 < . . . }, indexed by t

Agents arrive dynamically, having types

θi = (ai , di ,wi )

I ai : arrival timeI di : departure timeI wi : valuation component

An online mechanism makes enforces a sequence of decisionsx(θ) = (x1(θ), x2(θ), x3(θ), . . . )

I x t(θ) has to be decided knowing only types θi with ai ≤ tI payments pi (θ) have to be collected before di .

ygiannak (MPLA) Online Mechanism Design 17/09/2008 20 / 41

Page 46: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Limited Misreports

We apply “natural” limitations to the available misreports

θi = (ai , di , wi )I No early-arrivals: ai ≤ ai

I No late-departures: di ≤ di

No early-arrivals: very natural assumption.

No late-departures: not so natural. We will comment on relaxing itlater...

ygiannak (MPLA) Online Mechanism Design 17/09/2008 21 / 41

Page 47: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Limited Misreports

We apply “natural” limitations to the available misreports

θi = (ai , di , wi )I No early-arrivals: ai ≤ ai

I No late-departures: di ≤ di

No early-arrivals: very natural assumption.

No late-departures: not so natural. We will comment on relaxing itlater...

ygiannak (MPLA) Online Mechanism Design 17/09/2008 21 / 41

Page 48: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Single-valued Online Domains

Every agent i has a set of interesting decisions Li ⊆ O and is satisfied(at a same degree) whenever a decision from Li is made:

vi (θi , x(θ)) =

ri , if x t(θ) ∈ Li for some t ∈ [ai , di ],

0, otherwise.

ri : reward (bid)θi = (ai , di , ri )

Notation: xi (θi ) = 1 i is “satisfied” and xi (θi ) = 0 otherwise.

Efficiency:

E (θ) =N∑

i=1

xi (θ) · ri

ygiannak (MPLA) Online Mechanism Design 17/09/2008 22 / 41

Page 49: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Single-valued Online Domains

Every agent i has a set of interesting decisions Li ⊆ O and is satisfied(at a same degree) whenever a decision from Li is made:

vi (θi , x(θ)) =

ri , if x t(θ) ∈ Li for some t ∈ [ai , di ],

0, otherwise.

ri : reward (bid)θi = (ai , di , ri )

Notation: xi (θi ) = 1 i is “satisfied” and xi (θi ) = 0 otherwise.

Efficiency:

E (θ) =N∑

i=1

xi (θ) · ri

ygiannak (MPLA) Online Mechanism Design 17/09/2008 22 / 41

Page 50: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Critical Values

Definition (Critical Value)

v c(ai ,di )

(θ−i ) =

inf {r ′i | xi (θ′i , θ−i ) = 1} , if this exists,

∞, otherwise.

The smallest reward she can report and still receive an interestingdecision, keeping everything else unchanged.

The critical value is independent of the agent’s reported reward ri

ygiannak (MPLA) Online Mechanism Design 17/09/2008 23 / 41

Page 51: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Monotonicity

Notation: θi ≺θ θ′i ⇐⇒ (a′i ≤ ai )∧ (di ≤ d ′i )∧ (ri < r ′i ): “better” type

Definition (Monotonicity)

A mechanism, in a single-valued online domain, is called monotonic if, forevery agent i and types θi , θ

′i with θi ≺θ θ′i ,

xi (θi , θ−i ) = 1 =⇒ xi (θ′i , θ−i ) = 1,

for every θ−i .

If agent i gets allocated by reporting a type θi then she will also beallocated if she reports a “better” type θ′i .

ygiannak (MPLA) Online Mechanism Design 17/09/2008 24 / 41

Page 52: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Monotonicity

Notation: θi ≺θ θ′i ⇐⇒ (a′i ≤ ai )∧ (di ≤ d ′i )∧ (ri < r ′i ): “better” type

Definition (Monotonicity)

A mechanism, in a single-valued online domain, is called monotonic if, forevery agent i and types θi , θ

′i with θi ≺θ θ′i ,

xi (θi , θ−i ) = 1 =⇒ xi (θ′i , θ−i ) = 1,

for every θ−i .

If agent i gets allocated by reporting a type θi then she will also beallocated if she reports a “better” type θ′i .

ygiannak (MPLA) Online Mechanism Design 17/09/2008 24 / 41

Page 53: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Truthfulness

Theorem

Every monotonic decision policy x can be truthfully implemented, i.e.there is a payment rule p such that mechanism (x , p) is truthful.

Proof.

Constructive:

pti (θ) =

v c(bai ,bdi )

(θ−i ), if xi (θi , θ−i ) = 1 ∧ t = di ,

0, otherwise,

ygiannak (MPLA) Online Mechanism Design 17/09/2008 25 / 41

Page 54: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Truthfulness (cont.)

Definition

In any single-valued online domain, every truthful mechanism must bemonotonic.

Proof.

Every truthful mechanism must ask for critical value payments, i.e.pi (θ) = v c

(ai ,di )(θ−i )

ygiannak (MPLA) Online Mechanism Design 17/09/2008 26 / 41

Page 55: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Presentation Progress

1 Online Problems

2 Game Theory and Mechanism Design

3 Online Mechanism Design

4 Online Auctions

ygiannak (MPLA) Online Mechanism Design 17/09/2008 27 / 41

Page 56: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Expiring ItemsCanonical Expiring Items (CIE) problem: we have a single, indivisible,re-usable item to allocate at each period t ∈ T . Bidders care to getonly one instance of the item. No extra value if get more.

The GREEDY auction:I Decision policy: at every time point t, allocate an item to the

unassigned (unallocated so far) agent with the highest bid. Break tiesrandomly.

I Payment policy: Every agent i that gets allocated, pays her critical bidv c(ai ,di )

(θ−i ) upon her departure di . Non-allocated agents make nopayments.

I Greedy: myopically maximizes efficiencyI If all agents are impatient, i.e. ai = di , then Greedy Auction is a

sequence of Vickrey (second-price) auctions.

Theorem

The GREEDY auction is truthful.

Proof.

GREEDY is monotonic.

ygiannak (MPLA) Online Mechanism Design 17/09/2008 28 / 41

Page 57: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Expiring ItemsCanonical Expiring Items (CIE) problem: we have a single, indivisible,re-usable item to allocate at each period t ∈ T . Bidders care to getonly one instance of the item. No extra value if get more.The GREEDY auction:

I Decision policy: at every time point t, allocate an item to theunassigned (unallocated so far) agent with the highest bid. Break tiesrandomly.

I Payment policy: Every agent i that gets allocated, pays her critical bidv c(ai ,di )

(θ−i ) upon her departure di . Non-allocated agents make nopayments.

I Greedy: myopically maximizes efficiencyI If all agents are impatient, i.e. ai = di , then Greedy Auction is a

sequence of Vickrey (second-price) auctions.

Theorem

The GREEDY auction is truthful.

Proof.

GREEDY is monotonic.

ygiannak (MPLA) Online Mechanism Design 17/09/2008 28 / 41

Page 58: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Expiring ItemsCanonical Expiring Items (CIE) problem: we have a single, indivisible,re-usable item to allocate at each period t ∈ T . Bidders care to getonly one instance of the item. No extra value if get more.The GREEDY auction:

I Decision policy: at every time point t, allocate an item to theunassigned (unallocated so far) agent with the highest bid. Break tiesrandomly.

I Payment policy: Every agent i that gets allocated, pays her critical bidv c(ai ,di )

(θ−i ) upon her departure di . Non-allocated agents make nopayments.

I Greedy: myopically maximizes efficiencyI If all agents are impatient, i.e. ai = di , then Greedy Auction is a

sequence of Vickrey (second-price) auctions.

Theorem

The GREEDY auction is truthful.

Proof.

GREEDY is monotonic.

ygiannak (MPLA) Online Mechanism Design 17/09/2008 28 / 41

Page 59: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Expiring ItemsCanonical Expiring Items (CIE) problem: we have a single, indivisible,re-usable item to allocate at each period t ∈ T . Bidders care to getonly one instance of the item. No extra value if get more.The GREEDY auction:

I Decision policy: at every time point t, allocate an item to theunassigned (unallocated so far) agent with the highest bid. Break tiesrandomly.

I Payment policy: Every agent i that gets allocated, pays her critical bidv c(ai ,di )

(θ−i ) upon her departure di . Non-allocated agents make nopayments.

I Greedy: myopically maximizes efficiencyI If all agents are impatient, i.e. ai = di , then Greedy Auction is a

sequence of Vickrey (second-price) auctions.

Theorem

The GREEDY auction is truthful.

Proof.

GREEDY is monotonic.

ygiannak (MPLA) Online Mechanism Design 17/09/2008 28 / 41

Page 60: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Expiring ItemsCanonical Expiring Items (CIE) problem: we have a single, indivisible,re-usable item to allocate at each period t ∈ T . Bidders care to getonly one instance of the item. No extra value if get more.The GREEDY auction:

I Decision policy: at every time point t, allocate an item to theunassigned (unallocated so far) agent with the highest bid. Break tiesrandomly.

I Payment policy: Every agent i that gets allocated, pays her critical bidv c(ai ,di )

(θ−i ) upon her departure di . Non-allocated agents make nopayments.

I Greedy: myopically maximizes efficiencyI If all agents are impatient, i.e. ai = di , then Greedy Auction is a

sequence of Vickrey (second-price) auctions.

Theorem

The GREEDY auction is truthful.

Proof.

GREEDY is monotonic.ygiannak (MPLA) Online Mechanism Design 17/09/2008 28 / 41

Page 61: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

CEI: Upper bound

Theorem

The GREEDY Auction is 2-competitive.

Proof.

Let x be the Greedy Auction decision rule, x∗ the optimal offline decisionrule and advesary chooses types θ. Also, let A be the set of all agentsallocated by x , B by both x and x∗ ,and C by x∗ only.

E (x(θ)) =∑

i∈A ri , E (x∗(θ)) =∑

i∈B ri +∑

i∈C ri

B ⊆ A , ri ≥ 0 =⇒∑

i∈B ri ≤∑

i∈A riFor every i ∈ C allocated only by x∗ at some period ti , x allocatessome other agent ji at the same period ti for which ri ≤ rji . So∑

i∈C ri ≤∑

i∈C rji ≤∑

j∈A rj

E (x∗(θ)) ≤ 2E (x(θ)) =∑

i∈A ri =⇒ maxθE(x∗(θ))E(x(θ)) ≤ 2

ygiannak (MPLA) Online Mechanism Design 17/09/2008 29 / 41

Page 62: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

CEI: Upper bound

Theorem

The GREEDY Auction is 2-competitive.

Proof.

Let x be the Greedy Auction decision rule, x∗ the optimal offline decisionrule and advesary chooses types θ. Also, let A be the set of all agentsallocated by x , B by both x and x∗ ,and C by x∗ only.

E (x(θ)) =∑

i∈A ri , E (x∗(θ)) =∑

i∈B ri +∑

i∈C ri

B ⊆ A , ri ≥ 0 =⇒∑

i∈B ri ≤∑

i∈A riFor every i ∈ C allocated only by x∗ at some period ti , x allocatessome other agent ji at the same period ti for which ri ≤ rji . So∑

i∈C ri ≤∑

i∈C rji ≤∑

j∈A rj

E (x∗(θ)) ≤ 2E (x(θ)) =∑

i∈A ri =⇒ maxθE(x∗(θ))E(x(θ)) ≤ 2

ygiannak (MPLA) Online Mechanism Design 17/09/2008 29 / 41

Page 63: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

CEI: Upper bound

Theorem

The GREEDY Auction is 2-competitive.

Proof.

Let x be the Greedy Auction decision rule, x∗ the optimal offline decisionrule and advesary chooses types θ. Also, let A be the set of all agentsallocated by x , B by both x and x∗ ,and C by x∗ only.

E (x(θ)) =∑

i∈A ri , E (x∗(θ)) =∑

i∈B ri +∑

i∈C ri

B ⊆ A , ri ≥ 0 =⇒∑

i∈B ri ≤∑

i∈A ri

For every i ∈ C allocated only by x∗ at some period ti , x allocatessome other agent ji at the same period ti for which ri ≤ rji . So∑

i∈C ri ≤∑

i∈C rji ≤∑

j∈A rj

E (x∗(θ)) ≤ 2E (x(θ)) =∑

i∈A ri =⇒ maxθE(x∗(θ))E(x(θ)) ≤ 2

ygiannak (MPLA) Online Mechanism Design 17/09/2008 29 / 41

Page 64: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

CEI: Upper bound

Theorem

The GREEDY Auction is 2-competitive.

Proof.

Let x be the Greedy Auction decision rule, x∗ the optimal offline decisionrule and advesary chooses types θ. Also, let A be the set of all agentsallocated by x , B by both x and x∗ ,and C by x∗ only.

E (x(θ)) =∑

i∈A ri , E (x∗(θ)) =∑

i∈B ri +∑

i∈C ri

B ⊆ A , ri ≥ 0 =⇒∑

i∈B ri ≤∑

i∈A riFor every i ∈ C allocated only by x∗ at some period ti , x allocatessome other agent ji at the same period ti for which ri ≤ rji . So∑

i∈C ri ≤∑

i∈C rji ≤∑

j∈A rj

E (x∗(θ)) ≤ 2E (x(θ)) =∑

i∈A ri =⇒ maxθE(x∗(θ))E(x(θ)) ≤ 2

ygiannak (MPLA) Online Mechanism Design 17/09/2008 29 / 41

Page 65: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

CEI: Upper bound

Theorem

The GREEDY Auction is 2-competitive.

Proof.

Let x be the Greedy Auction decision rule, x∗ the optimal offline decisionrule and advesary chooses types θ. Also, let A be the set of all agentsallocated by x , B by both x and x∗ ,and C by x∗ only.

E (x(θ)) =∑

i∈A ri , E (x∗(θ)) =∑

i∈B ri +∑

i∈C ri

B ⊆ A , ri ≥ 0 =⇒∑

i∈B ri ≤∑

i∈A riFor every i ∈ C allocated only by x∗ at some period ti , x allocatessome other agent ji at the same period ti for which ri ≤ rji . So∑

i∈C ri ≤∑

i∈C rji ≤∑

j∈A rj

E (x∗(θ)) ≤ 2E (x(θ)) =∑

i∈A ri =⇒ maxθE(x∗(θ))E(x(θ)) ≤ 2

ygiannak (MPLA) Online Mechanism Design 17/09/2008 29 / 41

Page 66: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

CEI: Lower bound

Theorem

No truthful online auction for the CEI problem can be (2− ε)-competitive,for every 0 < ε < 1.

Corollary

CRCEI = 2.

ygiannak (MPLA) Online Mechanism Design 17/09/2008 30 / 41

Page 67: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

CEI: Lower bound

Theorem

No truthful online auction for the CEI problem can be (2− ε)-competitive,for every 0 < ε < 1.

Corollary

CRCEI = 2.

ygiannak (MPLA) Online Mechanism Design 17/09/2008 30 / 41

Page 68: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

CEI: An Impossibility Result

Theorem

No truthful auction for the CEI problem can have a constant competitiveratio, if we relax the no late-departures assumption and allow arbitrarymisreports of departure.

ygiannak (MPLA) Online Mechanism Design 17/09/2008 31 / 41

Page 69: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

CEI: Extensions

k re-usable goods instead of 1: The Greedy Auction (k unallocatedagents with largest bids) still is 2-competitive.

The asynchronous model: time is continuous and not discrete.CR = 5

Relax truthfulness: CR ∈ [φ, 2], φ ≈ 1.618034.

Taking the auction’s revenue as a performance criterion: no constantCR.

ygiannak (MPLA) Online Mechanism Design 17/09/2008 32 / 41

Page 70: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

CEI: Extensions

k re-usable goods instead of 1: The Greedy Auction (k unallocatedagents with largest bids) still is 2-competitive.

The asynchronous model: time is continuous and not discrete.CR = 5

Relax truthfulness: CR ∈ [φ, 2], φ ≈ 1.618034.

Taking the auction’s revenue as a performance criterion: no constantCR.

ygiannak (MPLA) Online Mechanism Design 17/09/2008 32 / 41

Page 71: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

CEI: Extensions

k re-usable goods instead of 1: The Greedy Auction (k unallocatedagents with largest bids) still is 2-competitive.

The asynchronous model: time is continuous and not discrete.CR = 5

Relax truthfulness: CR ∈ [φ, 2], φ ≈ 1.618034.

Taking the auction’s revenue as a performance criterion: no constantCR.

ygiannak (MPLA) Online Mechanism Design 17/09/2008 32 / 41

Page 72: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

CEI: Extensions

k re-usable goods instead of 1: The Greedy Auction (k unallocatedagents with largest bids) still is 2-competitive.

The asynchronous model: time is continuous and not discrete.CR = 5

Relax truthfulness: CR ∈ [φ, 2], φ ≈ 1.618034.

Taking the auction’s revenue as a performance criterion: no constantCR.

ygiannak (MPLA) Online Mechanism Design 17/09/2008 32 / 41

Page 73: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

CEI: Open problems

Randomized auctions

Revenue maximizing auctions. Revenue competitve ratio with respectto h = b

a , [a, b] bid interval.

ygiannak (MPLA) Online Mechanism Design 17/09/2008 33 / 41

Page 74: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Limited Supply

Canonical Limited Supply (CLS) problem: we have a single, indivisibleitem to allocate at only one agent.

Assumption: All bids are different (easy to relax)

We need a weaker adversarial model: otherwise trivially infinite CRs

Random Ordering Hypothesis: the adversary selects bids ri ,arrival-departure intervals [ai , di ] but the matching is done randomly(and uniformly).

Maximize expected efficiency or revenue.

ygiannak (MPLA) Online Mechanism Design 17/09/2008 34 / 41

Page 75: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

Limited Supply

Canonical Limited Supply (CLS) problem: we have a single, indivisibleitem to allocate at only one agent.

Assumption: All bids are different (easy to relax)

We need a weaker adversarial model: otherwise trivially infinite CRs

Random Ordering Hypothesis: the adversary selects bids ri ,arrival-departure intervals [ai , di ] but the matching is done randomly(and uniformly).

Maximize expected efficiency or revenue.

ygiannak (MPLA) Online Mechanism Design 17/09/2008 34 / 41

Page 76: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

CLS: Adaptive, threshold auctions

Definition

For every k = 1, 2, . . . ,N define A(k) to be the following auction for theCLS problem:

(i) Learning Phase: Make no allocation until you receive the k ’th bid attime period τ . Let p ≥ q be the two top bids received so far.

(ii) Transition Phase: If some agent i with bid wi = p is still active attime period τ , then allocate i for a payment of q (breaking tiesrandomly).

(iii) Accepting Phase: If no agent got allocated during the transitionphase (i.e. at τ), allocate the first agent to arrive after τ bidding atleast p (no ties possible), for a payment of p. If no such agentarrives, allocate the last bidder to arrive.

ygiannak (MPLA) Online Mechanism Design 17/09/2008 35 / 41

Page 77: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

The Classic Secretary Problem

N applicants are interviewed for a job opening, one after the other.

They arrive in a random order (random-ordering) hypothesis

After reviewing each applicant, we must irrevocably decide whether tohire her or not.

We do not know the qualification (quality) of an applicant, until weactually interview her.

How can we maximize the probability of hiring the best applicant?

Interview the first⌊

Ne

⌋applicants without hiring any of them and

then hire the first applicant ranking higher than all these first⌊

Ne

⌋candidates.

Probability of success at least 1e ≈ 36.8%, as N →∞.

Optimal Stopping Theory

ygiannak (MPLA) Online Mechanism Design 17/09/2008 36 / 41

Page 78: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

The Classic Secretary Problem

N applicants are interviewed for a job opening, one after the other.

They arrive in a random order (random-ordering) hypothesis

After reviewing each applicant, we must irrevocably decide whether tohire her or not.

We do not know the qualification (quality) of an applicant, until weactually interview her.

How can we maximize the probability of hiring the best applicant?

Interview the first⌊

Ne

⌋applicants without hiring any of them and

then hire the first applicant ranking higher than all these first⌊

Ne

⌋candidates.

Probability of success at least 1e ≈ 36.8%, as N →∞.

Optimal Stopping Theory

ygiannak (MPLA) Online Mechanism Design 17/09/2008 36 / 41

Page 79: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

The Classic Secretary Problem

N applicants are interviewed for a job opening, one after the other.

They arrive in a random order (random-ordering) hypothesis

After reviewing each applicant, we must irrevocably decide whether tohire her or not.

We do not know the qualification (quality) of an applicant, until weactually interview her.

How can we maximize the probability of hiring the best applicant?

Interview the first⌊

Ne

⌋applicants without hiring any of them and

then hire the first applicant ranking higher than all these first⌊

Ne

⌋candidates.

Probability of success at least 1e ≈ 36.8%, as N →∞.

Optimal Stopping Theory

ygiannak (MPLA) Online Mechanism Design 17/09/2008 36 / 41

Page 80: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

The Classic Secretary Problem

N applicants are interviewed for a job opening, one after the other.

They arrive in a random order (random-ordering) hypothesis

After reviewing each applicant, we must irrevocably decide whether tohire her or not.

We do not know the qualification (quality) of an applicant, until weactually interview her.

How can we maximize the probability of hiring the best applicant?

Interview the first⌊

Ne

⌋applicants without hiring any of them and

then hire the first applicant ranking higher than all these first⌊

Ne

⌋candidates.

Probability of success at least 1e ≈ 36.8%, as N →∞.

Optimal Stopping Theory

ygiannak (MPLA) Online Mechanism Design 17/09/2008 36 / 41

Page 81: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

CLS: Upper bounds

Theorem

As N →∞, the adaptive auction A(bNe c) is e-competitive for efficiencyand e2-competitive for revenue.

e ≈ 2.718, e2 ≈ 7.389

Theorem

As N →∞, the adaptive auction A(bN2 c) is 2ln 2 -competitive for efficiency

and 4-competitive for revenue

2ln 2 ≈ 2.885

Corollary

As N →∞,

CRECLS ≤ e ≈ 2.718 and CRR

CLS ≤ 4.

ygiannak (MPLA) Online Mechanism Design 17/09/2008 37 / 41

Page 82: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

CLS: Upper bounds

Theorem

As N →∞, the adaptive auction A(bNe c) is e-competitive for efficiencyand e2-competitive for revenue.

e ≈ 2.718, e2 ≈ 7.389

Theorem

As N →∞, the adaptive auction A(bN2 c) is 2ln 2 -competitive for efficiency

and 4-competitive for revenue

2ln 2 ≈ 2.885

Corollary

As N →∞,

CRECLS ≤ e ≈ 2.718 and CRR

CLS ≤ 4.

ygiannak (MPLA) Online Mechanism Design 17/09/2008 37 / 41

Page 83: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

CLS: Upper bounds

Theorem

As N →∞, the adaptive auction A(bNe c) is e-competitive for efficiencyand e2-competitive for revenue.

e ≈ 2.718, e2 ≈ 7.389

Theorem

As N →∞, the adaptive auction A(bN2 c) is 2ln 2 -competitive for efficiency

and 4-competitive for revenue

2ln 2 ≈ 2.885

Corollary

As N →∞,

CRECLS ≤ e ≈ 2.718 and CRR

CLS ≤ 4.

ygiannak (MPLA) Online Mechanism Design 17/09/2008 37 / 41

Page 84: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

CLS: Extensions and Open Problems

Lower bound → efficiency: 2, revenue: 32

Multi-item case (identical items): constant (very large) CRs andCR → 1 as k →∞Matroid Secretary problems

Open problems:

Bids drawn independently from an unknown distribution (our upperbounds still hold)

Close CR “gaps”

ygiannak (MPLA) Online Mechanism Design 17/09/2008 38 / 41

Page 85: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

CLS: Extensions and Open Problems

Lower bound → efficiency: 2, revenue: 32

Multi-item case (identical items): constant (very large) CRs andCR → 1 as k →∞Matroid Secretary problems

Open problems:

Bids drawn independently from an unknown distribution (our upperbounds still hold)

Close CR “gaps”

ygiannak (MPLA) Online Mechanism Design 17/09/2008 38 / 41

Page 86: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

References

D. C. ParkesOnline Mechanism Design.In N. Nisan, T. Roughgarden, E. Tardos, V. Vazirani, eds., AlgorithmicGame Theory, Cambridge University Press, 2007. Chapter 16.

M. T. Hajiaghayi, R. Kleiberg, M. Mahdian and D. C. ParkesOnline auctions with re-usable goods.In Proceedings of the 6th Conference on Electronic Commerce (EC’05), pp.165-174,2005.

M. T. Hajiaghayi, R. Kleinberg. and D. C. ParkesAdaptive limited supply auctions.In Proceedings of the 5th ACM Conference on Electronic Commerce(EC ’04), 2004.

ygiannak (MPLA) Online Mechanism Design 17/09/2008 39 / 41

Page 87: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

THE END

Thank you!

ygiannak (MPLA) Online Mechanism Design 17/09/2008 40 / 41

Page 88: Online Mechanism DesignOnline Mechanism Design M.Sc. Thesis Yiannis Giannakopoulos users.uoa.gr/~ygiannak University of Athens Graduate Program in Logic, Algorithms and Computation

ygiannak (MPLA) Online Mechanism Design 17/09/2008 41 / 41