1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1,...

43
1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1 , Di Niu1, Baochun Li 2 1 Department of Electrical and Computer Engineering University of Alberta 2 Department of Electrical and Computer Engineering University of Toronto

Transcript of 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1,...

Page 1: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

1

Min-Cost Live Webcast under Joint Pricing of Data, Congestion and

Virtualized ServersRui Zhu1, Di Niu1, Baochun Li2

1Department of Electrical and Computer Engineering

University of Alberta2Department of Electrical and Computer

EngineeringUniversity of Toronto

Page 2: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

2

Roadmap

Part 1 A joint pricing of data, congestion and virtualized servers

Part 2 Min-cost multicast as k-NWST

The first PTAS proposed

Part 3 Trace-driven simulations

Part 1 A joint pricing of data, congestion and virtualized servers

Page 3: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

3

Live Webcast

Problem: Large amount of data transferringSignificantly contributing to traffic congestionEngaging many server resources, etc.

Page 4: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

4

Charge end users – conventional

Monthly flat rate/ Pay-as-you-go/Both

Excessive burden on clients

Charge content/application provider

Encourage customers to use more

E.g. Telus: free six-month subscription of Rdio

Existing pricing policies

Page 5: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

5

How should webcast operators pay for the

video delivery service?

Page 6: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

6

A road pricing motivation

Distance traveled pricing

Transferring data

Congestion specific pricing

Congestion degree

Page 7: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

7

Congestion pricingCharge the webcast provider

A per-minute price rate on each link

Pricing rate ∝ bandwidth-delay product

Related with the media streaming topology

Encourage webcast operator minimize its “waiting data”

Page 8: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

8

Cost of servers

Download from

source

Recoding and resendingClient

Operation cost

Page 9: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

9

Roadmap

Part 1 A joint pricing of data, congestion and virtualized servers

Part 2 Min-cost multicast as k-NWST

The first PTAS proposed

Part 3 Trace-driven simulations

Page 10: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

10

System model

SourceCDN ServersClient

Page 11: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

11

F

F

S

F

F

Objective: minimize the total cost including data transferring, congestion

and server opening

Page 12: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

12

Formulating the problem

, ,, ,

,

min e e i i i j i jx y z

e E i F i F j T

c z f y c x

( )

,

,

,

, ( )

= 1 ( )

, ( , )

,

, , {0,1} ( , , )

e ie N

i ji F

i j i

ii F

i j i e

z y i N F

x j T

x y i F j T

y k

x y z i F j T e E

s.t.Server congestionService congestion

Page 13: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

13

Formulating the problem

, ,, ,

,

min e e i i i j i jx y z

e E i F i F j T

c z f y c x

( )

,

,

,

, ( )

= 1 ( )

, ( , )

,

, , {0,1} ( , , )

e ie N

i ji F

i j i

ii F

i j i e

z y i N F

x j T

x y i F j T

y k

x y z i F j T e E

s.t.Opening cost

Page 14: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

14

Formulating the problem

, ,, ,

,

min e e i i i j i jx y z

e E i F i F j T

c z f y c x

( )

,

,

,

, ( )

= 1 ( )

, ( , )

,

, , {0,1} ( , , )

e ie N

i ji F

i j i

ii F

i j i e

z y i N F

x j T

x y i F j T

y k

x y z i F j T e E

s.t.

Optimal solution is a tree

Each client belongs to one server

Page 15: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

15

The data costThe total data transferred per unit time is proportional to the total number of selected edges

Given the video bit rate r, the total data transferred is

Since nr is a constant, this cost can be incorporated into the server opening cost

ii F

y r nr

Page 16: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

16

Unfortunately, it is a hard problem.

Page 17: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

17

Let’s start by ignoring the opening costThen, fi=0 for all relay servers.

Only congestion cost are considered.

Equivalent with an very famous hard problem, Steiner Tree. (NP-hard, even within 1.0105)

M. Chlebik, J. Chlebikova.The Steiner Tree problem on graphs: Inapproximability results. Theoretical Computer Science, 2008

Page 18: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

If we don’t consider the inter-server connection

18

Case 1: No cost for inter-server connections.

Case 2: No inter-server connections are permitted.

In both case, they are equivalent with Uncapacitated Facility Location problem, another NP-hard problem.

Page 19: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

19

No server number constraint?

Well, it is called Node-Weighted Steiner Tree problem (NWST).

Page 20: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

20

NWST – Existing Results

NP-hard to approximate withinC.Lund, M. YannakakisOn the hardness of approximating minimization problems. Journal of the ACM, 1994

Currently best known ratio:S. Guha, S. Khuller.Improved methods for approximating node weighted Steiner trees and connected dominating sets. Information and Computation, 1999

(1 ) ln n

1.35ln n

Page 21: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

21

The linear relaxation, ,

, ,,

min e e i i i j i jx y z

e E i F i F j T

c z f y c x

( )

,

,

,

, ( )

= 1 ( )

, ( , )

,

, , 0 ( , , )

e ie N

i ji F

i j i

ii F

i j i e

z y i N F

x j T

x y i F j T

y k

x y z i F j T e E

s.t.

Page 22: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

22

Original problem

A PTAS for k-NWST

, ,,

min (x, y, z)

s.t. ,

e e i i i j i je E i F i F j T

ii F

f c z f y c x

y k

, ,,

(x, y, z, ) ( )e e i i i j i j ie E i F i F j T i F

L c z f y c x y k

The Lagrangian relaxation

Page 23: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

23

Lagrange multiplier λ as opening cost: fi’ := fi

+ λ

Subroutine Algorithm1:

A PTAS for NWST with additional opening cost

, ,,

, ,,

(x, y, z, ) ( )

( )

e e i i i j i j ie E i F i F j T i F

e e i i i j i je E i F i F j T

L c z f y c x y k

c z f y c x k

( , , )P c f A G1P. Klein, R. Ravi.A nearly best-possible approximation algorithm for node-weighted Steiner trees. J. Algorithm, 1995

Page 24: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

24

A PTAS for our problemSearching for proper Lagrange multiplier λ 1

1 1

2 2

( )

( )

P

P

A

A

1 1 2 2k k k

Convex combination of P1 and P2

2

If μ2>1/2, output P2. Otherwise, select some nodes in P2 and add them in P1

3

Page 25: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

25

Step 1: find proper λ

• For sufficiently large λ, the opening cost dominates

• For sufficiently small λ, the cost depends on congestion, making more to open

• The binary search can find two trees near the server constraint

Page 26: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

26

Step 2: Convex combination

• Convex combination of P1 and P2

1 1 1

2 2 2

( ) ( ) ( )

( ) ( ) ( )OPEN D

OPEN D

C X C X k k OPT

C X C X k k OPT

where is the total opening cost

is the total congestion cost

( )OPENC X

( )DC X

Page 27: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

27

Step 3: Merge P1 and P2

Page 28: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

28

Target: select k-k1 nodes from P2

P1

P2

Page 29: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

29

Double edges of P2

P1

P2

Page 30: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

30

Find the Euler tour and shortcut to tour

P1

P2

Page 31: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

31

Find the Euler tour and shortcut to tour

P1

P2Average cost:

Then, we have:1 2 1( ) / ( )k k k k

12 2

2 1

2 2 2

( ) ( ')

2( ( ) ( ))

2 ( ( ) ( ))

OPEN D

OPEN D

OPEN D

C X C P

k kC X C P

k k

C X C P

Page 32: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

32

Connect P1 to the cheapest path of tour

P1

P2

Page 33: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

33

The total server cost

1 1

1 1 1

2 2 2

( ( , ')) ( ) ( )

( ') ( ')

( ( , ')) 2 ( ( ) ( ))

2 ( ( ) ( ))

D OPEN D

OPEN D

D OPEN D

OPEN D

C PATH S X C X C P

C X C P

C PATH S X C X C P

C X C P

Page 34: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

34

The upper bound for total cost

Since , we have1( ( , ))DC PATH P S OPT

1 1 1 2 2 2

1

1 2

( ) ( )

2 ( ( ) ( )) 2 ( ( ) ( ))

( ( , ))

2 2

2

(2 1)

OPEN D

OPEN D OPEN D

DS

C X C X

C X C X C X C X

C PATH P S

OPT OPT OPT

OPT OPT

OPT

Page 35: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

35

Conclusion (Approximation Ratio)Our PTAS can approximate k-NWST with a ratio of

2 1.35ln 1 2.7 ln 1.n n

Page 36: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

36

Roadmap

Part 1 A joint pricing of data, congestion and virtualized servers

Part 2 Min-cost multicast as k-NWST

The first PTAS proposed

Part 3 Trace-driven simulations

Page 37: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

37

Inter-server and server-client delay traces

Traces collected from PlanetLab and from the Seattle projectMonitor the RTTs among 8 Planet nodes for a 15-day periodMonitor the RTTs from the 8 Planet nodes to 19 Seattle nodes

Page 38: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

38

Opening cost assignment

The opening costs (including data) for CDN edge nodes are from pricing policy by Amazon Web Service (Amazon CloudFront)

Page 39: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

39

Baseline Algorithm

Randomly chooses a subset of servers to openWith no inter-server connectionsConnects each client to its closet server.

Page 40: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

40

12345678 0

0.5

1

1.5

2

2.5

3 Total Cost Congestion Cost Opening CostPe

rform

ance

Rati

o

The cost computed by our algorithm

Number of Servers

Page 41: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

41

12345678 0

0.5

1

1.5

2

2.5

3 Total Cost Congestion Cost Opening CostPe

rform

ance

Rati

o

The cost computed by baseline algorithm

Number of Servers

Page 42: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

42

ConclusionsA joint pricing policy of data, congestion and virtual servers for live webcasting application providers

Model the Min-cost multicast and provide the first PTAS for it

Future work:

Only routing are considered, how about using network coding?

Page 43: 1 Min-Cost Live Webcast under Joint Pricing of Data, Congestion and Virtualized Servers Rui Zhu 1, Di Niu1, Baochun Li 2 1 Department of Electrical and.

43

Thank you

Rui Zhu

Department of Electrical and Computer Engineering

University of Toronto