A Comparative Study of DASH Representation Sets Using Real...

22
A COMPARATIVE STUDY OF DASH REPRESENTATION SETS USING REAL USER CHARACTERISTICS Kreuzberger et al. 1 A Comp. Study of DASH Repr. Sets – Real User Characteristics C. Kreuzberger , B. Rainer, H. Hellwagner Institute of Information Technology (ITEC) Faculty of Technical Sciences (TEWI) Alpen-Adria-Universität Klagenfurt (AAU), Austria L. Toni, P. Frossard Signal Processing Laboratory (LTS4) École polytechnique fédérale de Lausanne (EPFL), Switzerland

Transcript of A Comparative Study of DASH Representation Sets Using Real...

Page 1: A Comparative Study of DASH Representation Sets Using Real …chkr.at/.../uploads/kreuzberger_nossdav_presentation_v2.pdf · 2016-05-14 · A COMPARATIVE STUDY OF DASH REPRESENTATION

A COMPARATIVE STUDY OF DASH

REPRESENTATION SETS USING REAL

USER CHARACTERISTICS

Kreuzberger et al. 1A Comp. Study of DASH Repr. Sets – Real User Characteristics

C. Kreuzberger, B. Rainer, H. HellwagnerInstitute of Information Technology (ITEC)

Faculty of Technical Sciences (TEWI)Alpen-Adria-Universität Klagenfurt (AAU), Austria

L. Toni, P. FrossardSignal Processing Laboratory (LTS4)

École polytechnique fédérale de Lausanne (EPFL), Switzerland

Page 2: A Comparative Study of DASH Representation Sets Using Real …chkr.at/.../uploads/kreuzberger_nossdav_presentation_v2.pdf · 2016-05-14 · A COMPARATIVE STUDY OF DASH REPRESENTATION

VIDEO STREAMING AND DASH Rapidly growing (> 60% of traffic at peak times)

DASH: videos with various bitrates and

resolutions (representations) on a per-segment

basis

Overall goal in video streaming (from the user‘s

perspective): maximize Quality of Experience

(QoE) by chosing representations based on

restrictions of the user (e.g., bandwidth, spatial

resolution, …) and network conditions

Kreuzberger et al. A Comp. Study of DASH Repr. Sets – Real User Characteristics 2

Page 3: A Comparative Study of DASH Representation Sets Using Real …chkr.at/.../uploads/kreuzberger_nossdav_presentation_v2.pdf · 2016-05-14 · A COMPARATIVE STUDY OF DASH REPRESENTATION

MULTIMEDIA STREAMING SCENARIO

Kreuzberger et al. A Comp. Study of DASH Repr. Sets – Real User Characteristics 3

How to decide which representation sets should be madeavailable on the server side?

And what is the impacton the user base?

Page 4: A Comparative Study of DASH Representation Sets Using Real …chkr.at/.../uploads/kreuzberger_nossdav_presentation_v2.pdf · 2016-05-14 · A COMPARATIVE STUDY OF DASH REPRESENTATION

DASH REPRESENTATIONS IN THE WILD

Kreuzberger et al. A Comp. Study of DASH Repr. Sets – Real User Characteristics 4

ParsingMPD of51k videos

Netflix Blog

Tech. Docu.

Page 5: A Comparative Study of DASH Representation Sets Using Real …chkr.at/.../uploads/kreuzberger_nossdav_presentation_v2.pdf · 2016-05-14 · A COMPARATIVE STUDY OF DASH REPRESENTATION

OPTIMIZED DASH REPRESENTATIONS

Kreuzberger et al. A Comp. Study of DASH Repr. Sets – Real User Characteristics 5

[16] Toni et al., „Optimal Selection of Adaptive Streaming Representations”, ACM Transactions on Multimedia Computing Communications and Applications, 2015

Integer Linear

Program (ILP)

Problems:

Mainly theoretical

results

Static number of users

Page 6: A Comparative Study of DASH Representation Sets Using Real …chkr.at/.../uploads/kreuzberger_nossdav_presentation_v2.pdf · 2016-05-14 · A COMPARATIVE STUDY OF DASH REPRESENTATION

OUR APPROACH

Kreuzberger et al. A Comp. Study of DASH Repr. Sets – Real User Characteristics 6

Evaluate optimized and existing DASH

representations

by modelling dynamic user behaviour (join/leave),

with realistic device and network characteristics,

and conducting extensive simulations using NS-3.

Metrics

Average User Satisfaction [SSIM per screen resolution]

Average Goodput [kbit/s]

Page 7: A Comparative Study of DASH Representation Sets Using Real …chkr.at/.../uploads/kreuzberger_nossdav_presentation_v2.pdf · 2016-05-14 · A COMPARATIVE STUDY OF DASH REPRESENTATION

DYNAMIC USER BEHAVIOUR

Kreuzberger et al. A Comp. Study of DASH Repr. Sets – Real User Characteristics 7

[12] K. Pires and G. Simon. YouTube Live and Twitch: A Tour of User-generated Live Streaming Systems. In Proc. 6th ACM Multimedia Systems Conference, 2015.

Page 8: A Comparative Study of DASH Representation Sets Using Real …chkr.at/.../uploads/kreuzberger_nossdav_presentation_v2.pdf · 2016-05-14 · A COMPARATIVE STUDY OF DASH REPRESENTATION

Kreuzberger et al. A Comp. Study of DASH Repr. Sets – Real User Characteristics 8

[10] Nielsen Research, "Binging" is the New Viewing for Over-the-top Streamers, 2013

[16] Toni et al., „Optimal Selection of Adaptive Streaming Representations”, ACM Transactions on Multimedia Computing Communications and Applications, 2015

DEVICE AND NETWORK CHARACTERISTICS

Page 9: A Comparative Study of DASH Representation Sets Using Real …chkr.at/.../uploads/kreuzberger_nossdav_presentation_v2.pdf · 2016-05-14 · A COMPARATIVE STUDY OF DASH REPRESENTATION

OPTIMIZED REPRESENTATIONS

Kreuzberger et al. A Comp. Study of DASH Repr. Sets – Real User Characteristics 9

Computed using

ILP [16] with

device/network

characteristics and

dynamic user

behaviour

(previous two slides)

Page 10: A Comparative Study of DASH Representation Sets Using Real …chkr.at/.../uploads/kreuzberger_nossdav_presentation_v2.pdf · 2016-05-14 · A COMPARATIVE STUDY OF DASH REPRESENTATION

UPPER BOUND: MAX-MIN MODEL

In general:

Discrete bitrates (e.g., 100, 200, 500, … kbit/s)

Enables clients to maintain a local video playback

buffer

Upper bound: max-min model

Assumption: continous bitrates (0 – 20.000 kbit/s)

Distribute bandwidth among competitors on a best-

effort principle (max-min fairness)

No local video playback buffer

Kreuzberger et al. A Comp. Study of DASH Repr. Sets – Real User Characteristics 10

Page 11: A Comparative Study of DASH Representation Sets Using Real …chkr.at/.../uploads/kreuzberger_nossdav_presentation_v2.pdf · 2016-05-14 · A COMPARATIVE STUDY OF DASH REPRESENTATION

NS-3 AND DASH NS-3 is a time-discrete packet-level simulator

We implemented

HTTP/1.1-compatible file transfer

Rate-based DASH adaptation logic

MPD parsing using libdash

Network settings:

MTU: 1500 bytes

TCP New Reno, w/ segment size (MSS) of 1430 bytes

Bottleneck link: 100, 200 Mbit/s and 15 ms RTT

Kreuzberger et al. A Comp. Study of DASH Repr. Sets – Real User Characteristics 11

Page 12: A Comparative Study of DASH Representation Sets Using Real …chkr.at/.../uploads/kreuzberger_nossdav_presentation_v2.pdf · 2016-05-14 · A COMPARATIVE STUDY OF DASH REPRESENTATION

RESULTS: AVG. USER SATISFACTION

(BOTTLENECK 100 MBIT/S)

Kreuzberger et al. A Comp. Study of DASH Repr. Sets – Real User Characteristics 12

Page 13: A Comparative Study of DASH Representation Sets Using Real …chkr.at/.../uploads/kreuzberger_nossdav_presentation_v2.pdf · 2016-05-14 · A COMPARATIVE STUDY OF DASH REPRESENTATION

RESULTS: AVG. GOODPUT

(BOTTLENECK 100 MBIT/S)

Kreuzberger et al. A Comp. Study of DASH Repr. Sets – Real User Characteristics 13

Page 14: A Comparative Study of DASH Representation Sets Using Real …chkr.at/.../uploads/kreuzberger_nossdav_presentation_v2.pdf · 2016-05-14 · A COMPARATIVE STUDY OF DASH REPRESENTATION

CONCLUSIONS

The choice of representations has an impact on satisfaction

Researchers need to consider this when evaluatingtheir DASH adaptation strategies

Optimized representations [16] are good, but don‘twork very well in all situations

Data and simulation framework available athttp://concert.itec.aau.at/NOSSDAV_2016/ andhttps://github.com/ChristianKreuzberger/AMuSt-Simulator/

Kreuzberger et al. A Comp. Study of DASH Repr. Sets – Real User Characteristics 14

Page 15: A Comparative Study of DASH Representation Sets Using Real …chkr.at/.../uploads/kreuzberger_nossdav_presentation_v2.pdf · 2016-05-14 · A COMPARATIVE STUDY OF DASH REPRESENTATION

THANK YOU!

Kreuzberger et al. A Comp. Study of DASH Repr. Sets – Real User Characteristics 15

Page 16: A Comparative Study of DASH Representation Sets Using Real …chkr.at/.../uploads/kreuzberger_nossdav_presentation_v2.pdf · 2016-05-14 · A COMPARATIVE STUDY OF DASH REPRESENTATION

BACKUP SLIDES

Kreuzberger et al. A Comp. Study of DASH Repr. Sets – Real User Characteristics 16

Page 17: A Comparative Study of DASH Representation Sets Using Real …chkr.at/.../uploads/kreuzberger_nossdav_presentation_v2.pdf · 2016-05-14 · A COMPARATIVE STUDY OF DASH REPRESENTATION

RESULTS: AVG. USER SATISFACTION

(BOTTLENECK 200 MBIT/S)

Kreuzberger et al. A Comp. Study of DASH Repr. Sets – Real User Characteristics 17

Page 18: A Comparative Study of DASH Representation Sets Using Real …chkr.at/.../uploads/kreuzberger_nossdav_presentation_v2.pdf · 2016-05-14 · A COMPARATIVE STUDY OF DASH REPRESENTATION

RESULTS: AVG. GOODPUT

(BOTTLENECK 200 MBIT/S)

Kreuzberger et al. A Comp. Study of DASH Repr. Sets – Real User Characteristics 18

Page 19: A Comparative Study of DASH Representation Sets Using Real …chkr.at/.../uploads/kreuzberger_nossdav_presentation_v2.pdf · 2016-05-14 · A COMPARATIVE STUDY OF DASH REPRESENTATION

USER SATISFACTION

Kreuzberger et al. A Comp. Study of DASH Repr. Sets – Real User Characteristics 19

Idea: lower bit rate required

when satisfying a user with a low

screen resolution (360p)

compared to a user with a high

screen resolution (540p–1080p)

Encoded 4 video sequences

360p, 540p, 720p, 1080p

100 kbit/s – 20 Mbit/s

Page 20: A Comparative Study of DASH Representation Sets Using Real …chkr.at/.../uploads/kreuzberger_nossdav_presentation_v2.pdf · 2016-05-14 · A COMPARATIVE STUDY OF DASH REPRESENTATION

Kreuzberger et al. A Comp. Study of DASH Repr. Sets – Real User Characteristics 20

Page 21: A Comparative Study of DASH Representation Sets Using Real …chkr.at/.../uploads/kreuzberger_nossdav_presentation_v2.pdf · 2016-05-14 · A COMPARATIVE STUDY OF DASH REPRESENTATION

Kreuzberger et al. A Comp. Study of DASH Repr. Sets – Real User Characteristics 21

Page 22: A Comparative Study of DASH Representation Sets Using Real …chkr.at/.../uploads/kreuzberger_nossdav_presentation_v2.pdf · 2016-05-14 · A COMPARATIVE STUDY OF DASH REPRESENTATION

Kreuzberger et al. A Comp. Study of DASH Repr. Sets – Real User Characteristics 22