Network Adaptive Video Streaming Over Wireless Mesh Networks 3200

download Network Adaptive Video Streaming Over Wireless Mesh Networks 3200

of 21

Transcript of Network Adaptive Video Streaming Over Wireless Mesh Networks 3200

  • 8/4/2019 Network Adaptive Video Streaming Over Wireless Mesh Networks 3200

    1/21

    DEPT. OF INFO. & COMM.,GIST

    Network-Adaptive Video Streaming

    over Wireless Mesh Networks

    SangHoon Park

    October 25th, 2007

    Networked Media Laboratory, Department of Information andCommunication

    School of Information & MechatronicsGwangju Institute of Science & Technology (GIST)

    [email protected]

    http://nm.gist.ac.kr/~shpark

    Lab Seminar

    mailto:[email protected]:jongwon%[email protected]:jongwon%[email protected]:[email protected]
  • 8/4/2019 Network Adaptive Video Streaming Over Wireless Mesh Networks 3200

    2/21

    DEPT. OF INFO. & COMM.,GIST

    Presentation Outline

    Introduction & Motivation

    Problem Description

    Proposed System Architecture & Scheme

    Implementation

    Experimental Results

    Conclusions & Future Work

  • 8/4/2019 Network Adaptive Video Streaming Over Wireless Mesh Networks 3200

    3/21

    DEPT. OF INFO. & COMM.,GIST

    Video Streaming over Wireless Mesh Networks (WMNs)

    WMNs

    A cheap and efficient method for providing network connectivity

    Providing real-time multimedia service over WMNs

    VoD (Video on Demand) or Video broadcasting services in WMNs-based ubiquitous

    environment

    Video receivers: Multimedia communication with Internet servers

    VoD Server

    Video

    broadcastingserver

    Video receivers

  • 8/4/2019 Network Adaptive Video Streaming Over Wireless Mesh Networks 3200

    4/21

    DEPT. OF INFO. & COMM.,GIST

    Challenges in Video Streaming over WMNs

    Higher bit error rate (BER) than that in wired-line links Packet losses caused by many reasons

    Congestion, Random channel error, Route change/break,

    Scarce and time-varying network available bandwidth

    Dynamic channel capacity due to various kinds of interference

    As increasing hop-count, end-to-end throughput is severely degraded

    Lack of QoS support mechanism

    e.g., IEEE 802.11 has serious deficiencies in multi-hop environment due to hidden

    terminal effects and contention from neighbor traffic

    < Link-throughput > < End-to-end throughput >

  • 8/4/2019 Network Adaptive Video Streaming Over Wireless Mesh Networks 3200

    5/21

    DEPT. OF INFO. & COMM.,GIST

    Considerable Solution Approaches

    To handle the impact of channel error

    Efficient and resilient video coding and protection (e.g., FEC, delay-constrained ARQ, link-layer

    retransmission, )

    To handle scarce and dynamic network available bandwidth

    Scalable video transmission using scalable video coding

    Network-adaptive video rate control using network monitoring

    Multi-path video transmission

    QoS-supporting in layer MAC-layer service differentiation (e.g., IEEE 802.11e)

    Cross-layer approach (Cross-layer optimization or interaction)

    Jointly consider different layers, including multimedia application, routing and transporting protocol, link

    layer scheduling, and physical layer power control

    We are focusing on the problem: Scarce and dynamic network available

    bandwidth

    How to effectively dynamically adapt video stream?

    End-to-end video quality improvement

  • 8/4/2019 Network Adaptive Video Streaming Over Wireless Mesh Networks 3200

    6/21

    DEPT. OF INFO. & COMM.,GIST

    Problem Description

    Basic Assumptions

    A video flow can be transmitted in scalable fashion (e.g., temporal scalability)

    Base layer: l1, enhancement layers: l2, l3, , ln

    After video rate adaptation,k video layers are transmitted

    A video flow use a single path in WMNs

    S RN1 N2 N3

    N5

    N7N6

    N4

    Source video stream

    3l

    2l

    1l

    nl

    1

    l

    2l

    kl

    Adapted video stream

    Video

    adaptation

  • 8/4/2019 Network Adaptive Video Streaming Over Wireless Mesh Networks 3200

    7/21

    DEPT. OF INFO. & COMM.,GIST

    Problem Description (Cont.)

    Interference due to competing flow

    Network available bandwidth for video flow is fluctuating

    Arbitrary Intra-/Inter-background flow

    For the given assumptions,

    How to adapt scalable video according to time-varying network available bandwidth toimprove end-to-end video quality?

    Assumption: There is no greedy background flow. To cover this issue, multiple flow scheduling

    algorithm or congestion control is required

    S RN1 N2 N3

    B1

    Be

    video flow

    background flow

    time-varying network available bandwidth

  • 8/4/2019 Network Adaptive Video Streaming Over Wireless Mesh Networks 3200

    8/21

    DEPT. OF INFO. & COMM.,GIST

    Video Adaptation: End-to-End Vs

    Hop-by-Hop Rate Adaptation

    End-to-end Video Rate Adaptation

    End-to-end statistics (e.g., loss rate, quality) monitoring at receiver

    Sender adapt video based on feedback from receiver

    Main drawbacks

    Reliability of feedback will be decreased as the congestion is increased

    To guarantee reliable feedback, an additional back channel for feedback is needed

    Delay of feedback makes that video adaptation reacts slowly to time-varying channel

    condition

    S RN1 N2 N3

    end-to-end feedback

    videoadaptation

  • 8/4/2019 Network Adaptive Video Streaming Over Wireless Mesh Networks 3200

    9/21

    DEPT. OF INFO. & COMM.,GIST

    Video Adaptation: End-to-End Vs

    Hop-by-Hop Rate Adaptation

    Hop-by-hop Video Rate Adaptation

    Link statistics monitoring (e.g., MAC-layer loss rate) at each intermediate hop

    Intermediate hop adapt video based on own monitoring information

    Advantages

    The problems raised in the end-to-end approach can be solved

    Overhead & Challenges Cross-layer design is required

    Monitoring & rate adaptation module should be deployed at each intermediate hop

    Prioritized packetization at sender is needed

    S RN1 N2 N3

    monitoring

    & adaptation

    monitoring

    & adaptation

    monitoring

    & adaptation

  • 8/4/2019 Network Adaptive Video Streaming Over Wireless Mesh Networks 3200

    10/21

    DEPT. OF INFO. & COMM.,GIST

    Proposed System Architecture:

    Preliminary Design

    Internet

    video

    streams

    Access pointMesh routers

    < WMN Backbone> < WLAN>

    Video Server

    WMN gateway

    Videoreceiver

    Real-timeparsing &prioritized

    packetization

    Intermediate node QoS control

    playoutPlayout

    buffering

    Gateway architecture Video receiver architectureIntermediate node architecture

    Packetdroppingfor rate

    adaptation

    Wirelesschannel

    monitoring

    Packet

    discarding

    Networkmonitoring

    (multiple flow)

    Cross-layer design

  • 8/4/2019 Network Adaptive Video Streaming Over Wireless Mesh Networks 3200

    11/21

    DEPT. OF INFO. & COMM.,GIST

    Prioritized Packetization for Temporal

    Scalability

    NOL= number of layers

    TS

    packet

    RTP

    header

    TS

    packet

    TS

    packet

    TS

    packet

    TS

    packet

    TS

    packet

    TS

    packet

    Priority

    field

    188*7=1316 12

    1500

    1

    NOL+2

    NOLRate

    profile

    Current

    layer

    1NOL

    We assume

    Profile: MPEG-2 TS over RTP

    Priority field

    Each RTP packet contain additional fields in application layer

    Frame indexing (may not need)

    Priority (layering information)

  • 8/4/2019 Network Adaptive Video Streaming Over Wireless Mesh Networks 3200

    12/21

    DEPT. OF INFO. & COMM.,GIST

    Experimental Results: WMN Testbed

    Deployed in GIST DIC 2nd floor

    1 Gateway (N1), 6 Intermediate

    nodes (N2~N7)

    IEEE 802.11a-based

    Single Interface

    < Base-line throughput test (static routing): N1->N6>

    Link-throughput End-to-end throughput

    N1 (gateway)

    N2

    KOREN

    N3

    N4

    N5

    N6N7

    static routing pathfor throughput test

  • 8/4/2019 Network Adaptive Video Streaming Over Wireless Mesh Networks 3200

    13/21

    DEPT. OF INFO. & COMM.,GIST

    Video format

    MPEG-2 TS

    Resolution: 30fps 720x480

    Bitrate: 4Mbps CBR

    GOP: IBBPBB

    Interference by background traffic

    N3 -> N2: 2~4Mbps Pareto UDP traffic

    N4 -> N3: 2~4Mbps Pareto UDP traffic

    N5 -> N4: 2~4Mbps Pareto UDP traffic

    N6 -> N5: 2~4Mbps Pareto UDP traffic

    N7 -> N6: 2~4Mbps Pareto UDP traffic

    Single video streaming service

    N1 -> N2 -> N3 -> N4 -> N5 -> N6 -> video

    receiver using static routing

    N1 (gateway)

    N2

    KOREN

    N3

    N4

    N5

    N6 N7

    video receiver

    video traffic

    background traffic

    Experimental Setup

  • 8/4/2019 Network Adaptive Video Streaming Over Wireless Mesh Networks 3200

    14/21

    DEPT. OF INFO. & COMM.,GIST

    Temporal scalability of experimental video

    stream

    Clip length: 2 minutes

    GOP: IBBPBB, 30fps, 4Mbps

    4 Temporal layers (l1, l2, l3, l4)

    Rate profile of each temporal layer

    l1: 1.52Mbps, l2: 0.86Mbps, l3: 0.8Mbps, l4: 0.8Mbps

    Frame rate profile of each temporal layer

    l1: 5fps, l2: 5fps, l3: 10fps, l4: 10fps

    < Source video stream

    traffic characteristic >

    I0 B1 B2 P3 B5 B6Original GOP

    I0

    B1

    B2

    P3

    B5

    B6

    l1: Base layer

    l2

    l3

    l4

    Enhancement

    layers

    < Temporal layering of experimental video stream>

    Experimental Video Specification

    Time (s)

    0 50 100 150 200 250 300

    Kbps

    3800

    3850

    3900

    3950

    4000

    4050

  • 8/4/2019 Network Adaptive Video Streaming Over Wireless Mesh Networks 3200

    15/21

    DEPT. OF INFO. & COMM.,GIST

    Experimental Results: Preliminary Results

    < Background traffic pattern >

    Experiment 1: 10 times According to the background traffic load

    < Background traffic characteristic:

    2M pareto >

    Experiment

    Index

    Dst->Src Traffic

    pattern

    Peak

    sending

    rate

    1 N3->N2 Pareto 2M

    2 N3->N2 Pareto 3M

    3 N3->N2 Pareto 4M

    4 N4->N3 Pareto 2M

    5 N4->N3 Pareto 3M

    6 N4->N3 Pareto 4M

    Time(s)

    0 50 100 150 200 250

    Bitrate

    0.0

    5.0e+5

    1.0e+6

    1.5e+6

    2.0e+6

    2.5e+6

  • 8/4/2019 Network Adaptive Video Streaming Over Wireless Mesh Networks 3200

    16/21

    DEPT. OF INFO. & COMM.,GIST

    Experimental Results

    Methodology for end-to-end video quality measurement

    Receiving stage: Received packet ratio per frame, Discarded frame ratio

    Displayed Frame rate

    Discontinuity, Variance of Discontinuity (VoD), Autocorrelation of

    Discontinuity (AoD)

    Demuxing Decoding RenderingReceiving < th

    Y

    Frame discarding

  • 8/4/2019 Network Adaptive Video Streaming Over Wireless Mesh Networks 3200

    17/21

    DEPT. OF INFO. & COMM.,GIST

    Preliminary Experimental Results:

    N4->N3 background flow

  • 8/4/2019 Network Adaptive Video Streaming Over Wireless Mesh Networks 3200

    18/21

    DEPT. OF INFO. & COMM.,GIST

    Preliminary Experimental

    Results with No Background

  • 8/4/2019 Network Adaptive Video Streaming Over Wireless Mesh Networks 3200

    19/21

    DEPT. OF INFO. & COMM.,GIST

    Conclusions & Future Work

    Network-Adaptive

    End-to-End Vs Hop-by-hop Video Adaptation in WMNs

    Preliminary Architecture & Scheme are proposed

    Future Work

    Performance Evaluation through extensive experiments

    Hop-by-hop scheme needed to be improved

    There is still video distortion before video adaptation starting due to

    reactive reponse

    To solve this problem, error recovery and adaptive playout can be

    incorporated (preliminary idea!)

  • 8/4/2019 Network Adaptive Video Streaming Over Wireless Mesh Networks 3200

    20/21

    DEPT. OF INFO. & COMM.,GIST

    References

    [1] J. Jun and M. L. Sichitiu, The nominal capacity of wireless mesh networks, IEEE WirelessCommunications Magazine, Oct. 2003.

    [2] Q. Zhang, Video delivery over wireless multp-hop networks, in Proc. ISPCS, Dec. 2005

  • 8/4/2019 Network Adaptive Video Streaming Over Wireless Mesh Networks 3200

    21/21

    DEPT. OF INFO. & COMM.,GIST

    Thanks !Q & A