WiFi Display

14
1 WiFi Display Standard

description

Introduction to WiFi Display video coding and architecture

Transcript of WiFi Display

Page 1: WiFi Display

1

WiFi Display Standard

Page 2: WiFi Display

2

Protocol Methods Proprietary

Over TCP (what’s inside?)

Standard WFD Over UDP, WFD Header, MP2TS packets with

Page 3: WiFi Display

3

Standard WFD Stream

Page 4: WiFi Display

4

Architectural view

Page 5: WiFi Display

5

Media The Media Types supported by WFD:

H264 MPEG2 AAC Dolby AC3 LPCM (uncompressed audio)

Page 6: WiFi Display

6

MP2TS packetization in WFD WFD carries media (H264, AAC) in MP2TS packets

7 MP2TS are carried in a single RTP packet

RTP TS is derived from MP2TS and sent according to WLAN sync

Page 7: WiFi Display

7

Media Encapsulation Encapsulation of H264V into NAL/PES/MP2TS/RTP

Page 8: WiFi Display

8

Media Transport Stack Encoded audio/video streams are carried in MPEG2 Transport stream

The MP2TS packets are carried in RTP packets

Page 9: WiFi Display

9

H264 Profiles WFD supports two H264 profiles:

Constraint Base Profile Base profile without FMO, ASO

Constraint High Profile High profile without CABAC, 4x4

Page 10: WiFi Display

10

PAT & PMT PAT Should indicate PMT PID 0x100

PMT Should indicate PCR PID at 0x1000

PMT Should indicate video PID at 0x1011

PMT Should indicate Audio PID at 0x1100 (additional audio streams PID are consecutive)

The above tables (PCR,PAT/PMT…)should be sent at intervals smaller than 100mS

Page 11: WiFi Display

11

PMT Table

PMT Media Type Media Type

0x1B H.264

0X83 LPCM

0X81 AC3

0X0F AAC

Page 12: WiFi Display

12

Compression parameters changes Parameter compression change can follow changes in:

Device usage (Game, Video) Power (low battery) WLAN bandwidth changes

When changing compression parameters Source could: Change parameters without announcement Declare parameter changes using M4 RTSP request message

Page 13: WiFi Display

13

Frame Skipping WFD Frame skipping refers to removal of ALREADY

encoded video frames

Skipping is done AFTER the encoder

Frame number in slice header are sequential even when frames are skipped -> requires stream changing after encoder

The maximum skip interval is defined in bits B1:B3 of the wfd-video-formats parameters in M3 response

Frame skipping allowed only on non-referenced streams

->Skipping complete GOPs

Not recommended

Page 14: WiFi Display

14

Frame Refresh / Recovery In case of video streams errors (duo to packet loss), the

decoder may detect those errors

The Sink may decide that the errors are request a frame refresh (IDR Frame)

Request is done using the SET_PARAMETERS message with wfd_idr_request param