04/19/23

AVS Part 1System

CUI BIN

AVS team of the MPL at UTA

Chinese Information technology - Advanced coding of audio and

video

04/19/23 2

AVS comprises 10 parts

Part I ： SystemPart 2: VideoPart 3 ： AudioPart 4 ： Compliance TestsPart 5 ： Reference SoftwarePart 6 ： Digital Rights ManagementPart 7 ： Mobile VideoPart 8 ： Transmission of AVS by IP NetworkPart 9 ： Format of AVSPart 10 ： Mobile Audio & Speech

04/19/23 3

AVS part 1

Part 1 of AVS addresses the combining of one or more elementary streams of video and audio

Convert data into single or multiple streams which are suitable for storage or transmission.

04/19/23 4

AVS System

AVSEncoder

Audio Source

AVSEncoder

VideoSource

Multiplexer

C h a n n e l

Encoded Stream

AVSDecoder

AVSDecoder

DemultiplexerLip Synch

Video

Audio

Compressed Video

Compressed Audio

Compressed Video

Compressed Audio

04/19/23 5

AVS Bit-streams

ESElementary Stream

PESPacketized Elementary Stream

TSTransport Stream

PSProgram stream

04/19/23 6

PES

PES is an abbreviation for packetized elementary stream.

PES’s syntax and semantics are used to encapsulate the audio and the video elementary stream information

04/19/23 7

Syntax of PESPacket

start code prefix

stream Id

PES packet length

Optional PES

headerPES data byte

‘10’

2

PES scrambling

control

PES priority

data alignment indicator

7 marker bits

PES header

data lengthCopyright

2 1 1 1 1 8 8

PTS DTS ESCR ES rate DSM trick

mode Additional copy info

PES CRC PES

extension

33 42 22 8 7

5 marker bits

Optional field

PES private

data

PES packet header

field

P-STD buffer

lengthof PES

extension field

PES extension field data

program packets

sequence control

128 8 168 7

24 8 16

original or copy

Optional field

stuffing byte

(0xFF)

m*8

16

04/19/23 8

Multiplex

Video Encoder

Video DataPacketizer

Audio Encoder

Audio DataPacketizer

PS MUX

TS MUX

Program Stream

Transport Stream

Video PES

Audio PES

Extent of Systems Specification

04/19/23 9

PS ( Program Stream)

The PS is designed for use in relatively error-free environments PS packets may be of variable and have

relatively great lengths

04/19/23 10

Decoder of PS

Channel decoder

Channel

Program Stream

Program Stream decoder

Clock control

Video decoder

Audio decoder

Decoded video

Decoded audio

04/19/23 11

Syntax of PSPacket header

Packet 1

packet start code

‘ 01’ SCRPacket stuffing length

System header

Program multiplexing

rate

System start code

Header length

upper limit of

rate

Fixed marker

CSPS flag

Video lock flag

upper limit of Video

N loop

Stream ID ‘ 11’

P-STD Buffer size

limits

P-STD proportion of the

buffer boundaries

8 2 131

PES packet 1

AVS XXX program stream

Packet 2 Packet 3Packet header

Packet n…

Packet layer

Packet stuffing

byte

PES packet 2 … PES

packet n

upper limit of audio

Audio lock flag

…

32 2 42 22 5 3

1 5

04/19/23 12

PS Map

24 8 16 1 2 5 7

Packet start code

prefix

map stream

ID

program stream map

length

current next

indicator

program stream map

version

program stream

info length

N loop descriptor

elementary stream map

lengthN loop CRC 32

stream type

elementary stream ID

elmentary stream info length

N loop descriptor

16

16 32

8 8 16

04/19/23 13

TS ( Transport Stream )

The Transport Stream is designed for use in environments where errors are likelyThe TS combines one or more PES with one

or more independent time bases into a single stream

TS packets are 188 bytes long

04/19/23 14

TS Decoder

Channel decoder

Channel

Transport stream including one or more programs

Transport Stream demultiplexer &

decoderClock control

Video decoder

Audio decoder

Decoded video

Decoded audio

04/19/23 15

TS decoder

Channel decoder

Channel

Transport stream including multi-programs

Transport Stream demultiplexer & decoder

Transport stream including single program

04/19/23 16

head payload head payload head payload

188 bytes

Sync byte

8bits

Transport error

indicator

Payload unit start indicator

Transport priority

Transport scrambling control

Adaptation field

control

Continuity counter

Adaptation field

PEIT indicator

1 1 1 13 2 2 4

adaptation field

length

Discontinuity indicator

Random access

indicator

Elementary stream priority

indicator

PCR,OPCRetc. flag

Optional field

Stuffing byte

8 1 1 1 5

PCR OPCRSplice count down

Private Specific

transport data length

3 flags

ltw_valid Ltw offsetPiecewise

rateSplice type

DTS_next_au

Private transport

data

Adaptation field

extension length

Optional field

42 42 8 8 8 3

1 15 22 322 4

Transport StreamPEIT: program element information table

04/19/23 17

TS map

8 1 1 12 16 1

table IDsection syntax

indicator‘0’

section length

version number

CR PEID

program info length

N loop CRC 32

stream type

N loop descriptor

5

32

8 13 12

program number

current next

indicator

section number

last section number

N loop descriptor

elementary PEID

ES info length

3 4

2 8 8 8 3 13 4

04/19/23 18

Switch of PS and TS

PS and TS can be interchangeable with each other

Switch according to the public interchange format of PES Packet

04/19/23 19

Reference [1] Dandan Ding et al., "Reconfigurable video coding framework and decoder reconfigur

ation instantiation of AVS", Signal Processing: Image Communication, vol. 24, pp. 287-299, April 2009.

[2] Junhao Zheng et al., "An efficient VLSI architecture for CABAC of AVS HDTV decoder", Signal Processing: Image Communication, vol. 24, pp. 324-332, April 2009.

[3] Lu Yu, SijiaChen and JianpengWang, "Overview of AVS-video coding standards", Signal Processing: Image Communication, vol. 24, pp. 247-262, April 2009.

[4] Huizhu Jia et al., "An AVS HDTV video decoder architecture employing efficient HW/SW partitioning", IEEE Trans. on Consumer Electronics, vol. 52, pp. 1447-1453, Oct. 2006.

[5] A. Ehret et al., "Audio coding technology of ExAC", Intelligent Multimedia, Video and Speech Processing, 2004. , pp. 290-293, Hong Kong, China, Oct. 2004.

[6] Cong Peng et al., "Architecture of AVS hardware decoding system", Intelligent Multimedia, Video and Speech Processing, 2004., pp. 306-309, Hong Kong, Oct. 2004.

[7] Per Ekstrand, "Bandwidth extension of audio signals by spectral band replication", Proc. 1st IEEE Benelux Workshop on Model based Processing and Coding of Audio, pp. 53-58, Leuven, Belgium, Nov. 2002.

04/19/23 20

Reference [8] Martin Dietz and Stefan Meltzer, "CT-aacPlus—a state-of-the-art audio coding sys

tem", EBU Technical Review, July 2002. [9] Davis Pan and I. L. Schaumburg, "A tutorial on MPEG/audio compression", IEEE

Multimedia, vol. 2, pp. 60-74, 1995. [10] Xin Jin, Songnan Li and King Ngi Ngan, "Platform-independent MB-based AVS video

standard implementation", Signal Processing: Image Communication, vol. 24, pp. 312-323, April 2009.

[11] Qitong Yang et al., "An Efficient Hardware Implementation for Intra Prediction of AVS Encoder", IEEE ICALIP 2008 pp. 200-205, Shanghai, July 2008.

[12] Leirui Wang et al., "Hardware Implementation of Transform and Quantization for AVS Encoder", IEEE ICALIP 2008 pp. 843-847, Shanghai, July 2008.

[13] Xin Jin, Songnan Li and King Ngi Ngan, "AVS Video Standard Implementation For SOC Design", IEEE Int. Conference Neural Networks & Signal Processing, Zhenjiang, June 2008.

[14] Hai bing Yin et al., "An efficient VLSI architecture for rate disdortion optimization in AVS video encoder", IEEE International Symposium on Circuits and Systems,IEEE ISCAS 2008, pp. 2805-2808, 2008.

[15]Yan Min and Hu Guorong, "Evaluation of Codec Performance of AVS Audio", Information Technology & Standardization, vol.2, pp.22-25,2006.

04/19/23 21

Thank You!