Study and Performance Comparison of H.264/AVC, Dirac and AVS China Part 7 EE5359 Project Fall 2010...

Study and Performance Study and Performance Comparison of H.264/AVC, Comparison of H.264/AVC, Dirac and AVS China Part 7Dirac and AVS China Part 7

EE5359 Project

Fall 2010

Touseef Khan

1000676051

General Video Coding and General Video Coding and Decoding Process [1]Decoding Process [1]

An optional preprocessing step, the sender might choose to preprocess the video using format conversion or enhancement techniques.

The encoder encodes the video and represents the video as a bit stream.

The decoder decodes the video which gets displayed after an optional post-processing step which might include format conversion, filtering to suppress coding artifacts, error concealment, or video enhancement

H.264/AVC [1]H.264/AVC [1] H.264/MPEG-4 AVC is a block-oriented motion-compensation-

based codec standard developed by the ITU-T Video Coding

Experts Group (VCEG) together with the ISO/IEC Moving

Picture Experts Group (MPEG). It was the product of a

partnership effort known as the Joint Video Team (JVT).

H.264/AVC provides gains in compression efficiency of up to

50% over a wide range of bit rates and video resolutions

compared to previous standards.

Supports various applications such as video broadcasting,

video streaming, and video conferencing over fixed and

wireless networks and over different transport protocols and

results better than MPEG-2.

Dirac[24]Dirac[24]Hybrid motion-compensated video codec

developed by BBC Research, BBC. Uses modern techniques – discrete

wavelet transforms, arithmetic coding. Dirac is a general-purpose video

compression family suitable for everything from internet streaming to HDTV and electronic cinema.

It offers good quality at low bit rates, leading to lower costs. It offers good quality with low delay - ideal for live broadcast applications in studios and outside broadcasts.

AVS China Part 7 (AVS AVS China Part 7 (AVS Mobile)[13]Mobile)[13] Audio-video coding standard (AVS) is a working group of

audio and video coding standard in China, which was established in 2002.

AVS is a set of integrity standard system – system, video, audio and media copyright management.

AVS China has a coding efficiency similar to that of H.264 except that it has a lower computational complexity.

AVS M is the 7th part of the video coding standard developed by the AVS Workgroup of China which aims for mobile systems and devices.

In AVS M, a Jiben Profile out of the 10 different profiles of AVS.

AVS follows a layered structure for the data and this representation is seen in the coded bit stream.

H.264 Layers[1]H.264 Layers[1] The video coding layer (VCL) defines the efficient

representation of the video. The network adaptation layer (NAL) converts the VCL

representation into a format suitable for specific transport layers or storage media.

H.264 Encoder[3]H.264 Encoder[3]

H.264 Decoder[3]H.264 Decoder[3]

Dirac Encoder and Dirac Encoder and Decoder[13]Decoder[13]

AVS-M Encoder[18]AVS-M Encoder[18]

AVS-M Decoder[18]AVS-M Decoder[18]

H.264/AVC introduces the following changes:[1]In order to reduce the block-artifacts an adaptive deblocking filter is used in the prediction loop. The deblocked macroblock is stored in the memory and can be used to predict future macroblocks.The memory contains one video frame in previous standards, H.264/AVC allows storing multiple video frames in the memory.In H.264/AVC a prediction scheme is used also in Intra mode that uses the image signal of already transmitted macroblocks of the same image in order to predict the block to code.The discrete cosine transform (DCT) used in former standards is replaced by an integer transform.

H.264 Profiles[1]H.264 Profiles[1] A profile is defined as a subset of the entire bit stream syntax or in

other terms as a subset of the coding tools.

There are three profiles in the first version: Baseline, Main and Extended. There are four High profiles defined in the fidelity range extensions .

AVS China Profiles[13]AVS China Profiles[13]

Dirac – Wavelet Dirac – Wavelet Transforms[8]Transforms[8] More efficient than block transforms with still images. Operates on entire picture. Logarithmic frequency decomposition into sub-bands

at each stage, the filter produces for sub-bands called Low-Low (LL), Low-High (LH), High-Low (HL) and High-High (HH). The LL band is iteratively encoded to gain the required data.

Wavelet transforms have been proven to provide a more efficient technique than block transforms with still images and is currently used in JPEG2000.

Horizontal and vertical filtering for 2D signals.

Parametric ComparisonParametric Comparison Algorithmic Element

H.264/AVC [1]

Dirac[9]

AVS China Part 7[14]

Intra Prediction

4x4spatial,16x16 spatial, I-PCM

4x4 spatial

9 modes, simple 4x4 intra prediction and direct intra prediction

Transform

4×4 integer DCT, 8×8 integer DCT

4×4 wavelet transform

4x4 ICT without scaling in decoder

In-Loop Filters

Deblocking

None

Deblocking

Entropy Coding

CAVLC(Context Adaptive Variable Length)CABAC(Context Adaptive Binary Arithmetic)VLC

VLC

2D-VLC .E.g.:-Golomb code

P-Frame Type

Single referenceMultiple references

Single referenceMultiple references

Single referenceMultiple references(maximum of 2 reference frames)

Motion compensation block size

16×16, 16×8, 8×16, 8×8, 8×4, 4×8, 4×4

4×4

16×16, 16×8, 8×16, 8×8

CIF and QCIF formats [3]CIF and QCIF formats [3]

Fig(a) : Common Intermediate Format(CIF) 4:2:0 chroma sampling

Fig (b): Quadrature Common Intermediate Format (QCIF) 4:2:0 chroma sampling

Performance Analysis of Performance Analysis of Dirac Video CodecDirac Video Codec

Original File: News.yuvFormat : 4:2:0

Quality Factor (QF)

Compressed File Size (KB)

Bit rate(KBps)

Y-PSNR(dB)

Y-MSE Y-SSIM Compression Ratio

0 18 4.58 23.0236 326.68 0.6933

206:1

3 32 8.152 27.965 104.713

0.8544

116:1

5 59 14.989 32.364 38.027 0.925 63:1

8 166 42.426 41.949 4.184 0.9849

22:1

10 373 95.388 46.699 1.401 0.993 10:1

DIRAC Codec QCIF sequence : news_qcif.yuvHeight:176 , Width: 144Total no. of frames : 300Frames used : 100Original File size : 3713KBFrame Rate = 25 fps

Video Quality at different values of Quality Factor (QF)

QF = 0 QF = 5

QF = 10

DIRAC codecFile: news.yuvFormat: QCIF

Quality Factor (QF)


Bit rate(KBps)

Y-PSNR(dB)


0 38 9.473 25.383 189.73 0.78 390:1

3 81 20.66 30.675 56.104 0.8973 183:1

5 159 40.567 35.248 19.573 0.946 93:1

8 524 134.44 42.611 3.592 0.9802 28:1

10 1379 352.95 46.67 1.41 0.99 10:1

DIRAC CodecCIF sequence : news_cif.yuvHeight:352, Width: 288Total no. of frames : 300Frames used : 100Original File size : 14,850KBFrame Rate : 25 fps


QF = 0 QF = 5

QF = 10

DIRAC codecFile: news.yuvFormat: CIF

DIRAC Codec - File : News.yuv ; Format : 4:2:0

Original File: Foreman.yuvFormat : 4:2:0

Quality Factor (QF)


Bit rate(KBps)

Y-PSNR(dB)


0 24 6.1125 23.4 299.55 0.6837

155:1

3 43 10.984 27.73 110.48 0.8316

86:1

5 81 20.673 32.458 37.207 0.9179

46:1

8 256 65.418 41.019 5.183 0.9795

14.5:1

10 570 145.766 46.259 1.5507 0.993 6.5:1

DIRAC Codec QCIF sequence : foreman_qcif.yuvHeight:176 , Width: 144Total no. of frames : 300Frames used : 100Original File size : 3713KBFrame Rate = 25 fps


QF = 0 QF = 5

QF = 10

DIRAC codecFile: foreman.yuvFormat: QCIF

Quality Factor (QF)


Bit rate(KBps)

Y-PSNR(dB)


0 62 15.669 24.891 212.515

0.7253 239.5:1

3 116 29.639 30.154 63.252 0.8486 128:1

5 241 61.679 34.584 22.81 0.9146 62:1

8 918 234.86 41.392 4.756 0.972 16:1

10 2343 599.63 46.189 1.576 0.9899 6:1

DIRAC CodecCIF sequence : foreman_cif.yuvHeight:352, Width: 288Total no. of frames : 300Frames used : 100Original File size : 14,850KBFrame Rate : 25 fps


QF = 0 QF = 5

QF = 10

DIRAC codecFile: foreman.yuvFormat: CIF

DIRAC codec - File : Foreman.yuv ; Format : 4:2:0

Performance Analysis of Performance Analysis of H.264 Video CodecH.264 Video Codec


QP Compressed File Size (KB)

Bit rate(KBps)

Y-PSNR(dB)


0 887 226.92 66.767 0.0138 0.999 4:1

10 358 91.395 51.357 0.4794 0.997 10:1

25 52 13.176 39.473 7.399 0.978 71:1

40 8 1.972 28.089 101.74 0.8534

464:1

50 3 0.6812 21.78 434.99 0.6204

1237:1

H.264 CodecQCIF sequence : news_qcif.yuvHeight:176, Width: 144Total no. of frames : 300Frames used : 100Original File size : 3713KBFrame Rate = 25 fps

Video Quality at different values of Quantization Parameter (QP)

QP = 0 QP = 25

QP = 50

H.264 codecFile: news.yuvFormat: QCIF


Bit rate(KBps)

Y-PSNR(dB)


0 3763 963.13 67.63 0.0113 0.999 4:1

10 1569 401.65 51.455 0.4688 0.996 9:1

25 151 38.624 40.648 5.644 0.976 98:1

40 23 5.826 30.079 64.348 0.8847 645:1

50 9 2.06 23.978 262.193

0.7379 1650:1

H.264 CodecCIF sequence : news_cif.yuvHeight:352, Width: 288Total no. of frames : 300Frames used : 100Original File size : 14,850KBFrame Rate : 25 fps


QP = 0 QP = 25

QP = 50

H.264 codecFile: news.yuvFormat: CIF

H.264 codec - File :News.yuv ; Format : 4:2:0


Bit rate(KBps)

Y-PSNR(dB)


0 1518 388.48 69.182 0.0079 0.999 2.4:1

10 673 172.25 51.563 0.4573 0.9975

5.5:1

25 93 23.794 39.134 7.999 0.9708

40:1

40 16 3.896 28.609 90.264 0.8457

232:1

50 5 1.1475 21.821 430.874

0.6 743:1

H.264 CodecQCIF sequence : foreman_qcif.yuvHeight:176, Width: 144Total no. of frames : 300Frames used : 100Original File size : 3713KBFrame Rate = 25 fps


QP = 0 QP = 25

QP = 50

H.264 codecFile: foreman.yuvFormat: QCIF


Bit rate(KBps)

Y-PSNR(dB)


0 6818 1745.19 69.804 0.00686

0.999 2:1

10 3274 838 51.614 0.4519 0.9965

4.5:1

25 296 75.654 39.206 7.868 0.9566

50:1

40 47 11.821 30.1608 63.153 0.8412

316:1

50 18 4.584 23.953 263.737

0.6963

825:1

H.264 CodecQCIF sequence : foreman_cif.yuvHeight:352, Width: 288Total no. of frames : 300Frames used : 100Original File size : 14,850KBFrame Rate = 25 fps


QP = 0 QP = 25

QP = 50

H.264 codecFile: foreman.yuvFormat: CIF

H.264 codec - File : Foreman.yuv ; Format : 4:2:0

Performance Analysis of AVS Performance Analysis of AVS China-M Video CodecChina-M Video Codec



Bit rate(KBps)

Y-PSNR(dB)


0 564 173.02 53.918 0.2659 0.9984

6.5:1

15 145 44.216 45.588 1.8099 0.9923

25.5:1

31 40 12.216 36.636 14.219 0.965 93:1

45 15 4.493 28.924 83.954 0.8706

247.5:1

63 8 2.294 19.431 747.14 0.5363

464:1

AVS China-M CodecQCIF sequence : news_qcif.yuvHeight:176, Width: 144Total no. of frames : 300Frames used : 100Original File size : 3713KBFrame Rate = 25 fps


QP = 0 QP = 31

QP = 63

AVS China-M codecFile: news.yuvFormat: QCIF

Quality Factor (QF)


Bit rate(KBps)

Y-PSNR(dB)


0 2581 792.64 54.17 0.2509 0.9979 5.75:1

15 499 153.135

45.585 1.811 0.987 29.75:1

31 124 37.914 38.047 10.276 0.9635 120:1

45 52 15.9 30.706 55.704 0.8919 285.5:1

63 30 9.156 20.188 627.54 0.6015 495:1

AVS China-M CodecCIF sequence : news_cif.yuvHeight:352, Width: 288Total no. of frames : 300Frames used : 100Original File size : 14,850KBFrame Rate : 25 fps


QP = 0 QP = 31

QP = 63

AVS China-M codecFile: news.yuvFormat: CIF

AVS China-M codec - File : News.yuv ; Format : 4:2:0


Bit rate(KBps)

Y-PSNR(dB)


0 1133 347.88 53.658 0.2823 0.9985

3:1

15 312 95.623 44.894 2.124 0.9905

12:1

31 71 21.73 36.038 16.319 0.9493

52:1

45 25 7.464 29.161 79.499 0.855 148.5:1

63 9 2.605 20.357 603.59 0.5187

412.5:1

AVS China-M CodecQCIF sequence : foreman_qcif.yuvHeight:176, Width: 144Total no. of frames : 300Frames used : 100Original File size : 3713KBFrame Rate = 25 fps


QP = 0 QP = 31

QP = 63

AVS China-M codecFile: foreman.yuvFormat: QCIF


Bit rate(KBps)

Y-PSNR(dB)


0 5286 1623.52 53.724 0.278 0.9979

2.8:1

15 1240 380.813 44.642 2.25 0.9846

12:1

31 223 68.267 36.538 14.544 0.9309

66.5:1

45 83 25.368 30.824 54.215 0.8456

179:1

63 35 10.643 21.1 508.71 0.5667

424:1

AVS China-M CodecQCIF sequence : foreman_cif.yuvHeight:352, Width: 288Total no. of frames : 300Frames used : 100Original File size : 14,850KBFrame Rate = 25 fps


QP = 0 QP = 31

QP = 63

AVS China-M codecFile: foreman.yuvFormat: CIF

AVS China-M codec - File : Foreman.yuv ; Format : 4:2:0

PSNR(dB) vs. Bitrate(KBps)

File : News.yuv ; Format: QCIF 4:2:0


File : Foreman.yuv ; Format: QCIF 4:2:0


File : News.yuv ; Format: CIF 4:2:0


File : Foreman.yuv ; Format: CIF 4:2:0

MSE vs. Bitrate (KBps)

File : News.yuv ; Format: QCIF 4:2:0

MSE vs. Bitrate(KBps)

File : Foreman.yuv ; Format: QCIF 4:2:0

File : News.yuv ; Format: CIF 4:2:0



File : Foreman.yuv ; Format: CIF 4:2:0

MSU Video Quality Measurement MSU Video Quality Measurement Tool[20]Tool[20]

ConclusionsConclusions It can be concluded from the results

that H.264 stands out in terms of performance with respect to compression ratio, quality and applications over AVS China part 7 and Dirac. The graphs and tabulations clearly show that the PSNR, MSE and SSIM[21] of the video sequences improve as the bit rate increases, while the bit rate is varied using the quantization parameter.

Future WorkFuture Work

Further work can be carried out in studying and comparing video coding standards: H.264/AVC, Dirac and AVS China Part 7(AVS Mobile) for all profiles i.e. main, baseline and high profiles. Test video sequences of SD and HD formats can also be used at various bit rates for better analysis of performance of the video coding standards.

References:1. J.Ostermann et al, “Video coding with H.264/AVC: Tools, Performance, and

Complexity”, IEEE Circuits and Systems Magazine, vol. 4, Issue:1, pp. 7 – 28, Aug. 2004.

2. D. Marpe, T. Wiegand and G.J. Sullivan, “The H.264/MPEG4 Advanced Video Coding Standard and its Applications” , IEEE Communications magazine, vol. 44, Issue: 8,pp: 134 –143, Aug. 2006.

3. S.Kwon, A. Tamhankar and K.R. Rao, “Overview of H.264 / MPEG-4 Part 10”, J. Visual Communication and Image Representation, vol. 17, pp.186-216, April 2006.

4. I. Richardson, “Vcodex White Paper: An overview of H.264”, www.vcodex.com.

5. I. Richardson, “The H.264 advanced video compression standard ”, Wiley, 2nd edition,2010.

6. T. Wiegand and G.J. Sullivan, “The H.264/AVC Video Coding Standard [Standards in a Nutshell]”, IEEE Signal processing magazine, vol. 24, Issue: 2, pp. 148 – 153,March 2007.

7. H.264/AVC reference software: http://iphome.hhi.de/suehring/tml/download/

8. The Dirac web page: http://www.bbc.co.uk/rd/projects/dirac/technology.shtml

9. S.Issa and O.O.Khalifa, “Performance analysis of Dirac video codec with H.264/AVC”, International conference on computer and communication engineering, pp:1-6,Aug. 2010

10. K. Onthriar, K.K. Loo and Z.Xue, “Performance Comparison of Emerging Dirac Video Codec with H.264/AVC”, International Conference on Digital Telecommunications, pp. 22 – 22, Aug. 2006.

11. Dirac Specifications: http://diracvideo.org/download/specification/dirac-spec-latest.pdf

12. Dirac video download: http://diracvideo.org/download/

13. K. R. Rao and D.N. Kim, “Current Video Coding Standards: H.264/AVC, Dirac, AVS China and VC-1”, IEEE 42nd Southeastern symposium on system theory (SSST), pp. 1-8,March 2010.

14. L.Fan et al,“Overview of AVS Video Standard”, IEEE International conference on multimedia and expo, pp. 423 - 426 ,vol. 1, June 2004.

15. S. Pasqualini et al, “Comparison of H.264/AVC, H.264 with AIF, and AVS based on different video quality metrics”, International conference on telecommunications, pp.190 – 195, May 2009.

16. AVS China software : ftp://159.226.42.57/public/avsdoc/avs_software

17. L.Yu, S.Chen and J.Wang, “Overview of AVS-video coding standards”, Signal processing : Image communication, pp. 247-262,vol. 24, Issue: 4, Apr. 2009.

18. L.Fan, “Mobile Multimedia Broadcasting Standards”, ISBN: 978-0-387-78263-8, Springer US, 2009.

19. YUV Video Sequences: http://trace.eas.asu.edu/yuv

20. MSU video quality measurement tool : http://compression.ru/video/quality_measure/video_measurement_tool_en.html

21. Z. Wang , E.P. Simoncelli and A.C. Bovik, “Multi-scale structural similarity for image quality assessment” , Proceedings of IEEE Asilomar Conference on Signals, Systems and Computers, (Asimolar), vol. 2, pp. 1398 -1402, Nov. 2003.

22. S Srinivasan, et al, “Windows media video 9: overview and applications”, Signal Processing: Image Communication, Vol. 19, Issue 9, pp. 851-875, Oct. 2004.

23. W.Gao and T.Huang, “AVS Standard -Status and Future Plan”, Workshop on Multimedia New Technologies and Application, Shenzhen, China, Oct. 2007.

24. A.Ravi ‘Performance analysis and comparison of the Dirac video codec with H.264 / MPEG-4 Part 10 AVC”.

25. Ravi and K.R. Rao, “Performance analysis and comparison of the Dirac video codec with H.264/ MPEG- 4, Part 10”, for the book "Advances in reasoning-based image processing, analysis and intelligent systems: Conventional and intelligent paradigms", 2011.

THANK YOU

Study and Performance Comparison of H.264/AVC, Dirac and AVS China Part 7 EE5359 Project Fall 2010...

Documents

Transcript of Study and Performance Comparison of H.264/AVC, Dirac and AVS China Part 7 EE5359 Project Fall 2010...