By:Santosh Kumar

Muniyappa (1000661813)

Guided by: Dr. K. R. Rao

Final ReportMultimedia Processing

(EE 5359)

Many H.264 softwares like JM[6](Joint Model), Intel IPP[8](Integrated Performance Primitives), X264[5], FFMpeg [9](Fast Forward Moving Picture Experts Group).

The goal of this project is to carry out a performance analysis of the H.264 softwares like JM software, Intel IPP and X264.

JM software used here is version 17.2

Video coding standard jointly developed by ITU-T Video Coding Experts Group (VCEG) and the ISO/IEC Moving Picture Experts Group (MPEG).

Most widely accepted video standardBlu-ray discs, videos from YouTube and iTunes

store, Adobe Flash Player, Microsoft silverlight,

Outperforms all existing standards by a factor of two

Supports both planar and interleaved/packed raw image data (viz., yuv, rgb)

Input configuration file (*.cfg)Input fileNumber of frames to be encodedFrame rateOutput frame width and HeightProfile, level selectionGOP sizeBit rate control

Supports raw video data (yuv4mpeg or y4m only 4:2:0)

Output file format .264, .mkv, mp4Have to provide the inputs through the

command promptProfileRate controlGOP sizeQuantization parameterFrame rateon an average, x264 performs 50x faster

when compared to JM [7]

The encoder assumes that input videodata object contains frame in YUV420 format

Encoder does not support frame resizing. Thus input and output frame sizes should be the same.

Supports only main and high profiles.Input file is h264.par

Source fileNumber of frames to encodeFrame rate

A detailed analysis on different profiles and bit rates using QCIF and HDTV video test sequences will be done

Performance Comparison:Encoding and decoding times (seconds)Compression ratioPeak to peak signal to noise ratioStructural similarity index metric [12]

Video Sequenceakiyo_qcif.y4m 3713 KBQCIF format –176 x 144 YUV –4:2:0Number of frames encoded –100Profile –baseline, mainQuantization parameter–10,28,40,51Number of reference frames -3

akiyo_qcif.y4m sintel_720p.y4m

Reference Frames

Quantization Parameter

Structural Similarity

Index Metric

Peak to Peak Signal to

Noise Ratio in dB

Total Encoding Times(s)

Bit rates(kbps)

Compression Ratio

10 0.9969 51.086 525.499 1237.16 7.367063

28 0.971 38.234 248.934 229.5 39.5

40 0.861 29.906 183.088 71.38 123.7667

51 0.5814 22.532 145.103 25.35 337.5455

Quantization Parameter

Structural Similarity

Index Metric

Peak to Peak Signal to

Noise Ratio in dB

Total Encoding Times(s)

Bit rates(kbps)

Compression Ratio

10 0.9975 51.832 38.428 1292.51 7.058935

28 0.9722 38.431 35.715 204.14 44.20238

40 0.8609 29.836 34.030 66.05 137.5185

51 0.3909 12.79 33.082 12.76 618.8333

Video Sequencesintel_720p_100.y4mHDTV 1280×720Number of frames encoded –100GOP – IPBPBPBPBPBQuantization parameter–10,28,40,51Number of reference frames -3

Quantization Parameter

Structural Similarity

Index Metric

Peak to Peak Signal to Noise

Ratio in dBTotal Encoding

Times(s) Bit rates(kbps)Compression

Ratio

10 0.9989 63.115 1438.401 14044.44 23.85827

28 0.9796 47.424 1394.849 2001.91 167.3006

40 0.8692 37.834 1307.674 476.25 702.8351

51 0.5354 10.716 1059.323 109.25 3030

Video Sequenceakiyo_qcif.y4m 3713 KBQCIF format –176 x 144 YUV –4:2:0Number of frames encoded –100Profile –baseline, mainQuantization parameter–10,28,40,51Number of reference frames -3

Quantization Parameter

Structural Similarity

Index Metric

Peak to Peak Signal to

Noise Ratio in dB

Total Encoding Times(s)

Bit rates(kbps)

Compression Ratio

10 0.997426 51.895 0.813 426.28 21.33908

28 0.977708 39.174 0.396 36.16 247.5333

40 0.9046 31.617 0.392 9.78 928.25

51 0.737023 25.914 0.271 5.35 1237.667

Quantization Parameter

Structural Similarity

Index Metric

Peak to Peak Signal to

Noise Ratio in dB

Total Encoding Times(s)

Bit rates(kbps)

Compression Ratio

10 0.997371 51.587 0.7949 288.15 31.4661

28 0.977456 39.302 0.5029 30.29 285.6154

40 0.904055 31.814 0.4889 11.28 742.6

51 0.724986 25.959 0.327 6.4 1237.667

Video Sequencesintel_720p_100.y4mHDTV 1280×720Number of frames encoded –100GOP – IPBPBPBPBPBQuantization parameter–10,28,40,51Number of reference frames -3

Quantization Parameter

Structural Similarity

Index Metric

Peak to Peak Signal to

Noise Ratio in dB

Total Encoding Times(s)

Bit rates(kbps)

Compression Ratio

10 0.998286 63.175 17.85714286 5465.59 61.30845

28 0.99331 55.436 7.849293564 510.28 655.5288

40 0.982018 42.128 4.830917874 144.31 2311.017

51 0.959803 35.188 4.636068614 50.81 6492.857

Video Sequenceakiyo_qcif.y4m 3713 KBQCIF format –176 x 144 YUV –4:2:0Number of frames encoded –100Profile –baseline, mainBit Rates(kbps) – 1000, 100, 50, 10Number of reference frames -3

Bit rates(kbps)

Structural Similarity Index

Metric

Peak to Peak Signal to Noise

Ratio in dBTotal Encoding

Times(s)Compression

Ratio

1000 0.9963 49.8634 0.66 8.47

100 0.979 41.2845 0.45 68.57

50 0.9392 35.8397 0.38 137.44

10 0.6553 24.6113 0.35 154.37

Bit rates(kbps)

Structural Similarity Index

Metric

Peak to Peak Signal to Noise

Ratio in dBTotal Encoding

Times(s)Compression

Ratio

1000 0.9962 49.1608 0.69 9.4

100 0.983 41.1057 0.44 77.68

50 0.9492 35.3562 0.4 138.97

10 0.655 24.6113 0.39 159.6

Video Sequencesintel_720p_100.y4mHDTV 1280×720Number of frames encoded –100GOP – IPBPBPBPBPBBit Rates(kbps) – 1000, 100, 50, 10 Number of reference frames -3

Bit rates(kbps)

Structural Similarity Index

Metric

Peak to Peak Signal to Noise

Ratio in dBTotal Encoding

Times(s)Compression

Ratio

1000 0.998286 61.755 11.71 366.75

100 0.98331 55.8701 4.76 3317.02

50 0.942018 42.128 4.2 5153.59

10 0.899803 35.188 4.17 5856.63

JM X264 Intel IPP

Bit Rates(kbps)

SSIM Bit Rates(kbps)

SSIM Bit Rates(kbps)

SSIM

1237.16 0.9969 642.01 0.997426 1000 0.9963

229.5 0.971 99.08 0.977708 100 0.979

71.38 0.861 34.3 0.9046 50 0.9392

25.35 0.5814 15.55 0.737023 10 0.6553

JM X264 Intel IPP

Bit Rates(kbps)

SSIM Bit Rates(kbps)

SSIM Bit Rates(kbps)

SSIM

1292.51 0.9975 558.28 0.997588 1000 0.9962

204.14 0.9722 93.3 0.979848 100 0.983

66.05 0.8609 33.38 0.909762 50 0.9492

12.76 0.3909 14.97 0.731834 10 0.655

JM X264 Intel IPP

Bit Rates(kbps)

SSIM Bit Rates(kbps)

SSIM Bit Rates(kbps)

SSIM

14044.44 0.9989 5465.59 0.998286 1000 0.998286

2001.91 0.9796 510.28 0.99331 100 0.98331

476.25 0.8692 144.31 0.982018 50 0.942018

109.25 0.5354 50.81 0.959803 10 0.899803

JM X264 Intel IPP

Bit Rates(kbps)

PSNR(dB)

Bit Rates(kbps)

PSNR(dB)

Bit Rates(kbps)

PSNR(dB)

1237.16 51.086 642.01 52.216 1000 49.8634

229.5 38.234 99.08 40.082 100 41.2845

71.38 29.906 34.3 32.173 50 35.8397

25.35 22.532 15.55 26.25 10 24.6113

JM X264 Intel IPP

Bit Rates(kbps)

PSNR(dB)

Bit Rates(kbps)

PSNR(dB)

Bit Rates(kbps)

PSNR(dB)

1292.51 51.832 558.28 52.162 1000 49.1608

204.14 38.431 93.3 40.115 100 41.1057

66.05 29.836 33.38 32.222 50 35.3562

12.76 12.79 14.97 26.171 10 24.6113

JM X264 Intel IPP

Bit Rates(kbps)

PSNR(dB)

Bit Rates(kbps)

PSNR(dB)

Bit Rates(kbps)

PSNR(dB)

14044.44 63.115 5465.59 63.175 1000 61.755

2001.91 47.424 510.28 55.436 100 55.8701

476.25 37.834 144.31 42.128 50 42.128

109.25 10.716 50.81 35.188 10 35.188

JM X264 Intel IPP

Bit Rates(kbps)

Encoding Time (s)

Bit Rates(kbps)

Encoding Time (s)

Bit Rates(kbps)

Encoding Time (s)

1237.16 525.499 642.01 0.564016 1000 0.66

229.5 248.934 99.08 0.325998 100 0.45

71.38 183.088 34.3 0.197707 50 0.38

25.35 145.103 15.55 0.163999 10 0.35

JM X264 Intel IPP

Bit Rates(kbps)

Encoding Time (s)

Bit Rates(kbps)

Encoding Time (s)

Bit Rates(kbps)

Encoding Time (s)

1292.51 38.428 558.28 0.843028 1000 0.69

204.14 35.715 93.3 0.396999 100 0.44

66.05 34.03 33.38 0.325998 50 0.4

12.76 33.082 14.97 0.281001 10 0.39

JM X264 Intel IPP

Bit Rates(kbps)

Encoding Time (s)

Bit Rates(kbps)

Encoding Time (s)

Bit Rates(kbps)

Encoding Time (s)

14044.44 1438.401 5465.59 17.85714 1000 11.71

2001.91 1394.849 510.28 7.849294 100 4.76

476.25 1307.674 144.31 4.830918 50 4.2

109.25 1059.323 50.81 4.636069 10 4.17

JM X264 Intel IPP

Bit Rates(kbps)

Compression

Ratio

Bit Rates(kbps)

Compression

Ratio

Bit Rates(kbps)

Compression Ratio

1237.16 7.367063 642.01 14.17176 1000 8.47

229.5 39.5 99.08 90.56098 100 68.57

71.38 123.7667 34.3 265.2143 50 137.44

25.35 337.5455 15.55 530.4286 10 154.37

JM X264 Intel IPP

Bit Rates(kbps)

Compression Ratio

Bit Rates(kbps)

Compression Ratio

Bit Rates(kbps)

Compression Ratio

1292.51 7.058935 558.28 16.28509 1000 9.4

204.14 44.20238 93.3 97.71053 100 77.68

66.05 137.5185 33.38 265.2143 50 138.97

12.76 618.8333 14.97 530.4286 10 159.6

JM X264 Intel IPP

Bit Rates(kbps)

Compression Ratio

Bit Rates(kbps)

Compression Ratio

Bit Rates(kbps)

Compression Ratio

14044.44 23.85827 5465.59 61.30845 1000 366.75

2001.91 167.3006 510.28 655.5288 100 3317.02

476.25 702.8351 144.31 2311.017 50 5153.59

109.25 3030 50.81 6492.857 10 5856.63

Profiles Baseline Main HighSSIM Both X264 and

Intel IPP offer better results than JM

Both X264 and Intel IPP offer better results than JM

Both X264 and Intel IPP offer better results than JM

PSNR Both X264 and Intel IPP outperform JM. X264 performs slightly better than Intel IPP.

Both X264 and Intel IPP outperform JM. X264 performs slightly better than Intel IPP.

Both X264 and Intel IPP outperform JM. Intel IPP performs slightly better than X264

Encoding Time

Both X264 and Intel IPP outperform JM. X264 performs slightly better than Intel IPP.

Both X264 and Intel IPP outperform JM. X264 performs slightly better than Intel IPP.

Both X264 and Intel IPP outperform JM.

Compression Ratio

Both X264 and Intel IPP outperform JM. X264 performs slightly better than Intel IPP.

Both X264 and Intel IPP outperform JM. X264 performs slightly better than Intel IPP.

Both X264 and Intel IPP outperform JM. Intel IPP performs slightly better than X264

Perform the analysis on different video sequences .

Perform the analysis on different video formats viz., 4:2:2, 4:4:4

Perform the analysis on different video resolutions viz., 352x288, 480p, 1080p.

1. I. E. Richardson, “The H.264 advance video compression standard”, 2nd Edition, Wiley, 2010.

2. T. Wiegand, et al “Overview of the H.264/AVC video coding standard”, IEEE Trans. on circuits and systems for video technology, vol. 13, pp. 560-576, July 2003.

3. D. Marpe, T. Wiegand and G. J. Sullivan, “The H.264/MPEG-4 AVC standard and its applications”, IEEE Communications Magazine, vol. 44, pp. 134-143, Aug. 2006.

4. G. Sullivan, et al “The H.264/AVC Advanced Video Coding Standard: Overview and Introduction to the Fidelity Range Extensions”. Proceedings of SPIE - The International Society for Optical Engineering, vol. 5558, pp. 454-474, Applications of Digital Image Processing XXVII , 2004.

5. GIT repository of X264 - http://git.videolan.org/?p=x264.git;a=summary

6. JM software – http://iphome.hhi.de/suehring/tml/

7. L. Merritt et al., “X264: A High Performance H.264/AVC Encoder”.

8. Intel IPP - http://software.intel.com/en-us/articles/intel-integrated-performance-primitives-code-samples/

9. FFmpeg software - http://www.ffmpeg.org/10. Intel IPP Overview -

http://software.intel.com/en-us/intel-ipp/

11. K. V. S. Swaroop, and K. R Rao, “Performance Analysis and Comparison of JM 15.1 and Intel IPP H.264 Encoder and Decoder”, IEEE 2010 42nd Southeastern Symposium on System Theory (SSST), pp. 371-375, 2010.

12. Z. Wang, A. C. Bovik, H. R. Sheikh and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. on Image Processing, vol. 13, no. 4, pp. 600-612, Apr. 2004.

13. P. N. Tudor, “MPEG-2 video compression”, Electronics \& communication engineering journal, vol. 7, pp. 257-264, 2005.

14. S.Kwon, A. Tamhankar and K.R. Rao, “Overview of H.264 / MPEG-4 Part 10”, J. Visual Communication and Image Representation, vol. 17, pp.186-216, April 2006.

Thank you