By:Santosh Kumar
Muniyappa (1000661813)
Guided by: Dr. K. R. Rao
Final ReportMultimedia Processing
(EE 5359)
Many H.264 softwares like JM[6](Joint Model), Intel IPP[8](Integrated Performance Primitives), X264[5], FFMpeg [9](Fast Forward Moving Picture Experts Group).
The goal of this project is to carry out a performance analysis of the H.264 softwares like JM software, Intel IPP and X264.
JM software used here is version 17.2
Video coding standard jointly developed by ITU-T Video Coding Experts Group (VCEG) and the ISO/IEC Moving Picture Experts Group (MPEG).
Most widely accepted video standardBlu-ray discs, videos from YouTube and iTunes
store, Adobe Flash Player, Microsoft silverlight,
Outperforms all existing standards by a factor of two
Supports both planar and interleaved/packed raw image data (viz., yuv, rgb)
Input configuration file (*.cfg)Input fileNumber of frames to be encodedFrame rateOutput frame width and HeightProfile, level selectionGOP sizeBit rate control
Supports raw video data (yuv4mpeg or y4m only 4:2:0)
Output file format .264, .mkv, mp4Have to provide the inputs through the
command promptProfileRate controlGOP sizeQuantization parameterFrame rateon an average, x264 performs 50x faster
when compared to JM [7]
The encoder assumes that input videodata object contains frame in YUV420 format
Encoder does not support frame resizing. Thus input and output frame sizes should be the same.
Supports only main and high profiles.Input file is h264.par
Source fileNumber of frames to encodeFrame rate
A detailed analysis on different profiles and bit rates using QCIF and HDTV video test sequences will be done
Performance Comparison:Encoding and decoding times (seconds)Compression ratioPeak to peak signal to noise ratioStructural similarity index metric [12]
Video Sequenceakiyo_qcif.y4m 3713 KBQCIF format –176 x 144 YUV –4:2:0Number of frames encoded –100Profile –baseline, mainQuantization parameter–10,28,40,51Number of reference frames -3
akiyo_qcif.y4m sintel_720p.y4m
Reference Frames
Quantization Parameter
Structural Similarity
Index Metric
Peak to Peak Signal to
Noise Ratio in dB
Total Encoding Times(s)
Bit rates(kbps)
Compression Ratio
10 0.9969 51.086 525.499 1237.16 7.367063
28 0.971 38.234 248.934 229.5 39.5
40 0.861 29.906 183.088 71.38 123.7667
51 0.5814 22.532 145.103 25.35 337.5455
Quantization Parameter
Structural Similarity
Index Metric
Peak to Peak Signal to
Noise Ratio in dB
Total Encoding Times(s)
Bit rates(kbps)
Compression Ratio
10 0.9975 51.832 38.428 1292.51 7.058935
28 0.9722 38.431 35.715 204.14 44.20238
40 0.8609 29.836 34.030 66.05 137.5185
51 0.3909 12.79 33.082 12.76 618.8333
Video Sequencesintel_720p_100.y4mHDTV 1280×720Number of frames encoded –100GOP – IPBPBPBPBPBQuantization parameter–10,28,40,51Number of reference frames -3
Quantization Parameter
Structural Similarity
Index Metric
Peak to Peak Signal to Noise
Ratio in dBTotal Encoding
Times(s) Bit rates(kbps)Compression
Ratio
10 0.9989 63.115 1438.401 14044.44 23.85827
28 0.9796 47.424 1394.849 2001.91 167.3006
40 0.8692 37.834 1307.674 476.25 702.8351
51 0.5354 10.716 1059.323 109.25 3030
Video Sequenceakiyo_qcif.y4m 3713 KBQCIF format –176 x 144 YUV –4:2:0Number of frames encoded –100Profile –baseline, mainQuantization parameter–10,28,40,51Number of reference frames -3
Quantization Parameter
Structural Similarity
Index Metric
Peak to Peak Signal to
Noise Ratio in dB
Total Encoding Times(s)
Bit rates(kbps)
Compression Ratio
10 0.997426 51.895 0.813 426.28 21.33908
28 0.977708 39.174 0.396 36.16 247.5333
40 0.9046 31.617 0.392 9.78 928.25
51 0.737023 25.914 0.271 5.35 1237.667
Quantization Parameter
Structural Similarity
Index Metric
Peak to Peak Signal to
Noise Ratio in dB
Total Encoding Times(s)
Bit rates(kbps)
Compression Ratio
10 0.997371 51.587 0.7949 288.15 31.4661
28 0.977456 39.302 0.5029 30.29 285.6154
40 0.904055 31.814 0.4889 11.28 742.6
51 0.724986 25.959 0.327 6.4 1237.667
Video Sequencesintel_720p_100.y4mHDTV 1280×720Number of frames encoded –100GOP – IPBPBPBPBPBQuantization parameter–10,28,40,51Number of reference frames -3
Quantization Parameter
Structural Similarity
Index Metric
Peak to Peak Signal to
Noise Ratio in dB
Total Encoding Times(s)
Bit rates(kbps)
Compression Ratio
10 0.998286 63.175 17.85714286 5465.59 61.30845
28 0.99331 55.436 7.849293564 510.28 655.5288
40 0.982018 42.128 4.830917874 144.31 2311.017
51 0.959803 35.188 4.636068614 50.81 6492.857
Video Sequenceakiyo_qcif.y4m 3713 KBQCIF format –176 x 144 YUV –4:2:0Number of frames encoded –100Profile –baseline, mainBit Rates(kbps) – 1000, 100, 50, 10Number of reference frames -3
Bit rates(kbps)
Structural Similarity Index
Metric
Peak to Peak Signal to Noise
Ratio in dBTotal Encoding
Times(s)Compression
Ratio
1000 0.9963 49.8634 0.66 8.47
100 0.979 41.2845 0.45 68.57
50 0.9392 35.8397 0.38 137.44
10 0.6553 24.6113 0.35 154.37
Bit rates(kbps)
Structural Similarity Index
Metric
Peak to Peak Signal to Noise
Ratio in dBTotal Encoding
Times(s)Compression
Ratio
1000 0.9962 49.1608 0.69 9.4
100 0.983 41.1057 0.44 77.68
50 0.9492 35.3562 0.4 138.97
10 0.655 24.6113 0.39 159.6
Video Sequencesintel_720p_100.y4mHDTV 1280×720Number of frames encoded –100GOP – IPBPBPBPBPBBit Rates(kbps) – 1000, 100, 50, 10 Number of reference frames -3
Bit rates(kbps)
Structural Similarity Index
Metric
Peak to Peak Signal to Noise
Ratio in dBTotal Encoding
Times(s)Compression
Ratio
1000 0.998286 61.755 11.71 366.75
100 0.98331 55.8701 4.76 3317.02
50 0.942018 42.128 4.2 5153.59
10 0.899803 35.188 4.17 5856.63
JM X264 Intel IPP
Bit Rates(kbps)
SSIM Bit Rates(kbps)
SSIM Bit Rates(kbps)
SSIM
1237.16 0.9969 642.01 0.997426 1000 0.9963
229.5 0.971 99.08 0.977708 100 0.979
71.38 0.861 34.3 0.9046 50 0.9392
25.35 0.5814 15.55 0.737023 10 0.6553
JM X264 Intel IPP
Bit Rates(kbps)
SSIM Bit Rates(kbps)
SSIM Bit Rates(kbps)
SSIM
1292.51 0.9975 558.28 0.997588 1000 0.9962
204.14 0.9722 93.3 0.979848 100 0.983
66.05 0.8609 33.38 0.909762 50 0.9492
12.76 0.3909 14.97 0.731834 10 0.655
JM X264 Intel IPP
Bit Rates(kbps)
SSIM Bit Rates(kbps)
SSIM Bit Rates(kbps)
SSIM
14044.44 0.9989 5465.59 0.998286 1000 0.998286
2001.91 0.9796 510.28 0.99331 100 0.98331
476.25 0.8692 144.31 0.982018 50 0.942018
109.25 0.5354 50.81 0.959803 10 0.899803
JM X264 Intel IPP
Bit Rates(kbps)
PSNR(dB)
Bit Rates(kbps)
PSNR(dB)
Bit Rates(kbps)
PSNR(dB)
1237.16 51.086 642.01 52.216 1000 49.8634
229.5 38.234 99.08 40.082 100 41.2845
71.38 29.906 34.3 32.173 50 35.8397
25.35 22.532 15.55 26.25 10 24.6113
JM X264 Intel IPP
Bit Rates(kbps)
PSNR(dB)
Bit Rates(kbps)
PSNR(dB)
Bit Rates(kbps)
PSNR(dB)
1292.51 51.832 558.28 52.162 1000 49.1608
204.14 38.431 93.3 40.115 100 41.1057
66.05 29.836 33.38 32.222 50 35.3562
12.76 12.79 14.97 26.171 10 24.6113
JM X264 Intel IPP
Bit Rates(kbps)
PSNR(dB)
Bit Rates(kbps)
PSNR(dB)
Bit Rates(kbps)
PSNR(dB)
14044.44 63.115 5465.59 63.175 1000 61.755
2001.91 47.424 510.28 55.436 100 55.8701
476.25 37.834 144.31 42.128 50 42.128
109.25 10.716 50.81 35.188 10 35.188
JM X264 Intel IPP
Bit Rates(kbps)
Encoding Time (s)
Bit Rates(kbps)
Encoding Time (s)
Bit Rates(kbps)
Encoding Time (s)
1237.16 525.499 642.01 0.564016 1000 0.66
229.5 248.934 99.08 0.325998 100 0.45
71.38 183.088 34.3 0.197707 50 0.38
25.35 145.103 15.55 0.163999 10 0.35
JM X264 Intel IPP
Bit Rates(kbps)
Encoding Time (s)
Bit Rates(kbps)
Encoding Time (s)
Bit Rates(kbps)
Encoding Time (s)
1292.51 38.428 558.28 0.843028 1000 0.69
204.14 35.715 93.3 0.396999 100 0.44
66.05 34.03 33.38 0.325998 50 0.4
12.76 33.082 14.97 0.281001 10 0.39
JM X264 Intel IPP
Bit Rates(kbps)
Encoding Time (s)
Bit Rates(kbps)
Encoding Time (s)
Bit Rates(kbps)
Encoding Time (s)
14044.44 1438.401 5465.59 17.85714 1000 11.71
2001.91 1394.849 510.28 7.849294 100 4.76
476.25 1307.674 144.31 4.830918 50 4.2
109.25 1059.323 50.81 4.636069 10 4.17
JM X264 Intel IPP
Bit Rates(kbps)
Compression
Ratio
Bit Rates(kbps)
Compression
Ratio
Bit Rates(kbps)
Compression Ratio
1237.16 7.367063 642.01 14.17176 1000 8.47
229.5 39.5 99.08 90.56098 100 68.57
71.38 123.7667 34.3 265.2143 50 137.44
25.35 337.5455 15.55 530.4286 10 154.37
JM X264 Intel IPP
Bit Rates(kbps)
Compression Ratio
Bit Rates(kbps)
Compression Ratio
Bit Rates(kbps)
Compression Ratio
1292.51 7.058935 558.28 16.28509 1000 9.4
204.14 44.20238 93.3 97.71053 100 77.68
66.05 137.5185 33.38 265.2143 50 138.97
12.76 618.8333 14.97 530.4286 10 159.6
JM X264 Intel IPP
Bit Rates(kbps)
Compression Ratio
Bit Rates(kbps)
Compression Ratio
Bit Rates(kbps)
Compression Ratio
14044.44 23.85827 5465.59 61.30845 1000 366.75
2001.91 167.3006 510.28 655.5288 100 3317.02
476.25 702.8351 144.31 2311.017 50 5153.59
109.25 3030 50.81 6492.857 10 5856.63
Profiles Baseline Main HighSSIM Both X264 and
Intel IPP offer better results than JM
Both X264 and Intel IPP offer better results than JM
Both X264 and Intel IPP offer better results than JM
PSNR Both X264 and Intel IPP outperform JM. X264 performs slightly better than Intel IPP.
Both X264 and Intel IPP outperform JM. X264 performs slightly better than Intel IPP.
Both X264 and Intel IPP outperform JM. Intel IPP performs slightly better than X264
Encoding Time
Both X264 and Intel IPP outperform JM. X264 performs slightly better than Intel IPP.
Both X264 and Intel IPP outperform JM. X264 performs slightly better than Intel IPP.
Both X264 and Intel IPP outperform JM.
Compression Ratio
Both X264 and Intel IPP outperform JM. X264 performs slightly better than Intel IPP.
Both X264 and Intel IPP outperform JM. X264 performs slightly better than Intel IPP.
Both X264 and Intel IPP outperform JM. Intel IPP performs slightly better than X264
Perform the analysis on different video sequences .
Perform the analysis on different video formats viz., 4:2:2, 4:4:4
Perform the analysis on different video resolutions viz., 352x288, 480p, 1080p.
1. I. E. Richardson, “The H.264 advance video compression standard”, 2nd Edition, Wiley, 2010.
2. T. Wiegand, et al “Overview of the H.264/AVC video coding standard”, IEEE Trans. on circuits and systems for video technology, vol. 13, pp. 560-576, July 2003.
3. D. Marpe, T. Wiegand and G. J. Sullivan, “The H.264/MPEG-4 AVC standard and its applications”, IEEE Communications Magazine, vol. 44, pp. 134-143, Aug. 2006.
4. G. Sullivan, et al “The H.264/AVC Advanced Video Coding Standard: Overview and Introduction to the Fidelity Range Extensions”. Proceedings of SPIE - The International Society for Optical Engineering, vol. 5558, pp. 454-474, Applications of Digital Image Processing XXVII , 2004.
5. GIT repository of X264 - http://git.videolan.org/?p=x264.git;a=summary
6. JM software – http://iphome.hhi.de/suehring/tml/
7. L. Merritt et al., “X264: A High Performance H.264/AVC Encoder”.
8. Intel IPP - http://software.intel.com/en-us/articles/intel-integrated-performance-primitives-code-samples/
9. FFmpeg software - http://www.ffmpeg.org/10. Intel IPP Overview -
http://software.intel.com/en-us/intel-ipp/
11. K. V. S. Swaroop, and K. R Rao, “Performance Analysis and Comparison of JM 15.1 and Intel IPP H.264 Encoder and Decoder”, IEEE 2010 42nd Southeastern Symposium on System Theory (SSST), pp. 371-375, 2010.
12. Z. Wang, A. C. Bovik, H. R. Sheikh and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. on Image Processing, vol. 13, no. 4, pp. 600-612, Apr. 2004.
13. P. N. Tudor, “MPEG-2 video compression”, Electronics \& communication engineering journal, vol. 7, pp. 257-264, 2005.
14. S.Kwon, A. Tamhankar and K.R. Rao, “Overview of H.264 / MPEG-4 Part 10”, J. Visual Communication and Image Representation, vol. 17, pp.186-216, April 2006.
Thank you
Top Related