MULTIMEDIA PROCESSING

ADAPTIVE INTERPOLATION FILTER FOR H.264/AVC

Bhavana PrabhakarStudent Id: 1000790889Department of Electrical Engineering

H.264/ADVANCED VIDEO CODING:

Encoder block diagram H.264 [18]

H.264/ADVANCED VIDEO CODING:

Decoder block diagram H.264 [18]

Integer samples (shaded blocks with upper-case letters) and fractional sample positions (non-shaded blocks with lower-case letters). Example for filter size 6 x6. [16]

THE PROPOSAL

Present the non-separable adaptive interpolation filter which Analytically minimizes the energy of the prediction

error (PE). Where is the 2-D filter coefficient for each fractional pel position.

PE = Reduces the distorting effects, caused by aliasing,

motion blur, motion estimation inaccuracies etc. Further improvements can be achieved, when

applying locally adaptive filter, which is adapted to local properties of the image.

Steps will be taken to reduce blurring effects by: first considering only displacement without blurring effects. Where = average displacement vector and the prediction signal ( ) expressed in frequency domain is given in eq.(1) (jΩ) = (jΩ) eq.(1)With the intention of compensating the blurring effects, the adaptive interpolation filter H(jΩ) for perfect motion compensated prediction has to satisfy the condition given in eq.(2) (jΩ) = (jΩ) . H(jΩ) eq.(2)

An individual filter is to be used for the interpolation of each fractional-pel position

The estimation of the coefficients and the motion compensation are performed in the steps given in [16]

Filter coefficients are to be coded

Filter coefficients are subject to quantization, followed by prediction and entropy coding

The aliasing effects are minimized by suppressing the high-frequency components

Steps to reduce blurring effects.

STEPS TAKEN FOR IMPLEMENTATION OF AN AIF

FILTER COEFFICIENT OF A SUB-PEL POSITION.

6

1

6

11,1,

i j

SPjiji

SP hPp

Displacement vectors are estimated for every image to be coded. For the purpose of interpolation, the standard interpolation filter of H.264/AVC is applied to every reference image.

2-D filter coefficients are calculated for each sub-pel position independently by minimization of the prediction error energy:

x y i jjyix

SPjiyx

SP PhSe2

~,~,,2

LIST OF ACRONYMSAIF: Adaptive interpolation filterAVC: Advanced video codingBD – ROM: Blue ray disc – read only memoryCIF: Common intermediate formatHD – DVD: High definition - digital video discITU: International telecommunication unionKTA: Key technical areaMCIF: Motion compensated interpolation filterMPEG: Moving picture experts groupVCEG: Video coding experts group

REFERENCES[1] JVT of ISO/IEC & ITU-T, Draft ITU-T Recommendation H.264 and Draft ISO/IEC 14496-10 AVC, Doc JVT-Go50. Pattaya, Thailand, 2003.[2] O. Werner, “Drift analysis and drift reduction for multi resolution hybrid video coding”, Signal processing: image commun., vol. 8, no. 5, pp. 387–409, Jul. 1996.[3] T. Wedi and H. G. Musmann, “Motion and aliasing compensated prediction for hybrid video coding”, IEEE Trans. circuits syst. video technol., vol. 13, no. 7, pp. 577–586, Jul. 2003.[4] T. Wedi, “Adaptive interpolation filter for motion and aliasing compensated prediction”, in Proc VCIP, San Jose, CA, USA, pp. 415–422, Jan. 2002.[5] M. Budagavi, “Video compression using blur compensation”, in Proc.IEEE ICIP, Genova, Italy, pp. 882–885, Sep. 2005.[6] R. E. Crochiere and L. R. Rabiner, “Multi-rate signal processing”, Englewood Cliffs, NJ: Prentice Hall, pp. 88–91, 1983.[7] R. W. Schaefer and A. V. Oppenheim, “Discrete-time signal processing”, Englewood Cliffs, NJ: Prentice-Hall, 1989.[8] T. Wiegand et al, “Overview of the H.264/AVC video coding standard”, IEEE Trans. circuits syst. video technol., vol. 13, no. 7, pp. 560-576, Jul. 2003.[9] Y. Vatis and J. Ostermann, “Locally adaptive non separable interpolation filter for H.264/AVC”, in Proc. IEEE ICIP, Atlanta, GA, pp. 33–36, Oct. 2006.[10] T.Wedi, “Adaptive interpolation filter for motion compensated prediction”, Proc. IEEE ICIP, Rochester, NY, pp. 509–512, Sep. 2002.

[11] H.264/AVC reference software version JM11.0http://iphome.hhi.de/suehring/tml/download/old_jm/jm11.0.zip, Jan. 2007 [Online].[12] KTA software, version JM11.0 KTA1.3. http://www.tnt.uni-hannover.de/~vatis/kta/jm11.0kta1.3.zip, Mar. 2007 [Online].[13] Y. Vatis and J. Ostermann, “Prediction of P- and B-frames using a 2-D non-separable adaptive Wiener interpolation filter”,in ITU-T SG16/Q [15] (VCEG) Doc VCEG-AD08, Hangzhou, China, Oct. 2006.[14] Y. Vatis and J. Ostermann, ITU-T SG16/Q [15] (VCEG) VCEG-AE16, Marrakech, Morocco, Jan. 2007.[[15]] S. Wittman and T. Wedi, “Separable adaptive interpolation filter”,in ITU-T SG16/Q6, Doc. C-0219, Geneva, Switzerland, Jul. 2007.[16] Y. Vatis and J. Ostermann “Adaptive interpolation filter for H.264/AVC”, IEEE Trans. circuits syst. video technol., vol. 19, pp.179-192, Feb. 2009.[17] D. Rusanovskyy, K. Ugur, and J. Lainema, “Adaptive interpolation with directional filters”, in ITU-T SG16/Q.6 Doc. VCEG-AG21, Shenzhen,China, Oct. 2007.[18] D. Marpe, T. Wiegand and G. J. Sullivan, “The H.264/MPEG-4 AVC standard and its applications”, IEEE Communications Magazine, vol. 44, pp. 134-143, Aug. 2006.[19] T. Wiegand and G. J. Sullivan, “The picturephone is here:Really”, IEEE Spectrum, vol.48, pp. 50-54, Sep. 2011.[20] I. E. Richardson, “The H.264 Advanced Video Compression Standard”, 2nd Edition, Wiley 2010.