The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP
description
Transcript of The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP
![Page 1: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.fdocuments.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/1.jpg)
The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP
Hayder Radha ,Mihaela van der Schaar
and Yingwei Chen
IEEE TRANSACTIONS ON MULTIMEDIA, VOL.3, NO.1,MARCH 2001
![Page 2: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.fdocuments.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/2.jpg)
Outline
Introduction SNR FGS Video Coding Method FGS Coding with Adaptive
Quantization Hybrid Temporal-SNR Scalability with
an All FGS Structure Conclusions
![Page 3: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.fdocuments.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/3.jpg)
Introduction
Video-Coding and Networking Minimal real-time processing and rate
control when large number of unicast Highly adaptable to unpredictable
bandwidth Low-complexity decoding and low-
memory requirements
![Page 4: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.fdocuments.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/4.jpg)
Introduction(2)
Able to support both multicast and unicast applications
Scalable bitstream must be resilient to packet loss events
![Page 5: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.fdocuments.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/5.jpg)
SNR FGS Video Coding
[ Rmin = Rb , Rmax = Rb + Re ]
![Page 6: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.fdocuments.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/6.jpg)
SNR FGS Video Coding(2)
![Page 7: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.fdocuments.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/7.jpg)
SNR FGS Video Coding -encoder
Two encoders
base layer->motion compensation
enhancement layer->fine-granular Each DCT FGS-residual frame
consists of NBP bitplanes
![Page 8: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.fdocuments.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/8.jpg)
SNR FGS Video Coding -scanning order
![Page 9: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.fdocuments.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/9.jpg)
![Page 10: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.fdocuments.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/10.jpg)
Architecture for the SNR FGS Video Coding -decoder
![Page 11: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.fdocuments.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/11.jpg)
SNR FGS Video Coding -performance
Compared with traditional SNR scalability video coding
![Page 12: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.fdocuments.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/12.jpg)
SNR FGS Video Coding -performance(2)
![Page 13: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.fdocuments.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/13.jpg)
SNR FGS Video Coding -performance(3)
![Page 14: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.fdocuments.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/14.jpg)
SNR FGS Video Coding -conclusions
FGS exploits temporal redundancy only at the base layer
FGS is good for high motion sequences such as “movie trailers”,certain commercials and news clips with high-action content
![Page 15: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.fdocuments.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/15.jpg)
SNR FGS Video Coding -conclusions
Base-layer could have a major impact on the overall performance of FGS
[R2,Rmax] could be significantly better than the average performance over the wider range[R1,Rmax]
![Page 16: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.fdocuments.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/16.jpg)
FGS Coding with Adaptive Quantization
FGS-based AQ is achieved through bitplane shifting
Selected macroblocks within an FGS enhancement layer frame
Selected coefficients within the 8 * 8 blocks
![Page 17: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.fdocuments.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/17.jpg)
Adaptive Quantization-Selective Enhancement
![Page 18: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.fdocuments.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/18.jpg)
Adaptive Quantization-frequency weighting
![Page 19: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.fdocuments.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/19.jpg)
Adaptive Quantization-combine SE with FW
![Page 20: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.fdocuments.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/20.jpg)
Adaptive Quantization-notice
SE : macroblock-by-macroblock basis FW : use the same FW matrix Selective enhancement is a relative
operation Up-shifting operation does not
guarantee that a particular SE macroblock gets scanned earlier(MSB)
![Page 21: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.fdocuments.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/21.jpg)
Adaptive Quantization-evaluation
Not improve the rate-distortion performance ,but rather to improve the visual quality
SE can be used to enhance a particular region
FW can reduce some of blockiness, but may softening some of the sharp edges and other finedetails
![Page 22: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.fdocuments.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/22.jpg)
Adaptive Quantization-evaluation(2)
![Page 23: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.fdocuments.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/23.jpg)
Hybrid Temporal-SNR Scalability
Temporal scalability : Enhance the motion smoothness of compressed video
F = FBL + FEL
Provide the flexibility of choosing between temporal scalability and SNR scalability (Users’ performance and real-time bandwidth)
![Page 24: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.fdocuments.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/24.jpg)
all-FGS hybrid temporal-SNR scalability structure
![Page 25: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.fdocuments.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/25.jpg)
Architecture for the all-FGS hybrid temporal-SNR scalability encoder
![Page 26: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.fdocuments.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/26.jpg)
Architecture for the all-FGS hybrid temporal-SNR scalability decoder
![Page 27: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.fdocuments.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/27.jpg)
Performance Evaluation of the Hybrid FGS Scalability Method
![Page 28: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.fdocuments.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/28.jpg)
Performance Evaluation of the Hybrid FGS Scalability Method
![Page 29: The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP](https://reader035.fdocuments.in/reader035/viewer/2022070409/56814428550346895db0c2ce/html5/thumbnails/29.jpg)
Conclusions
MPEG-4 FGS framework Supporting unicast and multicast
Internet video application Adaptive quantization Hybrid temporal-SNR scalability
method