MPEG 4 Shaojie Zhang Anjum Gupta Dept. of Computer Science and Engineering.
-
Upload
wilfred-harrell -
Category
Documents
-
view
215 -
download
0
Transcript of MPEG 4 Shaojie Zhang Anjum Gupta Dept. of Computer Science and Engineering.
![Page 1: MPEG 4 Shaojie Zhang Anjum Gupta Dept. of Computer Science and Engineering.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d015503460f949d3503/html5/thumbnails/1.jpg)
MPEG 4Shaojie ZhangAnjum Gupta
Dept. of Computer Science and Engineering
![Page 2: MPEG 4 Shaojie Zhang Anjum Gupta Dept. of Computer Science and Engineering.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d015503460f949d3503/html5/thumbnails/2.jpg)
Outline
• Overview
• Technical Detail
• Industry and Market
• Conclusion
![Page 3: MPEG 4 Shaojie Zhang Anjum Gupta Dept. of Computer Science and Engineering.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d015503460f949d3503/html5/thumbnails/3.jpg)
Overview
• MPEG-1 - Error free environments
• MPEG-2 - Broadcast TV (SD and HD)
• MPEG-4 - Object based coding
• MPEG-7 - Multimedia description
• MPEG-21 - Seven element initiative for multimedia deployment
![Page 4: MPEG 4 Shaojie Zhang Anjum Gupta Dept. of Computer Science and Engineering.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d015503460f949d3503/html5/thumbnails/4.jpg)
What is MPEG-4
• An open toolbox to build bitstreams and decoders for multimedia content:
• Synthetic interactive graphics content
• To accommodate various user devices
• Lower bit rate encoding
![Page 5: MPEG 4 Shaojie Zhang Anjum Gupta Dept. of Computer Science and Engineering.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d015503460f949d3503/html5/thumbnails/5.jpg)
MPEG 4 – Basic Approach
• Object Based Encoding– MPEG-4 audiovisual scenes are composed of
several media objects.• Still objects (e.g. fixed background)
• Video objects (e.g. a talking person) • Audio objects
![Page 6: MPEG 4 Shaojie Zhang Anjum Gupta Dept. of Computer Science and Engineering.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d015503460f949d3503/html5/thumbnails/6.jpg)
Encoding Example
![Page 7: MPEG 4 Shaojie Zhang Anjum Gupta Dept. of Computer Science and Engineering.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d015503460f949d3503/html5/thumbnails/7.jpg)
An example of an MPEG-4 Scene
![Page 8: MPEG 4 Shaojie Zhang Anjum Gupta Dept. of Computer Science and Engineering.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d015503460f949d3503/html5/thumbnails/8.jpg)
Scene Description Format
• An MPEG-4 scene structure is represented as a DAG.
• Each node is a media object.
• Multiplexed with the media objects.
![Page 9: MPEG 4 Shaojie Zhang Anjum Gupta Dept. of Computer Science and Engineering.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d015503460f949d3503/html5/thumbnails/9.jpg)
Flexibility within MPEG-4
• Various algorithms to handle special cases.
• The stream is made of atomic units called Video Objects (VOs).
• Audio Visual Objects (AVOs) are combined to create a scene.
![Page 10: MPEG 4 Shaojie Zhang Anjum Gupta Dept. of Computer Science and Engineering.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d015503460f949d3503/html5/thumbnails/10.jpg)
Bit rate variability
Generic coder is extended by adding “Shape” input.
![Page 11: MPEG 4 Shaojie Zhang Anjum Gupta Dept. of Computer Science and Engineering.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d015503460f949d3503/html5/thumbnails/11.jpg)
Coding Tools and Algorithms
VLBV (Very Low Bit-rate Video) core can be extended by adding more information.
![Page 12: MPEG 4 Shaojie Zhang Anjum Gupta Dept. of Computer Science and Engineering.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d015503460f949d3503/html5/thumbnails/12.jpg)
MPEG-4 Encoding
![Page 13: MPEG 4 Shaojie Zhang Anjum Gupta Dept. of Computer Science and Engineering.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d015503460f949d3503/html5/thumbnails/13.jpg)
Decoding
![Page 14: MPEG 4 Shaojie Zhang Anjum Gupta Dept. of Computer Science and Engineering.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d015503460f949d3503/html5/thumbnails/14.jpg)
An Application
![Page 15: MPEG 4 Shaojie Zhang Anjum Gupta Dept. of Computer Science and Engineering.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d015503460f949d3503/html5/thumbnails/15.jpg)
Companies having MPEG-4 products
• Index of Companies
1. Ahead Software 2. Amphion Semiconductor 3. Apple Computers4. Bitmanagement
Software GmbH 5. Dicas
Digital Image Coding GmbH 6. DivXNetworks, Inc. 7. Emblaze Research 8. Envivio 9. Equator Technologies, Inc. 10.Fraunhofer Institute IIS-A 11.Hantro Products Oy 12.Harmonic Inc. 13.iVAST Inc.
14.Nextreaming Corporation 15.Octaga AS 16.Philips Electronics 17.Prodys 18.Sci-worx GmbH 19.Sorenson Media 20.Soundball, Inc. 21.Toshiba 22.Tvia, Inc. 23.VBrick Systems, Inc. 24.VCS Video Communication Syst
ems AG 25.VideoSpheres Inc. 26.Xilinx Inc.
![Page 16: MPEG 4 Shaojie Zhang Anjum Gupta Dept. of Computer Science and Engineering.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d015503460f949d3503/html5/thumbnails/16.jpg)
MPEG Market Penetration
US Market Penetration – growth from year 0 (introduction) – 10(From: The Yankee Group).
![Page 17: MPEG 4 Shaojie Zhang Anjum Gupta Dept. of Computer Science and Engineering.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d015503460f949d3503/html5/thumbnails/17.jpg)
MPEG Media Distribution
US Video-On-Demand Subscriber Forecasts(From: The Yankee Group)
![Page 18: MPEG 4 Shaojie Zhang Anjum Gupta Dept. of Computer Science and Engineering.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d015503460f949d3503/html5/thumbnails/18.jpg)
MPEG 4 Vs Other Technologies
![Page 19: MPEG 4 Shaojie Zhang Anjum Gupta Dept. of Computer Science and Engineering.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d015503460f949d3503/html5/thumbnails/19.jpg)
Conclusion
• MPEG-4 enables very low bit-rate multimedia communications.
• MPEG-4 is a dynamic standard, that is continuously being improved.
• Is being accepted in the industry applications.
• Expanding demand in the market.
![Page 20: MPEG 4 Shaojie Zhang Anjum Gupta Dept. of Computer Science and Engineering.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d015503460f949d3503/html5/thumbnails/20.jpg)
References
• ISO/IEC JTC1/SC29/WG11 N4668
• ISO/IEC JTC 1/SC 29/WG 11N2826
• ISO/IEC JTC 1/SC 29/WG 11N5504
• MPEG-4 Industry Forum (http://www.m4if.org)
![Page 21: MPEG 4 Shaojie Zhang Anjum Gupta Dept. of Computer Science and Engineering.](https://reader030.fdocuments.in/reader030/viewer/2022032723/56649d015503460f949d3503/html5/thumbnails/21.jpg)
Acknowledgement
• Dr. Wo Chang, NIST, U.S.
• Dr. Kai-Kuang Ma, NTU, Singapore