MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24...
Transcript of MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24...
![Page 1: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/1.jpg)
24 June ’03 0
MPEG-4 Demystified
Apple Worldwide Developers Conference24 June 2003
Rob Koenen
President, MPEG-4 Industry ForumChairman, MPEG Requirements GroupVice President, InterTrust Technologies
![Page 2: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/2.jpg)
24 June ’03 1
Overview
What is MPEG-4?How does MPEG-4 work?Recent Developments in MPEG-4Why use MPEG-4Deployment of MPEG-4About M4IF
![Page 3: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/3.jpg)
24 June ’03 2
Overview
What is MPEG-4?How does MPEG-4 work?Recent Developments in MPEG-4Why use MPEG-4?Deployment of MPEG-4About M4IF
![Page 4: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/4.jpg)
24 June ’03 3
What is MPEG-4?
The Media Standard Set by ISO/IEC
An interoperable cross-platform ecosystem An architecture and coding methods for representing rich multimedia content
beyond video and audio, supporting synthetic content, raster and vector graphics
Designed for all digital multimedia platforms
![Page 5: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/5.jpg)
24 June ’03 4
Where does it come from?
From Moving Picture Experts Group, who also did:MPEG-1: Standard for Video CD, CD-I, web, digital photo cameras
MPEG-1 Layer III audio codec (MP3)
MPEG-2: the DVD and digital TV standard
And also:MPEG-7: standard for description of contentMPEG-21: framework for interoperable use and exchange of digital media
![Page 6: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/6.jpg)
24 June ’03 5
MPEG-4 Vision
No convergence, but proliferationof multimedia over different networks, terminals.Common multimedia technology necessary that supports:
Broadcast CommunicationRetrieval
onlinepackaged media
![Page 7: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/7.jpg)
24 June ’03 6
One Single Technology for …
![Page 8: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/8.jpg)
24 June ’03 7
Write once - Play everywhere
![Page 9: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/9.jpg)
24 June ’03 8
Applications of MPEG-4
Mobile devicesLow datarates, errors, scalability
BroadcastNew, on-demand servicesHD broadcast‘MPEG-4 over MPEG-2’
Streaming servicesScalability, low to medium datarates, interactivity
Packaged Media (DVD)Interactivity,HD through higher compression rates
![Page 10: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/10.jpg)
24 June ’03 9
Overview
What is MPEG-4?How does MPEG-4 work?Recent Developments in MPEG-4Why use MPEG-4?Deployment of MPEG-4About M4IF
![Page 11: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/11.jpg)
24 June ’03 10
The Nature of MPEG-4
Object-based multimedia content representation standard
Revolutionary Systems Layer
State-of-the art coders, responsibly upgraded
Profiles and Levels restrict complexity and guarantee interoperability
![Page 12: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/12.jpg)
24 June ’03 11
The MPEG-4 Ecosystem
CreationDistribution
Consumption
![Page 13: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/13.jpg)
24 June ’03 12
‘Natural’ audiovisual object
Background with music
Graphic objects
Animated 2D photo / mesh
An MPEG-4 Scene
![Page 14: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/14.jpg)
24 June ’03 13
The Scene Tree
background voice-over
baby
video sound mesh picturebubbles
animated fish
root
graphics
sea-weed
fish
redblue
soilmusicsprite
![Page 15: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/15.jpg)
24 June ’03
Recapping: MPEG-4 is about the Coding of Audiovisual Objects
Audiovisual Scene is with ‘objects’These Objects can be of different nature Compositor puts objects in scene Efficient, Real-time Binary scene descriptionlanguage (BIFS)Coding scheme is optimal for object typePrinciple is fully independent of bitrate
![Page 16: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/16.jpg)
24 June ’03 15
MPEG-4 Supports a Variety of ‘Objects’
VisualVideoAnimated face & body; 2D and 3D animated meshesText and Graphics
AudioGeneral audio – mono - 5.1 channelsSpeechSynthetic sounds (‘Structured Audio’)Text-to-speech‘Environmental spatialization’
![Page 17: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/17.jpg)
24 June ’03 16
The Parts of the MPEG-4 Standard
Transport layerTransport layer
2. Visual
2. Visual
3. Audio
3. Audio
1. Systems1. Systems
1. Systems1. Systems
6. DMIF6. DMIF
presentationpresentation
decodingdecoding
demux & bufferdemux & buffer
transport interfacetransport interface
In principle not in standardIn principle not in standard
4. C
on
form
ance
4. C
on
form
ance
5. R
efer
ence
SW
5. R
efer
ence
SW
7. MPEG-4 on IP7. MPEG-4 on IP
10.AVC10.
AVC
![Page 18: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/18.jpg)
24 June ’03 17
Overview
What is MPEG-4?How does MPEG-4 work?Recent Developments in MPEG-4Why use MPEG-4?Deployment of MPEG-4About M4IF
![Page 19: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/19.jpg)
24 June ’03
Visual Media Object Types in MPEG-4
Video from 10 – 1,000,000 Kbit/sMultiple rectangular or arbitrary shape objects in the sceneScalable – Interlaced and Progressive
‘Sprites’ (e.g. backgrounds): send once, then warpComputer-generated visual information
Synchronized graphics & animated text Face and body animation, animated meshes with moving texture,
![Page 20: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/20.jpg)
24 June ’03 19
Audio Media Objects in MPEG-4
Audio from 4 kbit/s to 64 kbit/s/channelArbitrary number of objects in the sceneMPEG-4 AAC, TWINVQ> 4kbit/s: Harmonic and Individual Lines plus Noise’ (HILN)
Voice from 2 kbit/s to 24 kbit/s2-4 kbit/s: HVXC (Harmonic Vector eXcitation Coding)4-24 kbit/s: CELP:
Large step + Fine Grain Scalability1 kbit/s steps through Bit-Sliced Arithmetic Coding
![Page 21: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/21.jpg)
24 June ’03 20
MPEG-4’s Synthetic Audio Objects
Structured AudioSAOL (SA Orchestra Language)SASL (SA Score Language)Great ‘music’ at very low bitrates
Coded form of MIDIWavetable synthesis for simple decoders
Including effects
Text-To-Speech (interface!)To complement face/body animation
![Page 22: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/22.jpg)
24 June ’03 21
MPEG-4 Systems
Binary Scene DescriptionVRML concepts + Streaming + Real Time + EfficiencySupport for content in scene from different sourcesAllows interaction (local/remote)2D and 3DDynamic scene updates and scene animation
XMT: eXtensible MPEG-4 Textual FormatTextual format for BIFSIncludes some SMIL harmonization
![Page 23: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/23.jpg)
24 June ’03 22
MPEG-4 Systems
Predictable behavior of a decoder and decoded content:
Tight synchronization of A, V, synthetic, graphic elementsBuffer management
FlextimeSpring-like timing model (a-la SMIL)
IP management and protection (IPMP) InterfaceStandard interface to proprietary DRM SystemsMPEG-21 to bring more interoperability in DRM
File format MP4 (based on QuickTime)
![Page 24: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/24.jpg)
24 June ’03 23
MPEG-4 Systems (cntd.)
MPEG-J(ava) API for complicated content behavior, API’s to network / terminal / UI resources‘Application Engine’
Audio Rendering Specify downmix from arbitrary number of channelsEnvironmental spatialization
modeling of environment for spatial sound reproductionPhysical and perceptual model
![Page 25: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/25.jpg)
24 June ’03 24
Profiles & Levels
Conformance points are “Profiles@Levels”A bit like in MPEG-2
Profiles determine tool setE.g. B frames, ¼ pel Motion Compensation
Levels limit complexityE.g. MacroBlocks/sec, Complexity Units in Audio
Profiles are convergence point for Industry Standards built on MPEG-4
vehicle for market decisions and uptakee.g. Internet Streaming Media Alliance
![Page 26: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/26.jpg)
24 June ’03 25
Profile Dimensions:
Visual (natural, synthetic, natural + synthetic)Audio (natural, synthetic, natural + synthetic)Graphics
Scene Description (Scene Graph)Tools to describe and manipulate scene
MPEG-J (Main and Personal)Object Descriptor (Synch and Buffers)
MPEG does not prescribe how to combine theseThat’s what other industry fora do
Media Profiles
![Page 27: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/27.jpg)
24 June ’03 26
Overview
What is MPEG-4?How does MPEG-4 work?Recent Developments in MPEG-4Why use MPEG-4?Deployment of MPEG-4About M4IF
![Page 28: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/28.jpg)
24 June ’03 27
MPEG-4 Advanced Video Coding
Also standardized as ITU-T H.264Part 10 of MPEG-4 standardAlso known as the “JVT codec”
Built by world’s top video coding experts from ITU and MPEG in Joint Video Team (JVT)Best quality/complexity trade-off
Better than WM9, according to industry leader LSI LogicImprovements will continue
Significantly further reduces video bitratesFits into the MPEG-4 framework
Will coexist with MPEG-4 part 2 in market
![Page 29: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/29.jpg)
24 June ’03 28
High Efficiency Advanced Audio Coding
CD quality @ 48kbps; High quality @ 32kbpsAchieved through “Spectral Bandwidth Replication”predict upper half of spectrum from lower halfForward and backward compatible with ‘normal’ AAC
Amendment (addition) to MPEG-4 Audio Already operational in XM radio, chosen for Digital Radio Mondiale (“DRM”)Tested as best codec by EBU (European Broadcasting Union) over Windows, Real
![Page 30: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/30.jpg)
24 June ’03 29
EBU listening test results for 48Kbps stereo
0
20
40
60
80
100
Origina
laa
cPlu
sm
p3PRO
AAC
Real 8
7kHz L
PF
WM
A 8
MP3
Real G
23.
5kHz L
PF
LPF = Low Pass Filter. aacPlus is brand name for High Efficiency AAC. mp3PRO is brand name for MPEG-1 Layer III with Spectral Band ReplicationEBU = European Broadcasting Union
![Page 31: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/31.jpg)
24 June ’03 30
Other developments
Animation Framework eXtension (AFX)Unified framework for interactive animation and graphics
Work on 3D Video coding is in Requirements phaseWork on lossless audio coding is entering development phase
![Page 32: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/32.jpg)
24 June ’03 31
Overview
What is MPEG-4?How does MPEG-4 work?Recent Developments in MPEG-4Why use MPEG-4?Deployment of MPEG-4About M4IF
![Page 33: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/33.jpg)
24 June ’03 32
Standards Make Sense.They …
… fuel innovation (GSM, WLAN/802.11, …)… survive the test of time (PAL, NTSC, MP3, …)… prevent expensive format churn (VHS, CD, …)… help markets mature (CD, DVD, MPEG-2, …)… provide an interoperable ecosystem of tools and equipment: different providers make what they excel in
No vendor lock-in - avoid channel conflictsMarket-based price control mechanismsMulti-vendor sourcing of equipmentNo monopolies - no single vendor controls the format
![Page 34: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/34.jpg)
24 June ’03 33
MPEG-4 has Clear Benefits
Code once, use across platforms and players
Users pick their favorite players, devices
Content producers pick their favorite tools
Providers only need to stream in one format
Competition drives quality up
![Page 35: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/35.jpg)
24 June ’03 34
(R)evolution
A revolution in functionalityDesigned from the start for interactivityState of the art compression; responsible upgradesObject-based = intrinsic flexibilityProfiles, Levels limit complexity, guarantee interoperabilityOffers synthetic contentLocal rendering of 2D & 3D graphics and audio
An evolution in infrastructureAllows all types of ‘casting’: unicast, multicast, broadcast…on all network types, no need for new networks or transportsLeverage existing MPEG-2 and other infrastructures
![Page 36: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/36.jpg)
24 June ’03 35
Business Benefits
MPEG-4 saves moneyMore efficient use of bandwidthRepurpose existing contentNo need to duplicate work when adding value to assetsIntegrate into existing MPEG delivery environmentsUsed on all types of network, including IP
MPEG-4 makes moneyUse existing content and infrastructure in new waysAdd new dimensions to content, including interactivityLow-risk / high-return path for new entrants
![Page 37: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/37.jpg)
24 June ’03 36
Risks of Proprietary Technology
Third party business and pricing modelsProprietary, confidential 3rd party technology roadmaps
May change without warning
Potential channel conflicts Supplier also competitor License includes more “bundled features" than required
Single sourcing problems
![Page 38: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/38.jpg)
24 June ’03 37
Worldwide MPEG-4 Forecast
Shipments inmillions of units*
*Includes standalone MPEG-4 chips and cores embedded in processorsSource: ISUPPLI CORP.
![Page 39: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/39.jpg)
24 June ’03 38
Improvement Through Competition
Proprietary vendors underrate MPEG-4 quality:Comparisons with early, non-optimized codecs‘Industry-standard’ video quality does not exist!
MPEG standardizes the minimum: only decodersCompetition on encoding and post-processing
MPEG-2 bit-rates have reduced by over 50%after the standard was frozen in 1996without upgrading decoders
Competition between the ‘experts’ will: Drive MPEG-4 quality up after deployment of decodersDrive functionality of toolsMake AVC beat all proprietary codecs, including WM9
![Page 40: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/40.jpg)
24 June ’03 39
MPEG-2 Coding Efficiency – Harmonic, Inc.’s view
![Page 41: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/41.jpg)
24 June ’03 40
MPEG-2 Coding Efficiency – TandbergTV’s view
![Page 42: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/42.jpg)
24 June ’03 41
Overview
What is MPEG-4?How does MPEG-4 work?Recent Developments in MPEG-4Why use MPEG-4?Deployment of MPEG-4About M4IF
![Page 43: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/43.jpg)
24 June ’03 42
Widely adopted and supported
Industry wide PC media player supportQuickTime 6RealOne Player / Helix (Envivio plug-in)DivX: Millions of downloads weeklyWindows Media Player: several MPEG-4 plug-ins
MPEG-4 is part of the standard for 3G and 2.5G mobile phones
3GPP, 3GPP2 adopted MPEG-4 Profiles for video to mobileAAC is the optional audio codec in 3GPPFile format is adaptation of MP4QuickTime 6.3 supports 3GPP
![Page 44: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/44.jpg)
24 June ’03 43
Widely adopted and supported
Recommended by Internet Streaming Media Alliance (ISMA)
Vertical spec using horizontal MPEG-4 standard Founded by Sun, Kasenna, IBM, Apple, Cisco, Philips
MPEG-4 AVC to be adopted by DVB for DVB over IPBecoming de-facto standard for security, surveillance Supported in emerging Home Media Centers
![Page 45: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/45.jpg)
24 June ’03 44
Recent announcements and releases
MPEG-4 HD-based video camera (Samsung)Solid state video cameras (Panasonic, Divio)DVD players that read MP4 (Toshiba, Kiss)HDTV Chips (Sigma Designs)PDA’s (Sony’s Clie, Sharp’s Zaurus)Video ‘jukeboxes’ (e.Digital, Archos)Home entertainment gateways (e. Digital, Equator, Sigma, …)Mobile phones that decode and stream MP4 (Nokia, Motorola)
![Page 46: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/46.jpg)
24 June ’03 45
Overview
What is MPEG-4?How does MPEG-4 work?Recent Developments in MPEG-4Why use MPEG-4?Deployment of MPEG-4About M4IF
![Page 47: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/47.jpg)
24 June ’03 46
About the MPEG-4 Industry Forum
![Page 48: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/48.jpg)
24 June ’03 47
History
First Meetings 1999What do we need to do to get MPEG-4 adopted?
Officially Established June 2000Not-for-Profit Organization in Switzerland
Now approximately 100 membersWorldwideAcross Industries – IT, Telecoms, CE, Academia, content and service providers
![Page 49: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/49.jpg)
24 June ’03 48
AMD, Agfa Monotype, AOL Time Warner, Apple Computer, Canon, Cisco, DivXNetworks, Dolby, Envivio, Fraunhofer, Fujitsu, Fuji-Xerox PAL, Harmonic, Hitachi, IBM, Intel, InterTrust, iVAST, Matsushita, Microsoft, Mitsubishi, Motorola/GI, MPEG LA, NEC, NTT, Nokia, Oki, PacketVideo, Philips, RealNetworks, Scientific-Atlanta, Siemens, Sony, STMicroelectronics, Sun, TandbergTV, TDK, Tektronix, Thomson, Toshiba, Xilinx and many others (~100 members)
Membership includes
![Page 50: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/50.jpg)
24 June ’03 49
Goal
Getting MPEG-4 widely adoptedDoing the things that MPEG does not and can not address
Bootstrapping licensingProduct interoperabilityCompliance ProgramEducation, Information ClearinghouseMarketing, Exhibitions
![Page 51: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/51.jpg)
24 June ’03 50
Membership
3,000 US$ per year for full membershipAccess to meetings, documents, Interop ProgramSpeaking opportunities and co-exhibiting with M4IF
300 US$ for associate membershipSame rights, except voting rights
![Page 52: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/52.jpg)
24 June ’03 51
Licensing – the Responsibilities
MPEG StandardizesAnd collects Patent StatementsBut as a rule does not discuss licensing terms
M4IF initiates, discusses, encourages, suggests, catalyzes, bootstraps
But never licenses, determines, decides, …And does not recommend specific licensing terms(although it may suggest alternative approaches)
Licensors determine, decide, sell licensesIn discussions with the marketUsually in patent pools (joint licensing schemes)
![Page 53: MPEG-4 Demystified file24 June ’03 0 MPEG-4 Demystified Apple Worldwide Developers Conference 24 June 2003 Rob Koenen President, MPEG-4 Industry Forum Chairman, MPEG Requirements](https://reader030.fdocuments.in/reader030/viewer/2022041220/5e097208e3658f3894113ea0/html5/thumbnails/53.jpg)
24 June ’03 52
Thank you
Further information:www.m4if.org (website M4IF)
mpeg.tilab.com (website MPEG)www.apple.com/mpeg4 (Apple’s MPEG-4 Pages)