Post on 24-Jun-2018
INTERNATIONAL ORGANISATION FOR STANDARDISATIONORGANISATION INTERNATIONALE DE NORMALISATION
ISO/IEC JTC 1/SC 29/WG 11CODING OF MOVING PICTURES AND AUDIO
ISO/IEC JTC 1/SC 29/WG 11 N6484Redmond, WA – July 2004
Source Leonardo Chiariglione, Convenor
Title Report of the 68th meetingStatus
Report of the 69th meeting1 Opening The 68th WG11 meeting was held at the Technical University of Munich on 2004/03/15-19 at the kind invitation of the German National Body (DIN).
2 Roll call of participants Annex 1 gives the attendance list.
3 Approval of agenda Annex 2 gives the agenda approved.
4 Allocation of contributionsAnnex 3 gives the list of input contributions
5 Communications from Convenor
6 Report of previous meetingThis was approved.
7 Processing of NB Position PapersNational Body papers were considered and answers provided where appropriate.
8 Work plan
8.1 Media coding
8.1.1 MPEG-2 AAC BW Extensions conformanceThe following documents were approved
6617 DoC on ISO/IEC13818-4:200X/FPDAM2 Audio Conformance Ext.
6618 ISO/IEC13818-4:2004/FDAM2 Audio Conformance Ext.
1
8.1.2 Parametric Audio CodingThe following document was approved
6675 Formal Verification Report on MPEG-4 Parametric Audio Coding
8.1.3 Advanced Video CodingThe following document was approved
6540 Text of ISO/IEC 14496-10 Advanced Video Coding 3rd Edition
8.1.4 AVC ConformanceThe following documents were approved
6532 DoC on ISO/IEC 14496-4/FPDAM6 AVC Conformance
6533 ISO/IEC 14496-4/FDAM6 AVC Conformance
8.1.5 AVC Fidelity Range Extensions
8.1.6 AVC Fidelity Range Extensions ConformanceThe following document was approved
6534 ISO/IEC 14496-4/PDAM9 AVC FRExt Conformance
8.1.7 New levels in MPEG-4 Simple profileThe following documents were approved
6495 Request for ISO/IEC 14496-2:2004 AMD26496 Text of ISO/IEC 14496-2:2004/PDAM 2 (New Levels in Simple
Profile)
8.1.8 New levels in MPEG-4 Simple profile conformanceThe following document was approved
N6497 Request for ISO/IEC 14496-4:2004 Amd.10N6498 Text of ISO/IEC 14496-4:2004 PDAM10 Conformance Extensions for New Levels of
Visual Simple Profile
8.1.9 AFX Conformance
8.1.10 AFX ExtensionsThe following document was approved
6544 ISO/IEC 14496-16/PDAM1
2
8.1.11 Audio Lossless CodingThe following documents were approved
6672 Text of 14496-3:2001/PDAM 4, Audio Lossless Coding (ALS)
6680 Workplan for Audio Lossless Coding (ALS)
8.1.12 Audio Scalable Lossless CodingThe following documents were approved
6673 Text of 14496-3:2001/PDAM 5, Scalable Lossless Coding (SLS)
6681 Workplan for Scalable Lossless Coding (SLS)
8.1.13 1-bit Audio Lossless Coding The following document was approved
6674 Text of 14496-3:2001/FPDAM 6, Lossless coding of 1-bit oversampled signals
8.1.14 HE-AAC ConformanceThe following documents were approved
6622 DoC on ISO/IEC 14496-4/FPDAM8 HE-AAC, ABIFS and SA Conformance
6623 ISO/IEC 14496-4/FDAM8 HE-AAC, ABIFS and SA Conformance
8.1.15 SA ConformanceThe following documents were approved
6622 DoC on ISO/IEC 14496-4/FPDAM8 HE-AAC, ABIFS and SA Conformance
6623 ISO/IEC 14496-4/FDAM8 HE-AAC, ABIFS and SA Conformance
8.1.16 Scalable Video Coding
8.1.17 Streaming Text Format
8.1.18 Spatial Audio Coding
8.1.19 Video Coding Tool Repository
8.1.20 3D AV Coding
8.2 Composition coding
8.2.1 Audio BIFS ExtensionsThe following documents were approved
6590 DoC on ISO/IEC
3
14496-11/FPDAM36591 Text of ISO/IEC 14496-11/FDAM3
8.2.2 Audio BIFS ConformanceThe following documents were approved
6622 DoC on ISO/IEC 14496-4/FPDAM8 HE-AAC, ABIFS and SA Conformance
6623 ISO/IEC 14496-4/FDAM8 HE-AAC, ABIFS and SA Conformance
8.2.3 XMT extensionsThe following documents were approved
6592 DoC on ISO/IEC 14496-11/PDAM46593 Text of ISO/IEC
14496-11/FPDAM4
8.2.4 Lightweight Scene RepresentationThe following documents were approved
6499 Request of ISO/IEC 14496-206500 Text of ISO/IEC
14496-20/CD
8.2.5 Symbolic Music RepresentationThe following document was approved
6689 Call for Proposals for Symbolic Music Representation
8.3 Description coding
8.3.1 Efficient representation of descriptions
8.3.2 Video DescriptorsThe following document was approved
N6516 WD 2.0 of MPEG-7 New Visual Extensions
8.3.3 Audio Descriptors
8.3.4 MDS user preference extensionsThe following documents were approved
6633 DoC on ISO/IEC 15938-5 FPDAM/2
6634 ISO/IEC 15938-5 FDAM/2 “MDS User Preference Extensions”
4
8.3.5 MPEG-7 Conformance ExtensionsThe following documents were approved
6637 DoC on ISO/IEC 15938-7 FPDAM/1
6638 ISO/IEC 15938-7 FDAM/1
8.3.6 MPEG-7 Profiles
8.3.7 Schema definitionThe following documents were approved
6639 DoC on ISO/IEC 15938-10 FCD
6640 ISO/IEC 15938-10 FDIS “Schema Definition”
8.3.8 Extraction and use of MPEG-7 descriptions extensions
8.4 Systems support
8.4.1 Carriage of ISAN and V-ISAN metadata
8.4.2 New audio profile and level signaling
8.4.3 Text profile descriptorThe following documents were approved
6588 Request of ISO/IEC 14496-1:2004 Amd.1
6589 Text of ISO/IEC 14496-1:2004/PDAM1
8.4.4 MPEG-1 Audio access unitsThe following documents were approved
6670 DoC on 14496-3:2001/FPDAM 3, MPEG-1/2 Audio in MPEG-4
6671 Text of 14496-3:2001/FDAM 3, MPEG-1/2 Audio in MPEG-4
8.4.5 Streaming of MPEG-7 descriptions
8.4.6 Timestamps and Audio Codec BehaviorThe following document was approved
6682 Timestamps and Audio Codec Behavior
8.5 IPMP
8.5.1 MPEG-2 IPMP-X Conformance The following documents were approved
5
6624 DoC on ISO/IEC13818-4/FPDAM1 IPMP Conformance Ext.
6616 ISO/IEC13818-4/FDAM1 IPMP Conformance Ext.
8.5.2 MPEG-4 IPMP-X Conformance
8.5.3 Evaluation Tools for Persistent Association
8.5.4 MPEG-21 IPMP FrameworkThe following document was approved
6644 ISO/IEC 21000-4 WD v.1 “IPMP”
8.6 Digital Item
8.6.1 Digital Item DeclarationThe following documents were approved
6641 DoC on 21000-2 CD 2nd Edition – Digital Item Declaration
6642 ISO/IEC 21000-2 DID 2nd Edition FCD
8.6.2 Digital Item BinarisationThe following document was approved
6613 Text of ISO/IEC 21000-16/CD
8.6.3 DIA Conversions and PermissionThe following document was approved
6647 MPEG-21 DIA PDAM/1 “Conversions and Permissions”
8.6.4 Event ReportingThe following document was approved
6656 ISO/IEC 21000-15 WD v.2 “Event Reporting”
8.6.5 MPEG-21 Conformance
8.6.6 Vision, technologies and strategy
8.7 Transport and File Format
8.7.1 MPEG-2 SystemsThe following documents were approved:
6
6583 Study Text of ISO/IEC 13818-1:2000/FPDAM4
6584 DoC on ISO/IEC 13818-1:2000/FPDAM56585 Text of ISO/IEC 13818-1:2000/FDAM5
8.7.2 ISO File Format extensionsThe following documents were approved:
6595 Study Text of DoC on ISO/IEC 14496-12/FPDAM1
6596 Study Text of ISO/IEC 14496-12/FPDAM1
8.7.3 MPEG-21 File FormatThe following documents were approved:
6610 DoC on ISO/IEC 21000-9/CD6611 Text of ISO/IEC
21000-9/FCD
8.8 Multimedia architecture
8.8.1 MPEG-J extension for scene control
8.8.2 MPEG-J extension for renderingThe following document was approved
6549 ISO/IEC 14496-21 WD 1.0
8.8.3 Digital Item ProcessingThe following documents were approved
6653 Draft DoC on ISO/IEC 21000-10 CD
6654 Study on ISO/IEC 21000-10 CD “Digital Item Processing”
8.8.4 MPEG Multimedia Middleware
8.9 Reference implementation
8.9.1 AVC Reference SoftwareThe following documents were approved
6535 DoC on ISO/IEC 14496-5/FPDAM6 AVC and HE-AAC reference software
6536 ISO/IEC 14496-5/FDAM6 AVC and HE-AAC reference software
8.9.2 HE-AAC Reference SoftwareThe following documents were approved
7
6535 DoC on ISO/IEC 14496-5/FPDAM6 AVC and HE-AAC reference software
6536 ISO/IEC 14496-5/FDAM6 AVC and HE-AAC reference software
8.9.3 MPEG-2 IPMP Reference SoftwareThe following documents were approved
6619 DoC on ISO/IEC 13818-5/DAM2 IPMP Reference Software Ext.
6620 ISO/IEC 13818-5/AMD2 IPMP Reference Software Ext
8.9.4 AFX Reference SoftwareThe following documents were approved
6625 DoC on ISO/IEC 14496-5/FPDAM7 AFX reference software
6626 ISO/IEC 14496-5/FDAM7 AFX reference software
8.9.5 AVC Fidelity Range Extensions Reference SoftwareThe following document was approved
6537 ISO/IEC 14496-5/PDAM8 AVC FRExt reference software
8.9.6 MPEG-4 Visual Reference Hardware Description
8.9.7 MPEG-4 AVC Reference Hardware DescriptionThe following documents were approved
6506 Updated Call for the Submission of Hardware Reference Code for MPEG-4 Part 9: Reference Hardware Description
6509 Status of HDL submissions and commitments for MPEG-4 Part-9
8.9.8 MPEG-7 Reference Software ExtensionsThe following documents were approved
6512 DoC of ISO/IEC 15938-6/FPDAM1 Information Technology -Multimedia Content Description Interface- part 6: Reference Software Extensions
6511 ISO/IEC 15938-6/FDAM1 Information Technology -Multimedia Content Description Interface- part 6: Reference Software Extensions
8.9.9 MPEG-21 Reference SoftwareThe following documents were approved
6627 DoC on ISO/IEC 21000-8/CD MPEG-21 reference software
6628 ISO/IEC 21000-8/FCD MPEG-21 reference software
8
8.9.10 Test Bed for MPEG-21 Resource DeliveryThe following documents were approved
6629 DoC on ISO/IEC 21000-12/PDTR Test Bed for MPEG-21 Resource Delivery
6630 ISO/IEC 21000-12/DTR Test Bed for MPEG-21 Resource Delivery
8.10 Application formats
8.10.1 Music player Application Format The following documents were approved
6687 DoC on 23001-1:200X CD, “Player Application Format”
6688 Text of 23001-1:200X FCD, “Player Application Format”
8.10.2 Photo album Application Format
8.11 Maintenance
8.11.1 Systems standardsThe following documents were approved
6582 Text of ISO/IEC 13818-1:2000/DCOR3
6586 DoC on ISO/IEC 14496-1/DCOR36587 Text of ISO/IEC 14496-1/COR36594 Text of ISO/IEC 14496-11/COR2
8.11.2 Video coding standardsThe following document was approved
N6514 MPEG-4 Visual: List of Problems Reported version 13.0
8.11.3 Audio coding standardsThe following documents were approved
6621 ISO/IEC 13818-5 :1997/Amd1:1999/COR2
6669 Text of 13818-7:2004/DCOR 1 “AAC ADTS buffer fullness correction”
6677 Proposed 3rd Edition of 14496-3
8.11.4 Synthetic coding standardsThe following document was approved
6545 ISO/IEC 14496-16/DCOR1
9
8.11.5 Visual description coding standards
8.11.6 Audio description coding standards
8.11.7 MDS standardsThe following documents were approved
6635 DoC on ISO/IEC 15938-5 DCOR/1
6636 ISO/IEC 15938-5 COR/1
8.11.8 IPMPThe following document was approved
6646 ISO/IEC 21000-6 DCOR/1
8.11.9 Digital ItemThe following document was approved
6648 ISO/IEC 21000-7 COR/1 WD v.1
9 Liaison matters
10 Organisation of this meeting
10.1 Tasks for subgroupsTasks were assigned to achieve the goals of the work plan.
10.2 Joint meetings The following joint meetings were held
Groups What Where Day TimeReq, JVT Profiles, DCinema, etc. JVT Mon 15:30-
16:30Req, MDS, Sys MPEG-21 IPMP Req Mon 17:00-
18:00HOD Lassen Mon 18:00-
19:00Req, Vid MPEG-4 Video Profiles,
SVCVid Tue 09:00-
11:00Req, Sys, Aud, Vid, MDS
MAF Req Tue 11:00-11:30
Vid, Tst SVC Experts viewing Vid Tue 11:00-12:00
DMP Lassen Tue 13:00-14:00
Req, Sys OpenType, M3W Req Tue 14:00-15:00
Req, MDS, Sys DID, binarisation Req Req Tue 15:00-16:30
10
Sys, Snh Laser, MPEG-j, XMT Sys Tue 17:00-18:00
Req, Aud Scalable Audio in MPEG-21 Aud Tue 11:30-12:00
Req, Sys, Aud, Vid, MDS
MP7 Profiles Req Wed 11:30-13:00
Req, Int, MDS MP21 integration & implem. Req Wed 14:00-15:00
Req, Sys M3W Req Wed 14:00-14:30
MDS, Int MP21 conform. MDS Wed 15:00-16:00
Vid, JPG Scalable Video Coding Vid Wed 15:00-16:00
Aud, Sys Audio codec behaviour Aud Wed 16:00-17:00
Sys, SNHC Laser Snh Wed 16:00-15:00
Vid, VCEG Scalable Video Coding Vid Wed 16:00-17:00
Req, MDS MP21 IPMP Req Wed 16:30-17:00
Vid, ISG VCTR Vid Wed 11:30-12:30
MDS, Sys MP21 FF Sys Thu 09:00-10:00
Req, Vide PAT, 3DAV, SVC Vid Thu 09:30-11:00
Sys, JPG ISO File Format ext Sys Thu 10:00-11:00
MDS, Int MP21 RSW MDS Thu 11:00-12:00
Req, Aud SMR reqs Req Thu 14:00-14:30
10.3 Administrative matters
10.3.1 Schedule of future MPEG meetings The following meeting schedule was approved
Meeting City Country
Yr.
Mo. Days
69th Redmond, WA US 04 07 19-23
70th Palma de Mallorca
ES 04 10 18-22
71st Hong Kong CN 05 01 17-21
72nd Busan KR 05 04 18-
11
2273rd Poznań PL 05 07 25-
2974th ? FR 05 10 17-
2175th ? ? 06 01 23-
27
10.3.2 Promotional activities An ad hoc group with this mandate was re-ablished.
11 Planning of future activities The following ad hoc groups were established
6528 AHG on 3DAV Coding6662 AHG on AFX documents, CEs, and software6664 AHG on Audio Standard Maintenance6526 AHG on Core Experiments in Scalable Video Coding6525 AHG on Description Tools for New Visual Extensions6668 AHG On Exploration of Scalable Audio and Speech Coding6502 AHG on Font Format Representation6531 AHG on M3W6504 AHG on MAF6523 AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and
Conformance6524 AHG on Maintenance of MPEG-7 Visual related Documents and Reference Software6657 AHG on Media Locators6632 AHG on MPEG 1016659 AHG on MPEG-21 DIA6660 AHG on MPEG-21 DIP6661 AHG on MPEG-21 Event Reporting6503 AHG on MPEG-21 Integration and Outreach6658 AHG on MPEG-21 IPMP6666 AHG on MPEG-4 Lossless Audio Coding6510 AHG on MPEG-4 Part 9: Reference Hardware Description Phase 1 and 2.6696 AHG on MPEG-7 Audio6692 AHG on MPEG-7 Interoperability and Profiling6663 AHG on MPEG-J extensions for rendering6527 AHG on Scalable Video Model and SVC Reference Software6615 AHG on Scene Representation6665 AHG on Spatial Audio Coding6667 AHG on Symbolic Music Representation6631 AHG on the Communicating MPEG to the business Community6529 AHG on Video Coding Tools Repository6614 AHG on XML Structure Binarization and Streaming
12 Resolutions of this meetingThese were approved (N6482)
12
13 A.O.B There was no other business
14 Closing The meeting closed at 2004/07/24T21:20.
13
Annex 1Attendance list
First Name Last Name Company CountryMyriam Amielh CISRA AustraliaGerrard Drury TITR / enikos AustraliaShane Lauf University of Wollongong/Enikos AustraliaAxel Becker CISRA AustraliaRobert Prandolini Defence Science & Technology Org AustraliaDavid Taubman The University of New South Wales AustraliaIan Burnett University of Wollongong/Enikos AustraliaChristian Timmerer University Klagenfurt AustriaJoeri Barbarien Vrije Universiteit Brussel BelgiumJan Bormans IMEC BelgiumFrederik De Keukelaere Ghent University BelgiumAlexandru Salomie Vrije Universiteit Brussel BelgiumPeter Schelkens Vrije Universiteit Brussel BelgiumRik Van de Walle Ghent University BelgiumAntonin Descampe Université Catholique de Louvain BelgiumSpencer Cheng Morphbius Technology CanadaJeremie Farret SGDL Systems Inc CanadaAlain Mignot SolideSpace CanadaDemin Wang Communications Research Centre CanadaPatrick Rault FastVDO CanadaLowell Winger LSI CanadaFeng Wu Microsoft ChinaJizheng Xu Microsoft Research Asia ChinaShiqiang Yang Tsinghua University ChinaChengwei Gao Anyka Cayman Corporation ChinaWang Baoai China Electronics Standardization Institute ChinaHsin-Hao Chen OES/ITRI ChinaHsueh-Ming Hang National Chiao Tung University ChinaTihao Chiang NCTU/MITSUBISHI ChinaChun-Jen Tsai National Chiao Tung University ChinaYi-Shin Tung National Taiwan University ChinaChung-Neng Wang National Chiao Tung University ChinaJan Achrenius Hybrid Graphics, Ltd. FinlandPetri Kero Hybrid Graphics, Ltd. FinlandMauri Vaananen Nokia FinlandHenrik Karppinen Nokia, Inc. FinlandMichel Allain SACEM FranceOlivier Avaro France Telecom R&D FranceAbdellatif Benjelloun Touimi France Telecom R&D FranceRenaud Cazoulat France Telecom R&D FranceCyril Concolato ENST FranceAlexandre Cotarmanac'h France Telecom FranceJean-Claude Dufourd ENST FranceMelanie Dulong de Rosnay Medialive FranceFrancois Edouard Thomson R&D FrancePatrick Gioia France Telecom R&D FranceMarc Guez Vucher SCPP FranceMariam Kimiaeiasadi ENST FranceFrederic Loras France Telecom FranceFX NUTTALL CISAC FranceMarius Preda Int FranceClaude Seyrat EXPWAY FranceJerome Vieron Thomson FranceDavid Virette France Telecom France
14
Jérôme Caporossi Medialive FranceVania Conan Thales FranceChristine Guillemot INRIA FranceFabrice Le Leannec Canon Research Centre France SAS FranceDidier Nicholson Thales FranceStéphane Pateux France Telecom R&D FranceStephane Valente Philips Digital Systems Labs - Paris FranceFrancoise Preteux Institute National de Telecommunication FrancePeter Amon Siemens AG GermanyOliver Baum Fraunhofer IIS GermanyJohannes Boehm Thomson GermanyMartin Dietz Coding Technologies GermanyIvan Dimkovic Ahead Software GermanyBernhard Feiten Deutsche Telekom T-Systems GermanyHarald Fuchs Fraunhofer IIS GermanyRalf Geiger Fraunhofer IDMT GermanyBernhard Grill Fraunhofer IIS GermanyMatthias Gruhne Fraunhofer IDMT GermanyJuergen Herre Fraunhofer IIS GermanyJoerg Heuer Siemens AG GermanyTilman Liebchen Technical University of Berlin GermanyJoern Ostermann Universität Hannover - Institut für Theoretische N GermanyThomas Rusert Aachen University GermanyJuergen Schmidt Thomson GermanyAndreas Schneider Coding Technologies GermanyAljoscha Smolic Fraunhofer HHI GermanyRalph Sperschneider Fraunhofer IIS GermanyMathias Wien Aachen University GermanyIngo Wolf T-Systems Germany GermanySiegfried Foessel Fraunhofer IIS GermanyGero Bäse Siemens AG GermanyUlrich Benzler Robert Bosch GmbH GermanyUlrich Fecker University of Erlangen-Nuremberg GermanyCarsten Herpel Thomson GermanyPeter List Deutsche Telekom T-Systems GermanyDetlev Marpe Fraunhofer HHI GermanyTobias Oelbaum Munich University of Technology GermanyJens-Rainer Ohm RWTH Aachen GermanyHeiko Schwarz Fraunhofer HHI GermanyHerbert Thoma Fraunhofer IIS GermanyThomas Wedi Panasonic European Laboratories GermanyThomas Wiegand Fraunhofer HHI GermanyAharon Gill Zoran Microelectronics, Ltd. IsraelZvi Lifshitz Optibase, Ltd. IsraelMarco Tagliasacchi Politechnico di Milano ItalyRiccardo Leonardi University of Brescia ItalyPaolo Nesi DSI-DISIT- University of Florence -
MUSICNETWORKItaly
Stefano Tubaro Politecnico di Milano ItalyGiovanni Cordara Telecom Italia LAB ItalyRoberto Flaiani Aethra ItalyLeonardo Chiariglione CEDEO ItalyTakashi Nishi Oki Electric Industry Company, Ltd. JapanKohtaro Asai Mitsubishi Electric Corporation JapanYukihiro Bandou NTT JapanToshiaki Fujii Nagoya University JapanKazuhiro Iida Panasonic JapanSatoshi Ito Toshiba JapanYutaka Kamamoto NTT Japan
15
Takahiro Kimoto NEC JapanMasaki Kitahara NTT JapanTakuyo Kogure Matsushita Electric JapanTakehiro Moriya NTT JapanTokumichi Murakami Mitsubishi Electric Corporation JapanHirofumi Nishikawa Mitsubishi Electric Corporation JapanToshiyuki Nomura NEC JapanTakeshi Norimatsu Matsushita Electric JapanMasanori Sano NHK JapanCraig Schultz Multimedia-Architectures JapanTakanori Senoh Matsushita JapanYoshinori Sugihara JEITA JapanSeishi Takamura NTT JapanNaoya Tanaka Panasonic JapanMasayuki Tanimoto Nagoya University JapanTakafumi Ueno Matsushita Electric JapanAkio Yamada NEC JapanHiroshi Yasuda The University of Tokyo JapanJunichi Hara RICOH JapanAkio Matsubara RICOH JapanNaoki Kobayashi Nippon Telegraph Telephone East Corporation JapanYukiko Ogura IPSJ/ITSCJ JapanTakeshi Chujoh Toshiba JapanHideaki Kimata NTT JapanMasaaki Kobayashi Oki Electric Industry Company, Ltd. JapanTomokazu Murakami Hitachi, Ltd. JapanSatoru Sakazume Victor Company of Japan, Ltd. JapanTeruhiko Suzuki Sony JapanToshiya Takahashi Panasonic JapanHideki Takehara Victor Company of Japan, Ltd. JapanThiow Keng Tan NTT DoCoMo, Inc. JapanYoshihisa Yamada Mitsubishi Electric Corporation JapanMasao Aizu Canon, Inc. JapanItaru Kaneko Tokyo Polytechnic University JapanHiroshi Watanabe Waseda University JapanChung-Hyun Ahn ETRI KoreaKyung-Ae Cha Information and Communications University KoreaSangchang Cha Samsung Electronics KoreaJong-Jin Chae net&tv Inc. KoreaYongju Cho ETRI KoreaIk-Hwan Cho In-ha University KoreaWoo-Jin Han Samsung Electronics KoreaMahnjin Han Samsung AIT KoreaHendry Hendry Information and Communications University KoreaKang Hogab Hersasu KoreaGyeong Ja Jang Samsung AIT KoreaEuee Seon Jang Hanyang University KoreaYe Sun Joung ETRI KoreaSang-Kyun Kim Samsung AIT KoreaHae Kwang Kim Sejong University KoreaKiseob Kim Kangwon National University KoreaHyoungJoong Kim Kangwon National University KoreaWook-Joong Kim ETRI KoreaRinchul Kim University of Seoul KoreaSangwook Kim Samsung AIT KoreaMunchurl Kim Information and Communications University KoreaKyuheon Kim ETRI KoreaHyun Mun Kim Samsung AIT KoreaWonha Kim Kyung Hee University Korea
16
JungHoe Kim Samsung AIT KoreaJaejoon Kim Daegu University KoreaJoohee Kim Samsung AIT KoreaSeok-Hoon Kim Korea Digital Content Forum KoreaHye Yun Kim Samsung-AIT KoreaDaijin Kim Postech KoreaJong-Tae Kim KAIST KoreaSun Young Lee Hanyang University KoreaJong won Lee Samsung KoreaJeho Nam ETRI KoreaEunmi Oh Samsung AIT KoreaWeon Geun Oh ETRI KoreaKeunsoo Park Korean Broadcasting System KoreaSoo Jun Park ETRI KoreaSeungho Park Kyung Hee University KoreaJeongil Seo ETRI KoreaYoungjoo Song ETRI KoreaHyung Sik Suh KwareSoft Inc. KoreaWon-Young Yoo ETRI KoreaKisong Yoon ETRI KoreaChee Sun Won Dongguk University KoreaDong-Seok Jeong INHA University KoreaJeon ByeongMoon LG Electronics Inc. KoreaWoong Il Choi Sungkyunkwan University KoreaYo-sung Ho GIST KoreaManbae Kim Kangwon National University KoreaHaksoo Kim Kangwon National University KoreaYong Han Kim University of Seoul KoreaYung-Lyul Lee Sejong University KoreaYoung-Kwon Lim net&tv, Inc. KoreaJi-Ho Park LG Electronics Inc. KoreaSang Yong Seo Korea Telecom KoreaJean H.A. Gelissen Philips Research NLWerner Oomen Philips PDSL-E NLAndrew Tokmakoff Telematica Instituut NLFons Bruls Philips NLJan van der Meer Philips NLGisle Bjontegaard Tandberg NorwayArild Fuldseth Tandberg NorwayEyvind Fossbakk Norwegian Broadcasting Corporation NorwayWladyslaw Skarbek Warsaw University of Technology PolandMarek Domanski Poznań University of Technology PolandFernando Pereira Instituto Superior Técnico PortugalKok Seng Chong Panasonic Singapore Laboratories SingaporeNeo Sua Hong Panasonic Singapore Laboratories SingaporeZhongyang Huang Panasonic Singapore Laboratories SingaporeMing Ji Panasonic Singapore Laboratories SingaporeMen Huang Lee Panasonic Singapore Laboratories SingaporeXiao Lin Institute for Infocomm Research SingaporeChin Phek Ong Panasonic Singapore Laboratories SingaporeSusanto Rahardja Institute for Infocomm Research SingaporeXiaokang Yang Institute for infocomm research SingaporeRongshan Yu Institute for Infocomm Research SingaporeVincent Diong Panasonic Singapore Laboratories SingaporeChakJoo Lee Panasonic Singapore Laboratories SingaporeJiunn Bin Lim Panasonic Singapore Laboratories SingaporeChong Soon Lim Panasonic Singapore Laboratories SingaporeJaime Delgado Universitat Pompeu Fabra SpainMarc Gauvin sDae Spain
17
Thomas Kummer-Hardt AIO SpainEva Rodriguez Universitat Pompeu Fabra SpainPaulo Villegas Telefonica I+D SpainKristofer Kjorling Coding Technologies SwedenHeiko Purnhagen Coding Technologies SwedenPer Fröjdh Ericsson SwedenMarco Mattavelli EPFL SwitzerlandJulien Reichel VisioWave SwitzerlandStephan Wuermlin ETH Zurich SwitzerlandFrancesco Ziliani VisioWave SwitzerlandGiorgio Zoia EPFL SwitzerlandTouradj Ebrahimi EPFL SwitzerlandChris Barlas Rightscom, Ltd. UKMiroslaw Bober Mitsubishi Electric ITE-VIL UKLeszek Cieplinski Mitsubishi Electric ITE-VIL UKNiels Rump Rightscom, Ltd. UKMartin Russ British Telecommunications plc UKRay Taylor NDS Limited UKSimon Watt Universal Music International UKSteve Appleby BT UKPing Wu Tandberg Television UKCatherine Grant Nine Tiles UKPaul Jessop IFPI UKThomas DeMartini ContentGuard, Inc. USWenlong Dong Microsoft Corporation USMichael Good Recordare llc USIgor Komir Analog Devices, Inc. USJose' Roberto Alvarez Mobilygen Corporation USHye-Yeon Cheong Columbia University USChad Fogg Pixonics USNeelesh Gokhale RealNetworks USMingning Gu QPixel Technology USMichael Horowitz CoVi Technologies USKarl Lillevold RealNetworks USDaniel Miner DirecTV USSteve Purcell Enmedia USRob Robinett Modulus Video USEric Viscito eV Consulting USHitoshi Watanabe QPixel Technology USHsi-Jung Wu Apple Computer, Inc. USDengzhi Zhang QPixel Technology USSheng Zhong Broadcom USJeroen Bekaert Ghent University / Los Alamos National Laboratory USBruce Block RIAA USJonathan Boley University of Miami USMarina Bosi MPEG LA LLC USMikael Bourges-Sevenier Mindego, Inc. USGeorge Chen STMicroelectronics USKatie Cornog Avid Technology USSachin Deshpande Sharp Laboratories of America USMatt Fellers Dolby Laboratories USChuck Fenimore NIST USBradford Gandee ContentGuard, Inc. USMarco Hurtado IBM USJames D. (jj) Johnston Microsoft Corporation USMukta Kar Cable Television Laboratories USRob Koenen InterTrust USMike Ksar Microsoft Corporation USKhosrow Lashkari DoCoMo USA Labs US
18
Vladimir Levantovsky Agfa Monotype Corporation USDebargha Mukherjee Hewlett-Packard USMartha Nalebuff Microsoft Corporation USFlorian Pestoni Microsoft Corporation USHanspeter Pfister Merl USSchuyler Quackenbush Audio Research Laboratories USMajid Rabbani Eastman Kodak USChris Russell MPAA USOfer Shapiro Quix USJohn Smith IBM T. J. Watson Research Center USAli Tabatabai Sony USMihaela Vander Schaar Uc Davis / Philips USAnthony Vetro Mitsubishi Electric USMark Vinton Dolby Laboratories USXin Wang ContentGuard, Inc. USS. Merrill Weiss Merrill Weiss Group LLC USThomas White MIDI Mfrs Assoc USDai Yang VidiatorTechnology (us) Inc. USWendy Aylsworth Warner Brothers USAli Bilgin University of Arizona USWo Chang NIST USWalter Husak Dolby USMichael Marcellin University of Arizona USSusie Wee Hewlett-Packard USLian Zhu Crowley-Davis Research USJohn Apostolopoulos Hewlett-Packard USMarta Karczewicz Nokia Research Center USTaek Kim Hewlett-Packard USDavid Lindbergh Polycom, Inc. USPankaj Topiwala FastVDO USAlexandros Tourapis Thomson - Corporate Research USMike Rubinfeld NIST USYiliang Bao Nokia, Inc. USFrank Bossen DoCoMo USA Labs USPeisong Chen Qualcomm, Inc. USSherman Chen Broadcom USCraig Demel CoWare Inc. USFelix Fernandes Texas Instruments USHarinath Garudadri Qualcomm, Inc. USWalter Gish Dolby Laboratories USStephen Gordon Broadcom USMunsi Haque Intel Corporation USBarry Haskell Apple Computer, Inc. USCaspar Horne Self-employed USLouis Kerofsky Sharp Laboratories of America USShawmin Lei Sharp Laboratories of America USMichael Lightstone Nvidia USJiuhuai Lu Panasonic USAjay Luthra Motorola USTom McMahon Dolby Laboratories USRaghavendra Nagaraj Vidiator Technoogly us inc USMandayam Narasimhan Motorola USAtul Puri RealNetworks USWei Qi Vweb Corporation USViji Raveendran Qualcomm, Inc. USYuriy Reznik RealNetworks USJustin Ridge Nokia, Inc. USPhoom Sagetong Qualcomm, Inc. USDavid Singer Apple Computer, Inc. US
19
Huifang Sun Mitsubishi Electric Research Laboratories USShijun Sun Sharp Laboratories of America USKumar Swaminathan Hughes Network Systems USVishwanathan Swaminathan Sun USYasser Syed Cable Television Laboratories USPeter Symes SMPTE USRobert Turney Xilinx Research Laboratories USFeng Chi Wang Conexant Systems, Inc. USGary Sullivan Microsoft Corporation USPeter Schirling IBM Research USAndy Tescher Microsoft Corporation US
20
Annex 2Agenda
Agenda item1. Opening2. Roll call of participants3. Approval of agenda 4. Allocation of contributions 5. Communications from Convenor 6. Report of previous meeting 7. Processing of NB Position Papers 8. Work plan 1. 8.1 Media coding 1.1. MPEG-2 AAC BW Extensions conformance 1.2. AVC Conformance 1.3. AVC Fidelity Range Extensions 1.4. AVC Fidelity Range Extensions Conformance 1.5. AFX Conformance 1.6. AFX Extensions 1.7. Audio Lossless Coding 1.8. Audio Scalable Lossless Coding 1.9. 1-bit Audio Lossless Coding 1.10
. HE-AAC Conformance
1.11.
SA Conformance
1.12.
Scalable Video Coding
1.13.
Streaming Text Format
1.14.
Spatial Audio Coding
1.15.
Video Coding Tool Repository
1.16.
3D AV Coding
8.2 Composition coding 2.1. Audio BIFS Extensions 2.2. Audio BIFS Conformance 2.3. XMT extensions 2.4. Lightweight Scene Representation 2.5. Symbolic Music Representation 8.3 Description coding 3.1. Efficient representation of descriptions 3.2. Video Descriptors 3.3. Audio Descriptors 3.4. MDS user preference extensions 3.5. MPEG-7 Conformance Extensions 3.6. MPEG-7 Profiles
21
3.7. Schema definition 3.8. Extraction and use of MPEG-7 descriptions
extensions 8.4 Systems support 4.1. Carriage of ISAN and V-ISAN metadata 4.2. New audio profile and level signaling 4.3. MPEG-1 Audio access units 4.4. Streaming of MPEG-7 descriptions 4.5. Timestamps and Audio Codec Behavior 8.5 IPMP 5.1. MPEG-2 IPMP-X Conformance 5.2. MPEG-4 IPMP-X Conformance 5.3. Evaluation Tools for Persistent Association 5.4. MPEG-21 IPMP Framework 8.6 Digital Item 6.1. Digital Item Declaration 6.2. Digital Item Binarisation 6.3. DIA Conversions and Permission 6.4. Event Reporting 6.5. MPEG-21 Conformance 6.6. Vision, technologies and strategy 8.7 Transport and File Format 7.1. ISO File Format extensions 7.2. MPEG-21 File Format 8.8 Multimedia architecture 8.1. MPEG-J extension for scene control 8.2. MPEG-J extension for rendering 8.2. Digital Item Processing 8.3. MPEG Multimedia Middleware 8.9 Reference implementation 9.1. AVC Reference Software 9.2. HE-AAC Reference Software 9.3. AFX Reference Software 9.4. AVC Fidelity Range Extensions Reference Software 9.5. MPEG-4 Visual Reference Hardware Description 9.6. MPEG-4 AVC Reference Hardware Description 9.7. MPEG-7 Reference Software Extensions 9.8. MPEG-21 Reference Software 9.9. Test Bed for MPEG-21 Resource Delivery 8.1
0 Application formats
10.1.
Music player Application Format
10.2.
Photo album Application Format
8.11
Maintenance
11.1 Video coding standards 11.2 Audio coding standards
22
11.1 Visual description coding standards 11.2 Audio description coding standards 11.3 MDS standards 9. Liaison matters 10.
Organisation of this meeting
10.1
Tasks for subgroups
10.2
Joint meetings
11.
Administrative matters
11.1
Schedule of future MPEG meetings
11.2
Promotional activities
12.
Planning of future activities
13.
Resolutions of this meeting
14.
A.O.B
15.
Closing
23
Annex 3Input document list
No. Authors Title
10751 Wo Chang Document Register for SC29/WG11 Meeting Redmond, USA
10752 Robert TurneyMarco Mattavelli AHG on MPEG-4 Part 9 Reference Hardware Description Phase 1 and 2
10753Marius PredaMahnjin HanMikael Bourges-Svenier
AHG on AFX documents, CEs, and software
10754Mikael Bourges-SvenierVishy SwaminathanItaru Kaneko
AHG on MPEG-J extensions for rendering
10755T. ChiangYi-Shin TungChung-Neng Wang
AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance
10756
L. CieplinskiA. YamadaSang-Kyun KimStephan Herrmann
AHG on Maintenance of MPEG-7 Visual related Documents and Reference Software
10757 Miroslaw BoberSang-Kyun Kim AHG on Description Tools for New Visual Extensions
10758
Mihaela van der SchaarA. BeckerJ. RidgeC.J. Tsai
AHG on Core Experiments in Scalable Video Coding
10759 Aljoscha SmolicHideaki Kimata AHG on 3DAV Coding
10760 Euee S. JangKohtaro Asai AHG on Video Coding Tools Repository
10761 Simon Watt AHG to evaluate responses to the MPEG-21 IPMP CfP
10762 Wo ChangOlivier Avaro AHG on Multimedia Application Format (MAF)
10763Wo ChangAkio YamadaAlan Melby
AHG on MPEG-7 Profiles
10764 Gerrard DruryFrederik De Keukalaere AHG on Core Experiments for MPEG-21 DID 2nd Edition
10765Gerrard DruryFrederik De KeukaleareMunchurl Kim
AHG on Core Experiments for MPEG-21 DIP
10766 FX NuttallAndrew Tokmakoff AHG on MPEG-21 Event Reporting
10767 S. Quackenbush AHG on Spatial Audio Coding
10768 Tilman Liebchen AHG on MPEG-4 Lossless Audio Coding
10769 Paolo NesiGiorgio Zoia AHG on Symbolic Music Representation
24
10770Claude SeyratAndreas HutterItaru Kaneko
AHG on XML Structure Binarization and Streaming
10771Jean-Claude DufourdAlexandre Cotarmanac.hJuergen Schmidt
AHG on Scene Representation
10772
Jean GelissenOlivier AvaroIan BurnettYoung-Kwon Lim
AHG on MPEG Multimedia Middleware
10773 P. Schirling AHG on Communicating MPEG to the business Community
10774 Thomas DeMartini Requirement for MPEG-21 Binarization
10775 IEC TC 100 via SC 29 Secretariat
IEC CDV 60728-9/Amd.1: Cable networks for television signals, sound signals and interactive services -- Part 9: Interfaces for cabled distribution systems for digitally modulated signals, Amendment 1 [SC 29 N 5891]
10776 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 15938-4/FDAM 1 [SC 29 N 5892]
10777 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-1:2001/FDAM 3 [SC 29 N 5954]
10778 SC 37 via SC 29 Secretariat
ISO/IEC FCD 19794-6: Information technology -- Biometric data interchange formats -- Part 6: Iris image data [SC 29 N 5958]
10779 SC 37 via SC 29 Secretariat SC 37 NP on Vascular Biometric Image Interchange Format [SC 29 N 5959]
10780 SC 37 via SC 29 Secretariat
ISO/IEC FCD 19794-5: Information technology -- Biometric data interchange formats -- Part 5: Face image data [SC 29 N 5960]
10781 IEC TC 100 via SC 29 Secretariat
IEC CDV 62328-1: Multimedia home server systems -- Interchangeable volume/file structure adaptation for broadcasting receivers -- Part 1: General description and architecture [SC 29 N 5961]
10782 IEC TC 100 via SC 29 Secretariat
IEC CDV 62328-2: Multimedia home server systems -- Interchangeable volume/file structure adaptation for broadcasting receivers -- Part 2: General recording structure [SC 29 N 5962]
10783 IEC TC 100 via SC 29 Secretariat
IEC CDV 62328-3: Multimedia home server systems -- Interchangeable volume/file structure adaptation for broadcasting receivers -- Part 3: Broadcasting system specific recording structure -- ISDB [SC 29 N 5963]
10784 ITU-T SG 17 via SC 29 Secretariat Liaison Statement from ITU-T SG 17 [SC 29 N 5968]
10785 ITU-T SG 12 via SC 29 Secretariat Liaison Statement from ITU-T SG 12 [SC 29 N 5980]
10786 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC FDIS 21000-6 [SC 29 N 5981]
10787 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-11/PDAM 4 [SC 29 N 5982]
10788 SC 29 Secretariat Summary of Voting on ISO/IEC TR 13818-5:1997/Amd.1:1999/DCOR 2 [SC 29 N 5998]
10789 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC FDIS 14496-8 [SC 29 N 5999]
10790 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 15938-5:2003/FDAM 1 [SC 29 N 6001]
10791 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-4:200X/FPDAM 1 [SC 29 N 6002]
10792 SC 29 Secretariat Summary of Voting on ISO/IEC PDTR 21000-12 [SC 29 N 6008]
10793 TVA via SC 29 Secretariat Liaison Statement from the TV-Anytime Forum [SC 29 N 6015]
25
10794 IEC TC 100 via SC 29 Secretariat
IEC CDV 62298-1: Teleweb Application -- Part 1: General Description [SC 29 N 6016]
10795 IEC TC 100 via SC 29 Secretariat
IEC CDV 62298-2: Teleweb application -- Part 2: Delivery methods [SC 29 N 6017]
10796 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 13818-1:2000/FDAM 3 [SC 29 N 6019]
10797 SC 29 Secretariat Summary of Voting on ISO/IEC CD 21000-10 [SC 29 N 6103]
10798 ITU-R SG 6/WP 6M via SC 29 Secretariat Liaison Statement from ITU-R SG 6/WP 6M [SC 29 N 6022]
10799 ITU-T SG 9 via SC 29 Secretariat Liaison Statement from ITU-T SG 9 [SC 29 N 6033]
10800 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC FDIS 14496-18 [SC 29 N 6029]
10801 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC FDIS 14496-19 [SC 29 N 6035]
10802 a MPEG-21 DIA
10803 Glenn Adams David Singer W3C Comments on the MPEG Timed Text specification
10804 Ralph Sperschneider Study on ISO/IEC 14496-3:2001/FPDAM 3 (MP3onMP4)
10805 Mikael Bourges-Sevenier AhG MPEG-J extensions for rendering, Tokyo meeting report
10806 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-7/FPDAM 1 [SC 29 N 6046]
10807 Niels RumpChris Barlas Relationship between Digital Items and Digital Item Declarations
10808
NavarroSilva Nunes Aragao
2-D IDCT Hardware Accelerator Implementation for Virtex-II Devices
10809 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-3/FPDAM 3 [SC 29 N 6047]
10810 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-1:2001/FDAM 7 [SC 29 N 6048]
10811 JTC 1 Secretariat via SC 29 Secretariat Summary of Voting on ISO/IEC TR 13818-5:1997/DAM 2 [SC 29 N 6049]
10812 Jean-Claude DufourdOlivier Avaro
Answer to the CfP on LASeR and SAF: Streamezzo format proposal overview
10813 Niels RumpSimon Watt Overview of responses to Call for Proposals for MPEG-21 IPMP
10814 Joerg HeuerAndreas Hutter Answer to Call for Proposal on Lightweight Scene Representation
10815 Jean-Claude DufourdOlivier Avaro Answer to the CfP on LASeR and SAF: Streamezzo LASeR format proposal
10816 Jean-Claude DufourdOlivier Avaro Answer to the CfP on LASeR and SAF: Streamezzo SAF format proposal
10817 Jean-Claude DufourdOlivier Avaro Answer to the CfP on LASeR and SAF: Streamezzo Test Set and Executables
10818 Alexandre CotarmanachRenaud Cazoulat Answer to the CfP on LASeR and SAF
10819 Renaud CazoulatAlexandre Cotarmanach Answer to the CfP on LASeR and SAF
26
10820Robin BerjonGregoire PauClaude Seyrat
Response to the CfP on LASeR : BiM SVG Profile for LASeR
10821J.Dubois L.PierrefeuM.Mattavelli
Motion estimation Hardware Accelerator Implementation for Virtex-II Devices
10822 Robert Prandolini Scalable Video Coding Requirements for Video Surveillance Systems
10823 Wael BadawyTamer Mohamed
An Integrated Hardware-Accelerated Software Framework for MPEG4 Hardware Reference Model
10824Ihab AmerWael BadawyGraham Jullien
AN IP BLOCK FOR MPEG-4 PART 10 CONTEXT-BASED DAPTIVE VARIABLE LENGTH CODING (CAVLC)
10825Ihab AmerWael BadawyGraham Jullien
A Hardware Block for 2x2 Hadamard Transform and Quantization with Application to MPEG–4 Part 10
10826Ihab AmerWael BadawyGraham Jullien
A SystemC Description for 2x2 Hadamard Transform and Quantization Block with Application to MPEG–4 Part 10
10827Ihab AmerWael BadawyGraham Jullien
A Hardware Block for 4x4 Hadamard Transform and Quantization in MPEG-4 Part 10
10828Ihab AmerWael BadawyGraham Jullien
A SystemC model for 4x4 Hadamard Transform and Quantization witj application to MPEG-4 Part 10
10829Ihab AmerWael BadawyGraham Jullien
A Hardware Block for THE MPEG-4 PART 10 4x4 DCT-LIKE TRANSFORMATION AND QUANTIZATION
10830Ihab AmerWael BadawyGraham Jullien
A SYSTEMC MODEL FOR THE MPEG-4 PART 10 4x4 DCT-LIKE TRANSFORMATION AND QUANTIZATION
10831 Thomas DeMartini Editor's Input: DIA AMD/1 WDv2.1
10832Eva RodriguezSilvia LlorenteJaime Delgado
DMAG answer to MPEG-21 Intellectual Property Management and Protection Call for Proposals
10833 Jean-Claude DufourdYoung-Kwon Lim Proposed WD 0.1 of ISO/IEC 14496-20, LASeR and SAF
10834 Olivier Avaroet alii Proposed Draft Core Experiment on LASeR Harmonization with SVG
10835 Olivier Avaroet alii Proposed Draft Core Experiment on LASeR Binary Representation
10836 Young-Kwon Lim Report of the LASeR evaluation meeting
10837 Olivier Avaroet alii LASeR software
10838 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 14496-17 [SC 29 N 6057]
10839Melanie Dulong de RosnayJérôme CaporossiDaniel Lecomte
Answer to the Call for Proposals for MPEG-21 IPMP: Medialiving technology
27
10840 ITU-R SG 6/WP 6Q via SC 29 Secretariat Liaison Statement from ITU-R SG 6/WP 6Q [SC 29 N 6059]
10841 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-3:2001/FDAM 2 [SC 29 N 6062]
10842 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 15938-3:2002/FDAM 1 [SC 29 N 6063]
10843 DMP via SC 29 Secretariat Liaison Statement from the Digital Media Project [SC 29 N 6060]
10844 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-1:2001/DCOR 3 [SC 29 N 6064]
10845 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-11/DCOR 2 [SC 29 N 6069]
10846 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-5:2003/DCOR 1 [SC 29 N 6072]
10847 SC 29 Secretariat Summary of Voting on ISO/IEC CD 21000-8 [SC 29 N 6075]
10848
Itaru Kaneko (Tokyo Polytechnic University)Nobuyuk Kinoshita (MMG)Spencer Cheng (Morphbius Technology)
Application Specific Binary Coding (ASBC) of MPEG-21 descriptors for better coding efficiency maintaining interoperability to regular MPEG-21 decoder
10849
Valentin MuresanNoel O’ConnorNoel MurphySean MarlowAlan Smeaton
Low-power hardware acceleration for motion estimation
10850 Carlos SerraoPanos Kudumakis ENTHRONE answer to the Call for Proposal for MPEG-21 IPMP
10851 Wo Chang testing
10852
Yongju ChoYoung-Kwon LimMoonsub SongHyung-Joon Kim
Proposed Resource Reference Box for addressing a sub-part of a media resource
10853 Mauri Väänänen Finnish NB comment: SVC requirements and directions
10854Panos Kudumakis Carlos Serrao Claudio Alberti
MOSES and ENTHRONE answer to the MPEG-21 IPMP CfP
10855
HendryKyung-Ae ChaMunchurl KimKeun Soo Park
Answer to the CfP on MPEG-21 IPMP : A Right Description Model on Resource Combinations
10856
Jeongyeon LimQonita ShahabHendryKyung-Ae ChaMunchurl KimKeun Soo Park
Answer to the CfP on MPEG-21 IPMP : An IPMP Decription Tool for Partial Encryption of Digital Items
10857HendryMunchurl KimKeun Soo Park
Answer to the CfP on MPEG-21 IPMP : REL DIBOs in MPEG-21 DIP for MPEG-21 IPMP
10858 Zhongyang HuangMing JiShengmei ShenTaka Senoh
Answer to the MPEG-21 IPMP CfP: IPMP_Scheme Descriptor and its Processing for Digital Item Protection
28
Takafumi Ueno
10859 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-5:2001/FPDAM 7 [SC 29 N 6080]
10860 Ian S BurnettGerrard Drury Response to CfP for MPEG-21 IPMP
10861
Sang-Hoon OhSeok-Hoon KimHyung-Sik SuhSang-Gyu LeeBon-Hong So
Response to CfP for MPEG-21 IPMP : Reference Model for IPMP Assessment
10862 Craig Schultz Answer to the CfP on MPEG-21 IPMP
10863 Silva O. Nunes C. Aragao MPEG-4 Inverse Quantizer Hardware Accelerator Implementation in Virtex II
10864Xin WangVenugopal VenkatramanThomas DeMartini
Simple Integration Reference Software for MPEG-21 REL, DID and DIA
10865
J. J. ChaeJ. NamB. J. KimJ. W. Hong
Answer to CfPs for MPEG-21 IPMP
10866
Bin LiLi ZhaoNanshan WuShiqiang Yang
The DRM Framework for Large-scale Broadcast
10867 Tom McMahon AVC FRExt Level Requirements for D-Cinema and High Quality SD/HD Distribution, Contribution, and Backhaul
10868David Taubman none Nagita Mehrseresht none Raymond Leung
SVC Technical Contribution: Overview of recent technology developments at UNSW
10869
Chris BarlasNiels RumpIan BurnettPaul JessopRik van de WalleFernando PereiraSimon WattKate GrantChris RussellBrian Green
MPEG-21 Integration and Outreach
10870 Marco Rittermann A Proposal for Testing Multi-View Video Coding
10871
Jeho NamHyuk-Min Kwon Man-Bae KimSeungji YangTruong Cong ThangRin-Chul KimHae-Kwang Kim
Updated Status of MPEG-21 DIA Utility Software Modules
10872 Ye-Kui Wang Finnish NB comments on 14496-12 Amd.1
10873Victor TorresJaime DelgadoEva Rodriguez
MPEG-21 DIP Core Experiments: A contribution to the implementation of DIBOs for REL
29
10874
Spencer ChengGene WenNickolay PakoulinVitaly Omelchenko Alexander KoptelovAlexandre Petrenko Alexander Kossatch
Improving MPEG-21 IPMP Conformance - Experience from MPEG-2/4 IPMPX
10875 Shijun Sun Temporal Scalable Coding Using AVC Coding Tools
10876 JTC 1 Secretariat via SC 29 Secretariat Summary of Voting on ISO/IEC DTR 21000-1 (2nd Edition) [SC 29 N 6093]
10877 SC 37 via SC 29 Secretariat
Liaison Statement from JTC 1/SC 37 on ISO/IEC FCD 19794-5 [SC 29 N 6094]
10878 SC 29 Secretariat Summary of Voting on NP MPEG-A [SC 29 N 6099]
10879 SC 29 Secretariat Summary of Voting on CD MPEG-A [SC 29 N 6101]
10880 Gyeong Ja JangJames D. K. Kim Update of XMT-A for AFX
10881 KNB KNB comment on 14496-11/PDAM4 (XMT & MPEG-J Extensions)
10882 Gyeong Ja JangJames D. K. Kim Updates on the reference software of AFX Encoder
10883
Andrew KinaneValentin MuresanNoel O’ConnorNoel MurphySeán MarlowAlan Smeaton
Hardware Acceleration Module for Shape Adaptive Discrete Cosine Transform
10884 Young-Kwon Lim Proposal on SL-compliant SAF packet headers
10885
Jong-Tae KimWeon-Geun OhHae-Kwang KimHeung-Kyu LeeYoung-Ho Seo
Video Extension to Evaluation Tools for Persistent Association Technologies
10886
Ik-Hwan ChoHae Kwang KimWeon-Geun OhDong-Seok Jeong
The Composition of Test Video Sequences for Evaluation of the robustness of Digital Video Watermarking
10887 JTC 1 Secretariat via SC 29 Secretariat Summary of Voting on ISO/IEC DTR 21000-11 [SC 29 N 6102]
10888 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:200X/FPDAM 6 [SC 29 N 6106]
10889 SC 29 Secretariat Summary of Voting on ISO/IEC CD 21000-2 [SC 29 N 6107]
10890 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-4:200X/FDAM 5 [SC 29 N 6108]
10891Eva RodriguezJaime DelgadoSilvia Llorente
Revised REL Interpretation Conformance after verification of Test Cases
10892
Jeroen BekaertThomas DeMartiniRik Van de WalleHerbert Van de Sompel
Identification of a DIDL Document
10893 Wendy Aylsworth SMPTE Liaison to MPEG on OpenType® and ISO/IEC 14496-18
30
Tom McMahonPeter SymesOliver Morgan
10894
Stephan WürmlinMichael WaschbüschEdouard LamborayPeter KaufmannAljoscha SmolicMarkus Gross
Image-space Free-viewpoint Video
10895
Won-Young YooWeon-Geun OhHae-Kwang KimYong-Seok SeoSung-Hwan Lee
Transaction Watermarking Model for Persistent Association Technologies
10896 AUNB via SC 29 Secretariat
AUNB Contribution on JPEG & MPEG Public Document Archive [SC 29 N 6112]
10897 TVA via SC 29 Secretariat Liaison Statement from the TV-Anytime Forum [SC 29 N 6114]
10898 Mahnjin Han Addition to PointTexture Compression for future extensions
10899
Gyeong Ja JangShinjun LeeJames D.K. KimMahnjin Han
Update on XMT-A specification for encoding parameter of PointTexture Compression
10900 Jean H.A.Gelissen Contribution to MPEG Multimedia Middleware Requirements v.1.0
10901 Francois EdouardVieron Jerome THOMSON requirements for Scalable Video Coding
10902
Francois EdouardBoisson GuillaumeVieron JeromeBottreau VincentGuillemot Christine
Evaluation of Motion accuracy scalability - SVC Core experiment 1a
10903 Boisson Guillaume Improvements of SVC CfP S18 proposal
10904
Vincent BottreauChristine GuillemotRashid AnsariEdouard Francois
SVC Technical Contribution to CE1b: Spatial Transform using Three Lifting Steps
10905 Alexandre Cotarmanac'hVladimir Levantovsky Proposal to amend ISO/IEC 14496-1:2004
10906 A. G. Tescher for USNB USNB Contribution: Proposed CfP for Scalable Audio under MPEG 21
10907 A. G. Tescher for USNB USNB Contribution: Response to Munich resolution 2.2.3
10908 A. G. Tescher for USNB USNB Contribution: "Fidelity Range Extensions" name change
10909 A. G. Tescher for USNB USNB Contribution: Response to Munich resolution 2.2.2
10910 A. G. Tescher for USNB USNB Contribution: The need for additional levels for Visual SP
10911 A. G. Tescher for USNB USNB Contribution: Suggested corrigendum to 13818-1:2000
10912 A. G. Tescher for USNB Proposed conversion of OpenType to an ISO/IEC standard
10913 A. G. Tescher for USNB USNB Contribution: ISO/IEC 14496-17/FCD concerns
10914 SC 29 Secretariat Summary of Voting on ISO/IEC CD 21000-9
31
10915 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-3:2001/PDAM 6
10916 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-6:2003/FPDAM 1
10917 JTC 1 Secretariat Summary of Voting on ISO/IEC TR 15938-8/DAM 1
10918 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-5:2001/FPDAM 6
10919 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-10:2003/FPDAM 1
10920 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-1:2000/FPDAM 4
10921 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-1:2000/FPDAM 5
10922 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-4:200X/FPDAM 2
10923 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:200X/FPDAM 8
10924 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-11/FPDAM 3
10925 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-5:2003/FPDAM 2
10926 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 15938-10
10927 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-12/FPDAM 1 & 15444-12/FPDAM 1
10928 Wook-Joong KimEuee. S. Jang Consideration on the MAF for omni-directional AV
10929 Ulrich FeckerAndre Kaup Transposed Picture Ordering for Dynamic Light Field Coding
10930 Vladimir Levantovsky Proposal for amendment of ISO/IEC 14496-14
10931 Ulrich BenzlerMathias Wien Results of SVC CE3 (Quality Evaluation)
10932 Ulrich Benzler Discussion on requirements and applications for Scalable Video Coding
10933 Karol WnukowiczWladyslaw Skarbek Dominant Color Temperature Descriptor
10934
Han-Kuang HsuChia-Yang TsaiHsiang-Cheh HuangHsueh-Ming HangTihao Chiang
Response to CE1b in SVC-- SB-Reach Method for Entropy Coding
10935 Vittorio BaronciniTobias Oelbaum
A Multimedia material Visual quality ranking procedure based on Single or Multiple Viewing
10936 Alain MignotPierre Garneau Simplification of AFX/SolidRep node
10937 Patrick GioiaJérôme Royan Proposal for multiresolution urban representation
10938 Robert O'CallaghanMiroslaw Bober Preliminary Results on Situation/View-Based Clustering
10939
HendryMunchurl KimKeunsoo ParkEva RodriguezTorres Jaime Delgado
CE report for Core Experiment on DIBOs for REL
10940 Peter van Beek MPEG-7 User Description Profile Update
10941 Sachin Deshpande HTTP Agent-Driven Content Negotiation for Scalable Video Coding
32
10942 Shane LaufIan S Burnett Mobile MPEG-21 browser implementation
10943
Zhang HuSun LifengYang ShiqiangCheng Xiaoyu
Results for EE3 on evaluation of MAC for stereoscopic video coding
10944 AUNB AUNB Comments on MPEG-A CD
10945
J. J. ChaeJ. H. NamB. J. KimJ. W. Hong
Comments of the proposed document M10865
10946 Takahiro KimotoYoshihiro Miyamoto Response to SVC Core Experiment 1d. Introduction of a Base-Layer
10947
Sang-Kyun KimSeungji YangYong Man RoJi-Yeun Kim
Consideration on the clustering evaluation method for situation/view based photo clustering experiment (VCE-1)
10948
Sang-Kyun KimSeungji YangYong Man RoJi-Yeun Kim
CE Report for situation/view based photo clustering experiment (VCE-1)
10949
Sang-Kyun KimSeungji YangYong Man RoJi-Yeun Kim
GT set proposed for situation/view based photo clustering experiment (VCE-1)
10950
Sang-Kyun KimSeungji YangYong Man RoJi-Yeun Kim
Consideration on the photo categorization scheme (VCE-2)
10951
Sang-Kyun KimSeungji YangYong Man RoJi-Yeun Kim
Model set and GT set for the photo categorization experiment (VCE-2)
10952
Sun LifengYang ShiqiangCheng XiaoyuLi Fang
Consideration on Quality Measure for Multiview Video
10953
Sang-Kyun KimSeungji YangYong Man RoJi-Yeun Kim
Consideration of face based photo clustering and retrieval
10954 Tamer MohamedWael Badawy Multiple IP-Core Hardware-Accelerated Software System
10955 Akio Yamada Sang-Kyun Kim MPEG-7 Visual XM Document version 20.1
10956 Akio Yamada Sang-Kyun Kim WD 1.1 of MPEG-7 New Visual Extensions
10957 Myriam Amielh Final CE report on MPEG-21 Media Locator
10958 Yoshihiro Miyamoto Proposed Corrigendum to ISO/IEC 14496-4:200X 2nd Edition
33
10959 Jung Kyunheon Kim Interframe adaptive spatial transform
10960 Wo Chang Update M7ITB Testbed and Available Tools for MPEG-7 Bitstreams Repository
10961 Wo ChangSchuyler Quackenbush MAF Reference Software Workplan Proposal
10962 Wo Chang MAF File Format Proposal
10963
Myriam AmielhErnest WanGerrard DruryIan Burnett
Proposed DIBO for playing a Fragment
10964 AUNB AUNB Contribution: A DIBO for playing a DID fragment
10965 Euee S. JangJa Kim On the status of 3D Mesh Compression in MPEG-4
10966
Euee S. JangLeeChoLee
Initial thoughts on VCTR activity
10967 Euee S. JangAsai AHG on MPEG VCTR
10968 Noboru HaradaYongshan Yu
Proposal of CE for improved floating-point compression in ALS (Audio Lossless Coding)
10969 Yutaka KamamotoNoboru Harada Proposal of CE on Multi channel extension for ALS (Audio Lossless Coding)
10970 Li Fang Test Incomplete 3D Synthesis Method for Multiview Video
10971Christian Timmereron behalf of the Austrian NB
ANB comments on 21000-2 CD 2nd Edition
10972Christian Timmereron behalf of the Austrian NB
ANB comments on 21000-8 CD
10973Christian Timmereron behalf of the Austrian NB
ANB comments on 21000-10 CD
10974
Christian TimmererStephen DavisItaru KanekoSpencer ChengRobbie De Sutter
Report of CE on MPEG-21 Binarisation
10975 Hideaki KimataMasaki Kitahara Anchor bitstreams for experiments on multiple view video coding (3DAV)
10976 Hideaki KimataMasaki Kitahara Preliminary results on multiple view video coding (3DAV)
10977 Soo-Jun ParkMyung Gil Jang
Cross verification of Model set and GT set for the photo categorization experiment (VCE-2)
10978 Christian TimmererHermann Hellwagner Comments on DIA AMD1 WDv2
10979 Soo-Jun Park Cross verification of GT set proposed for situation/view based photo
34
Myung Gil Jang clustering experiment (VCE-1)
10980 Soo-Jun ParkMyung Gil Jang
Cross verification reprot of situation/view based photo clustering experiment (VCE-1)
10981 Soo-Jun ParkMyung Gil Jang Dataset of VCE-1 and 2
10982
Yesun JoungWon-Sik CheongJihun ChaKyuheon KimYoung-Kwon Lim
Comments on LASeR Harmonization with SVG
10983 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-5:2001/FDAM 4 [SC 29 N 6078]
10984 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-5:2001/FDAM 5 [SC 29 N 6079]
10985 OMA via SC 29 Secretariat Liaison Statement from the Open Mobile Alliance (OMA) [SC 29 N 6121]
10986 Soo-Jun ParkChee Sun Won A proposal for a hierarchical grouping of digital photos CE
10987Julien ReichelGuillaume BaudFrancesco Ziliani
Responses of CE1e in SVC: Adaptive update step in MCTF
10988Diego Santa CruzJulien ReichelFrancesco Ziliani
Responses of CE1d: Base-Layer
10989 Francesco Ziliani Summary of responces to Ce1d: Inroduction of a Baser Layer
10990Ji MingHuang ZhongyangTaka Senoh
Suggestions on the scope of MPEG-21 IPMP Standardization
10991 LEE SgNB Comment on the Lossless Audio Coding Work
10992 SC 37 Liaison Officer Liaison Statement from SC 37 Biometrics
10993PateuxAmonouKervadec
A generic framework for MCTF-based coding
10994 Helge Drumm CE - Shadow: Preliminary Results on Reference Software Implementation
10995PateuxAmonouKervadec
France Telecom Requirements for Scalable Video Coding
10996
Ingo WolfBernhard FeitenTeodora Guenkova-LuyAndreas SchorrFranz HauckAndreas J. Kassler
MPEG-21 DIA based delivery using SDPng and RTP
10997Ihor KirenkoRene van der VleutenFons Bruls
Flexible Scalable Video Compression
10998Gero BäseAndreas HutterPeter Amon
Requirements for a scalable video coding standard
10999 Jean-Claude Dufourd Comments on LASeR and SVG
35
Olivier Avaro
11000
Zhongyang HuangMing JiShengmei ShenTaka Senoh
Metadata protection in ISO Base File Format Amendment
11001 Heiko PurnhagenWerner Oomen CT/Philips contribution to CfP on spatial audio coding
11002 James Ingram Position Paper on the SMR Draft Call for Proposals
11003
Itaru Kaneko (Tokyo Polytechnic University)Mark Callow (HI Corporation)
Comments on MPEG-4 part 21 MPEG-J extension forrendering
11004 Ray Taylor MPEG-7 Systems extensions, TVAnytime indexing core experiments
11005 Martin Link Subjective results formal verification test MPEG4-Ext2. (Parametric)
11006 Adam Lindsay ID3v2 Tags in MPEG-A
11007 Kate Grant for UKNB UKNB position on patent statements
11008 Kristofer Kjörling New profile proposal combining HE-AAC and Parametric Stereo
11009Per EkstrandAndreas SchneiderKristofer Kjörling
Proposed additions to Sbr conformance testing
11010 Konstantin Hanke SVC CE1e - Verification of Visiowave Results on Adaptive Update Step in MCTF
11011 Konstantin Hanke Response to SVC CE1e - Spatial Highpass Transition Filtering
11012 DANAE Consortium Licensing status of software in SVC standardization
11013 Chris Barlas ISO/IEC 21000-6 COR/1 WD v.1 Editor's Input
11014 Masayuki TanimotoToshiaki Fujii Utilization of inter-view correlation for multiple view video coding
11015Naoya TanakaKok-Seng ChongKazuhiro Iida
Technical Description and Performance Test Results of Panasonic Spatial Audio Coding
11016
Joeri BarbarienAdrian MunteanuYiannis AndreopoulosFabio VerdicchioJan CornelisPeter Schelkens
Prediction-based scalable motion vector coding
11017
Thomas WediTeruhiko SuzukiYoshihisa YamadaTakuya ImaideTom McMahonStijn de WaeleByeong-Moon JeonStephen GordonNorio Ito
Definition of a 4:2:0 / 8-bit Profile for H.264/AVC FRExt
11018 Eunmi OhMiyoung Kim Proposed changes in MPEG-4 BSAC multi-channel audio coding
36
11019
Paolo NesiGiorgio ZoiaPierfrancesco BelliniJerome BarthelemyJames IngramDavid Crombie
Draft Evaluation Criteria for Assessing SMR Proposals
11020 Thomas Wedi Verification of HHI Results for Core Experiments on AVC-Based Scalable Video Coding
11021
Paolo NesiPierfrancesco BelliniJerome BarthelemyJames IngramNeil McKenzie
Examples of matching SMR aspects and available technologies
11022
Giorgio ZoiaPierfrancesco BelliniJerome BarthelemyPaolo NesiMikael Bourges-Sevenier
Graphic functionality in MPEG-4 and Symbolic Music Representation
11023 Masanori SANO Some thoughts on MPEG-7 Profiling
11024 Masanori SANO MPEG-7 Core Description Profile Update
11025
Paolo NesiGiorgio ZoiaJames IngramPiefrancesco Bellini
Study on Draft CfP on Symbolic Music Representation
11026JungHoe KimSangWook KimEunmi Oh
Comments on MPEG-4 BSAC Conformance
11027 van der Meer Inputs on study text of timed text FCD (part 17)
11028 Juergen SchmidtOliver Baum Study Text of ISO/IEC 14496-11/2003 FPDAM-3
11029 Juergen SchmidtKlaus Eilts-Grimm Simple Integration Reference Software for MPEG-4 AudioBIFS, version 3
11030 Mariam Kimiaei AsadiJean-claude Dufourd Possible missing features in MPEG-21 DIA
11031 Karsten MüllerAljoscha Smolic
View-Dependent Multi-Texturing for MPEG-4 AFX, Syntax and Se-mantics Specification Update
11032 John R. SmithAlan Melby
CE Results on Addressing Scheme for MPEG-21 using MPEG-7 Media Locators
11033 Matthias GruhneJan Rohden Proposed Core Experiment on Audio Rhythm Patterns
11034
Joerg HeuerAndreas HutterAndrea Kofler-VogtHarald Kosch
CE-Report on Evaluations of the Siemens Index System
11035 Werner OomenHeiko Purnhagen Proposed corrigenda to AMD2, (parametric)
11036 Joerg HeuerAndreas HutterAndrea Kofler-Vogt
Stream Reordering for Fast Random Access
37
Harald Kosch
11037 Werner Oomen Complementary information to Formal verification test parametric
11038
Stephan WürmlinChristopher LeeMatthias ZwickerMichael WaschbüschMarkus GrossHanspeter Pfister
Results on Reference Software Implementation on Point based Rendering for MPEG-4 AFX
11039 Leszek CieplinskiSoroush Ghanbari Preliminary Results of SVC CE1c
11040 Mathias Wien CE2.4 Adaptive Spatial Transforms: Verification of HHI results
11041
Joseph MeehanMinhua ZhouJennifer WebbFelix Fernandes
MPEG4 Simple-Profile Level 4 and 5 Proposal
11042 Woo-Jin Han Verification of SAIT results for SVC on CE1a Motion Scalability
11043Heiko SchwarzDetlev MarpeThomas Wiegand
SVC Core Experiment 2.1: Inter-layer prediction of motion and residual data
11044 Detlev MarpeThomas Wiegand SVC Core Experiment 2.1: Inter-layer prediction of motion and residual data
11045
Y. AndreopoulosA. MunteanuM. van der SchaarJ. CornelisP. Schelkens
Comparison Between t+2D and 2D+t Architectures with Advanced Motion Compensated Temporal Filtering
11046
Alexandru SalomieAdrian MunteanuRudi DeklerckPeter Schelkens
Proposal for the XMT-A specifications for MeshGrid
11047 Woo-Jin HanSang-Chang Cha Verification of OES/ITRI results for SVC on CE1c Intra Prediction
11048Heiko SchwarzDetlev MarpeThomas Wiegand
SVC Core Experiment 2.2: Influence of the update step on the coding efficiency
11049 Woo-Jin HanHo-Jin Ha Verification of VisioWave results for SVC on CE1d Base Layer
11050Woo-Jin HanSang-Chang ChaJae-Young Lee
Verification of MSRA results for SVC on CE1e Deblocking
11051Heiko SchwarzDetlev MarpeThomas Wiegand
SVC Core Experiment 2.3: Spatial interpolation
11052Heiko SchwarzDetlev MarpeThomas Wiegand
SVC Core Experiment 2.4: Adaptive Spatial Transforms
11053Woo-Jin HanHo-Jin HaBae-Keun Lee
Responses of SVC CE1a Motion Scalability; Interpolated motion layer
38
11054 Woo-Jin HanSang-Chang Cha Responses of SVC CE1c Intra Predictionl; Pixel-interpolated prediction
11055 Woo-Jin HanHo-Jin Ha Responses of SVC CE1d Base Layer; R-D optimized base-layering
11056Woo-Jin HanSang-Chang ChaJae-Young Lee
Responses of SVC CE1e Deblocking; In-loop prediction smoothing
11057 Jean-Claude Dufourd FNB comment on LASeR
11058
Rongshan YuXiao LinSusanto RahardjaHaibin Huang
Proposed WD3 of ISO/IEC 14496-3:2001/AMD 5, Audio Scalable Lossless Coding (SLS)
11059 Rongshan Yu Crosscheck on FhG’s Proposed Core Experiment for MPEG-4 Audio Scalable to Lossless (SLS) Coding
11060 Tilman Liebchen Verification Report on MPEG-4 ALS Core Experiment 5 (Coding of LPC Coefficients)
11061 Tilman LiebchenYuriy A. Reznik
Proposed Text of ISO/IEC 14496-3:2001/PDAM 4, Audio Lossless Coding (ALS)
11062
Rongshan YuSusanto RahardjaXiao LinHaibin Huang
Reduce Complexity for MPEG-4 Audio Scalable Lossless (SLS) Coding
11063 Tilman Liebchen Proposed Core Experiment on Higher Predictor Orders in MPEG-4 ALS
11064
Andrew TokmakoffYoungjoo SongKyunghee JiSenator Jeong
CE-Report on MPEG-21 Event Reporting
11065 Schuyler Quackenbush DRAFT Procedures for the Evaluation of Spatial Audio Coding Systems
11066Marius PredaFrançoise PreteuxOlivier Marre
Morphing Appearances
11067Julien ReichelFrancesco ZilianiJean Claude Michelou
Requirements for Scalable Video Coding for Video Surveillance Applications
11068 Marius PredaFrancoise Preteux Textual BBA
11069 Vatis Jörn Ostermann Verification of HHI Results for Core Experiment on Scalable Video Coding
11070 Vatis Jörn Ostermann verification of HHI results for core experiment on scalible video coding
11071 Ralph Sperschneider Problem with buffer fullness derivation in the case of number_of_raw_data_blocks_in_frame>0 and protection_absent=0
11072 Ralph Sperschneider Status on MPEG-4 Audio Conformance
11073 Ralph Sperschneider Proposed ISO/IEC 14496-3:2004 (Audio 3rd Edition)
11074Davide MaestroniMarco TagliasacchiStefano Tubaro
Responses of CE1d in SVC: Base Layer
11075 Juergen HerreChristof Faller
Fraunhofer/Agere Submission to Spatial Audio CfP
39
C. SpengerJ. HilpertK. Linzmeier
11076 Juergen Herre Evaluation of Spatial Audio Coding Schemes
11077Thomas DeMartiniHerbert Van de SompelJeroen Bekaert
Status of mpegRA activity
11078 Ralf Geiger Proposed WD4 of ISO/IEC 14496-3:2001/AMD 5, Audio Scalable Lossless Coding (SLS)
11079 Ralf GeigerJuergen Herre On the Performance of MPEG-4 SLS RM4
11080 S. QuackenbushH. Purnhagen Description of Audio Codec Behavior
11081
Jeroen BekaertFrederik De KeukelaereHerbert Van de SompelRik Van de Walle
Requirement for MPEG-21 DID
11082 French National Body FNB Position on SVC Standardization
11083 Michael Good Response to Draft Call for Proposals N6457
11084
Gregoire Pau Beatrice Pesquet-PopescuMihaela van der SchaarJerome Vieron
Delay-Performance Trade-Offs in Motion-Compensated Scalable Subband Video Compression
11085 Gregoire PauBeatrice Pesquet-Popescu Cross-verification of RWTH results on SVC CE-1e
11086
Christian TimmererKlaus LeopoldDietmar JannachHermann Hellwagner
Contribution to DIA AMD1 WDv2
11087Joerg HeuerGabriel PanisAndreas Hutter
Considerations for efficient Resource Adaptation based on MPEG-21 DIA
11088 Charith Abhayaratne SVC Core Experiment CE1b - Summary
11089 Matt Fellers Proposed Test Items for MPEG Spatial Audio Coding
11090
Matt FellersMark VintonMark DavisGrant Davidson
Dolby Laboratories Submission to CfP on MPEG-4 Spatial Audio Coding
11091Debargha MukherjeeHuisheng WangSam Liu
On BSD Transformation Instructions - Streaming Implementation and updates
11092
Daniel LarkinValentin MuresanNoel E. O'ConnorNoel MurphySeán MarlowAlan Smeaton
Hardware Acceleration Module for MPEG-4 binary shape coding motion estimation
11093 Eric Gsell FRExt Extended Bit Depth Characterization
40
11094 Walter GishHyung-Suk Kim FRExt Bit Depth Interoperability
11095 Diego Santa CruzYukihiro Bandoh Cross-verification of results for SVC on CE1d
11096 Thomas RusertMathias Wien
Multi-Layered Motion Estimation with Constrained Enhancement (SVC CE1a)
11097 Ali TabatabaiRohit Puri Multiple description coding for generalized layering
11098BlaszakDomanskiLange
Results in SVC CE2: mode selection and spatial upsampling
11099 Rafal LangeMarek Domanski Response to SVC CE2 tasks: inter-layer motion information prediction
11100Deepak TuragaAli TabatabaiMinh Do
Multiresolution Representation of Motion Information for Scalable Video Coding
11101
Lukasz BlaszakMarek DomanskiRafal LangeAdam Luczak
Response to SVC CE2 tasks: testing of SNR scalability technologies
11102 FNB FNB Position Paper on MPEG applications, context and objectives
11103 Alexandre Cotarmanac'h Updated software for SL extension
11104
Valentin MuresanDaniel LarkinAndrew KinaneNoel O’Connor
Status of CDVP's contribution to MPEG-4 Part 9 - Implementation Study Group
11105 Hiroshi YasudaTakuyo Kogure Digital Cinema QOS and Conformance
11106
Justin RidgePer FröjdhJonathan TehWoo-Jin Han
Mobile communications industry comments on SVC requirements
11107
Justin RidgeMarta KarczewiczYiliang BaoShawn Wang
Extension to AVC-based scalable video coding
11108 Justin Ridge Comment regarding SVC software selection
11109 Mikael Bourges-Sevenier Update of XMT-A and MPEG-J standards
11110 Gerrard DruryIan Burnett Comments on Identification of DID a Document
11111 Mikael Bourges-SevenierVishy Swaminathan Considerations for MPEG-J extensions for rendering
11112 Yuriy A. Reznik Verification Report on MPEG-4 ALS Core Experiment 4 (Coding of Random Access Frames)
11113 Gerrard DruryIan Burnett Response to Comments on DIP CD
11114 Yuriy A. Reznik Proposed CE on Additional Enhancements for Lossless Audio Coding
41
11115 Wo Chang Testing
11116 BD Founders via SC 29 Secretariat Liaison Statement from Blu Ray Disk Founders
11117
Chun-Jen TsaiChung-Neng WangChih-Hung LiYin-Tzu ShihChen-Wei FanJien-Peng Ho
Scalable Multimedia Streaming Test Bed for Media Coding and Testing in Streaming Environments
11118 Myriam Amielh Issues relating to the use of URI Fragment Identifiers in MPEG-21
11119Hsin-Hao ChenGuo-Zua WuYi-Jung Wang
Responses of CE1c in SVC: Exploiting the Spatial Correlation within the Low-Pass Frames
11120 Edouard FrancoisThomas Rusert CE1a : cross verification of MSRA proposal
11121 John R. SmithAlan K. Melby Revised Logical Media Locator for MPEG-7 & MPEG-21
11122 Giovanni Cordara CE1a: TILAB-PdM solution
11123 Ji Jizheng Xu Verification of NCTU results for SVC on CE1b, entropy coding
11124 Xiong Jizheng Xu Verification of TILAB/PdM results for SVC on CE1a
11125 Song Jizheng Xu Verification of SUMSUNG results for SVC on CE1c
11126 Xiong Jizheng Xu Feng Wu
Spatial Scalability in 3D Wavelet Coding with Spatial Domain MCTF Encoder
11127 Ji Jizheng Xu Debin Zhao Feng Wu Responses of CE1d in SVC: Base layer
11128 Xiong Jizheng Xu Feng Wu Responses of CE1a in SVC: Scalable Motion
11129 Song Jizheng Xu Hongkai Xiong Feng Wu Responses of CE1e in SVC: Adaptive update based on human vision system
11130 Zhang Jizheng Xu Hongkai Xiong Feng Wu Sub-pixel phase over-complete sub-band transform
11131Zang Wenpeng Ding Jizheng Xu Hanqin Lu Feng Wu
Responses of CE1b in SVC: Direction prediction for spatial transform
11132Chen Jae Hoon Kim Joaquín López Antonio Ortega
Illumination compensation for inter view Multi View Video Compression
11133 Guillemot, Liebl, Stockhammer, Jenkac
Discussion on requirements and applications of Scalable Video Coding for MBMS
11134 Jeremie FarretOlivier Bellis Solid implementation into IM1
11135Chen Jae Hoon Kim Joaquín López and Antonio Ortega
Anchor encoding results for the ST and Aquarium multi view sequences
11136 Feng PanYin Sun
SVC CE1e - Verification of MSRA Results on MCTF adaptation in the temporal update step
42
11137 Joohee KimHyeyeon Kim Responses to SVC CE1a: scalable motion information coding
11138 HsinHao Chen Verification Report of Samsung results for SVC on CE1c: Intra-prediction
11139 Giovanni Cordara CE1a : cross verification of Samsung proposal
11140 Han-Kuang HsuHsueh-Ming Hang Verification of MSRA results for SVC on CE1b, entropy coding
43
Annex 4Output document list
No. Source Title6481 Convener List of Documents from the Redmond, USA Meeting6482 Convener Resolutions of the Redmond, USA Meeting6483 Convener List of AHGs Established at the 69th Meeting in Redmond, USA6484 Convener Report of the 68th Meeting in Redmond, USA6485 Convener Guidelines for Electronic Distribution of MPEG and WG 11 Documents6486 Convener Press Release of the 69th Meeting in Redmond, USA6487 Convener Meeting Notice of the 70th Meeting in Palma de Mallorca, ES6488 HoD Guide for WG 11 Meeting Hosts6489 HoD MPEG 1016490 Requirements MPEG-4/2 Profiles under Consideration6491 Requirements Study of FCD ISO/IEC 15938-96492 Requirements Requirements for MPEG-21 IPMP6493 Requirements Draft of PDTR for potential second edition of ISO/IEC 21000-116494 Requirements Call for Evidence for Multi-view Video Coding6495 Video Request for 14496-2:2004 Amd.2 6496 Video Text of 14496-2:2004 PDAM2 New Levels in Simple Profile6497 Video Request for 14496-4:2004 Amd.106498 Video Text of 14496-4:2004 PDAM10 New Levels in Simple Profile
Conformance6499 Systems Request for ISO/IEC 14496-20 Lightweight Application Scene
Representation and Simple Aggregation Format6500 Systems Text of ISO/IEC 14496-20 CD Lightweight Application Scene
Representation and Simple Aggregation Format6501 Requirements Requirements for Multi-view Video Coding6502 Convener AHG on Font Format Representation6503 Convener AHG on MPEG-21 Integration and Outreach6504 Convener AHG on MAF6505 Requirements Requirements for Scalable Video Coding6506 ISG Updated Call for the Submission of Hardware Reference Code for MPEG-4
Part 9: Reference Hardware Description6507 ISG Template for MPEG-4 Part 9 HDL module documentation6508 ISG CVS server user manual and code format specification for MPEG-4 Part-9
submissions and maintenance Rev. 0 6509 ISG Status of HDL submissions and commitments for MPEG-4 Part-96510 Convener AHG on MPEG-4 Part 9: Reference Hardware Description Phase 1 and 2.6511 ISG ISO/IEC FPDAM 15938-6 Information Technology -Multimedia Content
Description Interface- part 6: Reference Software Extensions6512 ISG DoC of ISO/IEC PDAM 15938-6 Information Technology -Multimedia
Content Description Interface- part 6: Reference Software Extensions6513 Testing Results of the visual assesment of the results of the CEs on Scalable Video
Coding Technology6514 Video MPEG-4 Visual: List of Problems Reported version 13.06515 Video WD 2.0 of 14496-4 Visual Bitstreams Conformance Corrigendum6516 Video WD 2.0 of MPEG-7 New Visual Extensions
44
6517 Video MPEG-7 Visual XM Document version 21.06518 Video Description of Core Experiments for MPEG-7 New Visual Extensions6519 Video WD 1.0 of ISO/IEC 21000-13 Scalable Video Coding6520 Video Scalable Video Model Version 2.06521 Video Description of Core Experiments in MPEG-21 Scalable Video Coding6522 Video Study of Video Coding Tools Repository6523 Convener AHG on Maintenance of MPEG-4 Visual related Documents, Reference
Software and Conformance6524 Convener AHG on Maintenance of MPEG-7 Visual related Documents and Reference
Software6525 Convener AHG on Description Tools for New Visual Extensions6526 Convener AHG on Core Experiments in Scalable Video Coding6527 Convener AHG on Scalable Video Model and SVC Reference Software6528 Convener AHG on 3DAV Coding6529 Convener AHG on Video Coding Tools Repository6530 Requirements M3W Requirements6531 Convener AHG on M3W6532 JVT Disposition of NB Ballot Comments on ISO/IEC 14496 4/FPDAM6 AVC
Conformance6533 JVT Text of ISO/IEC 14496-4/FDAM6 AVC Conformance6534 JVT Text of ISO/IEC 14496-4/PDAM9 AVC Fidelity Range Extensions
Conformance6535 JVT Disposition of NB Ballot Comments on ISO/IEC 14496 5/FPDAM6 AVC
and HE AAC Reference Software6536 JVT Text of ISO/IEC 14496 5/FPDAM6 AVC and HE AAC Reference Software6537 JVT Text of ISO/IEC 14496-5/PDAM8 AVC Fidelity Range Extensions
Reference Software6538 JVT Disposition of NB Ballot Comments on ISO/IEC 14496 10/FPDAM1 AVC
Professional Extensions6539 JVT Text of ISO/IEC 14496 10/FDAM1 AVC Fidelity Range Extensions6540 JVT Text of ISO/IEC 14496 10 Advanced Video Coding 3rd Edition6541 JVT Request for Corrigendum for ISO/IEC 14496-10 Advanced Video Coding6542 JVT Working Draft 1 of Corrigendum for ISO/IEC 14496-10 Advanced Video
Coding6543 SNHC AFX Reference software FPDAM76544 SNHC ISO/IEC 14496-16/PDAM16545 SNHC ISO/IEC 14496-16/DCOR16546 SNHC AFX CE description6547 SNHC AFX VM 15.06548 SNHC SNHC FAQ 12.06549 SNHC ISO/IEC 14496-21 WD 1.06550 Requirements Summary of font format standardization activities in WG116551 Liaison Liaison Statement to the Digital Media Project6552 Liaison Liaison Statement to the DCCSDP6553 Liaison Liaison Statement to the OMA6554 Liaison Liaison Statement to JTC 1/SC 376555 Liaison Liaison Statement to ITU-T SG 176556 Liaison Liaison Statement to ITU-R SG 6/WP 6M 6557 Liaison Liaison Statement to W3C on MPEG Timed Text specification
45
6558 Liaison Liaison Statement to Blu Ray Disk Founders6559 Liaison Liaison Statement to IEEE LTSC6560 Liaison Liaison Statement to SMPTE on OpenType® and ISO/IEC 14496-186561 Liaison Liaison Statement to W3C on Public Workshop on Metadata for Content
Adaptation6562 Liaison Liaison Statement to VCEG6563 Liaison Liaison Statement to TVAF6564 Liaison Liaison Statement to JSR-2396565 Liaison Liaison Statement to IEC TC 1006566 Liaison Liaison Statement to SMPTE on Alpha Channel and AVC/H.264 Frext6567 Liaison Statement of benefits from establishing a class C liaison with the DMP6568 Liaison Statement of benefits from establishing a class C liaison with the DCCSDP6569 Liaison Statement of benefits from establishing a class C liaison with the OMA6570 Liaison Responses to NB Comments6571 Liaison List of WG11 Liaisons6572 SNHC Request for ISO/IEC 14496-16/AMD16573 JVT Liaison statement to ATSC on ISO/IEC 14496 10 FRExt amendment work6574 JVT Liaison statement to AVS China on ISO/IEC 14496 10 FRExt amendment
work6575 JVT Liaison statement to DVB on ISO/IEC 14496 10 FRExt amendment work6576 JVT Liaison statement to DVD Forum on ISO/IEC 14496 10 FRExt amendment
work6577 JVT Liaison statement to EBU on ISO/IEC 14496 10 FRExt amendment work6578 JVT Liaison statement to IMTC on ISO/IEC 14496 10 FRExt amendment work6579 JVT Liaison statement to ITU-R SG 6 on ISO/IEC 14496 10 FRExt amendment
work6580 JVT Liaison statement to ITU-T SG 9 on ISO/IEC 14496 10 FRExt amendment
work6581 JVT Liaison statement to MPEGIF on ISO/IEC 14496 10 FRExt amendment
work6582 Systems Text of ISO/IEC 13818-1:2000/DCOR36583 Systems Study Text of ISO/IEC 13818-1:2000/FPDAM46584 Systems DoC on ISO/IEC 13818-1:2000/FPDAM56585 Systems Text of ISO/IEC 13818-1:2000/FDAM56586 Systems DoC on ISO/IEC 14496-1/DCOR36587 Systems Text of ISO/IEC 14496-1/COR36588 Systems Request of ISO/IEC 14496-1:2004 Amd.16589 Systems Text of ISO/IEC 14496-1:2004/PDAM16590 Systems DoC on ISO/IEC 14496-11/FPDAM36591 Systems Text of ISO/IEC 14496-11/FDAM36592 Systems DoC on ISO/IEC 14496-11/PDAM46593 Systems Text of ISO/IEC 14496-11/FPDAM46594 Systems Text of ISO/IEC 14496-11/COR26595 Systems Study Text of DoC on ISO/IEC 14496-12/FPDAM16596 Systems Study Text of ISO/IEC 14496-12/FPDAM16597 Systems Study Text of DoC on ISO/IEC 14496-17/FCD6598 Systems Study Text of ISO/IEC 14496-17/FCD6599 Systems Core Experiment on LASeR Binary Representation6600 Convener Terms of Reference
46
6601 Convener MPEG Standards6602 Convener Table of unpublished standards at FDIS level6603 Convener Work plan and time line6604 Convener Work item assignment6605 Convener List of patent statements received6606 Systems Core Experiment on LASeR Harmonization with SVG6607 Systems WD1.0 of ISO/IEC 14496-20 Reference Software6608 Systems Core Experiments for Systems Extensions6609 Systems MPEG-7 Systems reference software workplan6610 Systems DoC on ISO/IEC 21000-9/CD6611 Systems Text of ISO/IEC 21000-9/FCD6612 Systems Technology under consideration for 21000-96613 Systems Text of ISO/IEC 21000-16/CD6614 Convener AHG on XML Structure Binarization and Streaming6615 Convener AHG on Scene Representation6616 Integration ISO/IEC13818-4/FDAM1 IPMP Conformance Ext.6617 Integration DoC on ISO/IEC13818-4:200X/FPDAM2 Audio Conformance Ext.6618 Integration ISO/IEC13818-4:2004/FDAM2 Audio Conformance Ext.6619 Integration DoC on ISO/IEC 13818-5/PDTR IPMP Reference Software Ext.6620 Integration ISO/IEC 13818-5/Dam1 IPMP Reference Software Ext6621 Integration ISO/IEC 13818-5:1997/Amd1:1999/COR26622 Integration DoC on ISO/IEC 14496-4/FPDAM8 HE-AAC, ABIFS and SA
Conformance6623 Integration ISO/IEC 14496-4/FDAM8 HE-AAC, ABIFS and SA Conformance6624 Integration DoC on ISO/IEC13818-4/FPDAM1 IPMP Conformance Ext6625 Integration DoC on ISO/IEC 14496-5/FPDAM7 AFX reference software6626 Integration ISO/IEC 14496-5/FDAM7 AFX reference software6627 Integration DoC on ISO/IEC 21000-8/CD MPEG-21 reference software6628 Integration ISO/IEC 21000-8/FCD MPEG-21 reference software6629 Integration DoC on ISO/IEC 21000-12/PDTR Test Bed for MPEG-21 Resource
Delivery6630 Integration ISO/IEC 21000-12/DTR Test Bed for MPEG-21 Resource Delivery6631 Convener AHG on the Communicating MPEG to the business Community6632 Convener AHG on MPEG 1016633 MDS DoC on ISO/IEC 15938-5 FPDAM/26634 MDS ISO/IEC 15938-5 FDAM/2 “MDS User Preference Extensions”6635 MDS DoC on ISO/IEC 15938-5 DCOR/16636 MDS ISO/IEC 15938-5 COR/16637 MDS DoC on ISO/IEC 15938-7 FPDAM/16638 MDS ISO/IEC 15938-7 FDAM/16639 MDS DoC on ISO/IEC 15938-10 FCD 6640 MDS ISO/IEC 15938-10 FDIS “Schema Definition”6641 MDS DoC on 21000-2 CD 2nd Edition – Digital Item Declaration6642 MDS ISO/IEC 21000-2 DID 2nd Edition FCD6643 MDS Status of Registration Authority for DII6644 MDS ISO/IEC 21000-4 WD v.1 “IPMP”6645 MDS MPEG-21 REL/RDD Software Implementation Plan v.76646 MDS ISO/IEC 21000-6 DCOR/1 6647 MDS MPEG-21 DIA PDAM/1 “Conversions and Permissions”
47
6648 MDS ISO/IEC 21000-7 COR/1 WD v.16649 MDS MPEG-21 DIA Software Implementation Plan v.86650 MDS Workplan for Core Experiment on Text Capabilities of Terminals6651 MDS Workplan for Core Experiment on Conversion Parameters6652 MDS Workplan for Core Experiment on Bitstream Adaptation in Constrained and
Streaming Environments6653 MDS DoC on ISO/IEC 21000-10 CD6654 MDS ISO/IEC 21000-10 FCD “Digital Item Processing”6655 MDS MPEG-21 DIP Software Implementation Plan v.36656 MDS ISO/IEC 21000-15 WD v.2 “Event Reporting”6657 Convener AHG on Media Locators6658 Convener AHG on MPEG-21 IPMP6659 Convener AHG on MPEG-21 DIA6660 Convener AHG on MPEG-21 DIP6661 Convener AHG on MPEG-21 Event Reporting6662 Convener AHG on AFX documents, CEs, and software6663 Convener AHG on MPEG-J extensions for rendering6664 Convener AHG on Audio Standard Maintenance6665 Convener AHG on Spatial Audio Coding6666 Convener AHG on MPEG-4 Lossless Audio Coding6667 Convener AHG on Symbolic Music Representation6668 Convener AHG On Exploration of Scalable Audio and Speech Coding6669 Audio Text of 13818-7:2004/DCOR 1 “AAC ADTS buffer fullness correction”6670 Audio DoC on 14496-3:2001/FPDAM 3, MPEG-1/2 Audio in MPEG-46671 Audio Text of 14496-3:2001/FDAM 3, MPEG-1/2 Audio in MPEG-46672 Audio Text of 14496-3:2001/PDAM 4, Audio Lossless Coding (ALS)6673 Audio Text of 14496-3:2001/PDAM 5, Scalable Lossless Coding (SLS)6674 Audio Text of 14496-3:2001/FPDAM 6, Lossless coding of 1-bit oversampled
signals6675 Audio Formal Verification Report on MPEG-4 Parametric Audio Coding6676 Audio Status of Performance and Complexity of MPEG Lossless Audio Coding
Architectures6677 Audio Proposed 3rd Edition of 14496-36678 Audio Study on High-Sampling Rate for MPEG-1/2 Layer III6679 Audio Proposed Enhancements to MPEG-4 BSAC multi-channel6680 Audio Workplan for Audio Lossless Coding (ALS)6681 Audio Workplan for Scalable Lossless Coding (SLS)6682 Audio Timestamps and Audio Codec Behavior6683 Audio Status of MPEG-4 Audio Conformance6684 Audio Proposed New Audio Conformance Bitstreams for BSAC6685 Audio Workplan for Audio Rhythmic Pattern6686 Audio Application Formats Framework6687 Audio DoC on 23001-1:200X CD, “Player Application Format”6688 Audio Text of 23001-1:200X FCD, “Player Application Format”6689 Audio Call for Proposals for Symbolic Music Representation6690 Audio DRAFT SMR Evaluation Procedure6691 Audio Workplan for the Evaluation of Spatial Audio Coding Responses6692 Convener AHG on MPEG-7 Interoperability and Profiling6693 Convener MPEG Items Completed
48
6694 HoD MPEG General Audio Codecs6695 JVT Liaison statement to SCTE on ISO/IEC14496 10 FRExt amendment work6696 Convener AHG on MPEG-7 Audio6697 Audio Request for Subdivision to ISO/IEC 23000-1
49
Annex 5Report of Requirements meeting
Source: Rob Koenen, InterTrust Technologies
NB: this report does not duplicate the resolutions, but rather complements them. This implies that not all output documents and not all Ad Hoc Groups are explicitly listed in the report below.
Monday 9:00-13:00 opening plenary meeting 13:30-14:30 Lunch (ends one hour after plenary ends)
14:30-15:30
MPEG-21 Technical Reports – Requirements Plenary10876 Summary of Voting on ISO/IEC DTR 21000-1 (2nd Edition) - JTC 1 Secretariat 10887 Summary of Voting on ISO/IEC DTR 21000-11 [SC 29 N 6102] - JTC 1 Secretariat 10885 Video Extension to Evaluation Tools for PATs - Jong-Tae Kim, et,.al.10886 The Composition of Test Video Sequences for Evaluation of the robustness of Digital
Video Watermarking - Ik-Hwan Cho, Hae Kwang Kim, Weon-Geun Oh, Dong-Seok Jeong
10895 Transaction Watermarking Model for PAT - Won-Young Yoo, et.al.
Lassen
15:30-16:30
Joint with JVT10867 AVC FRExt Level Requirements for D-Cinema and High Quality […] - Tom McMahon11017 Definition of a 4:2:0 / 8-bit Profile for H.264/AVC FRExt - Thomas Wedi, et.al.11116 Liaison Statement from Blu Ray Disk Founders - BD Founders via SC 29
Cascade
17:00-18:00
IPMP Responses and Associated Submissions – Joint with MDS and Systems Transfer of the work from Requirements to standards development
10813 Overview of responses to Call for Proposals for 21 IPMP - Niels Rump, Simon Watt10860 Response to CfP for 21 IPMP - Ian S Burnett, Gerrard Drury10865 Answer to CfPs for 21 IPMP - J. J. Chae, J. Nam, B. J. Kim, J. W. Hong10866 The DRM Framework for Large-scale Broadcast - Bin Li, et.al. 10945 Comments of the proposed document M10865 - J. J. Chae et.al.10850 ENTHRONE answer to the Call for Proposal for 21 IPMP - Serrao, Kudumakis10858 IPMP_Scheme Descriptor and its Processing for DI Protection – ZY Huang et.al.10990 Suggestions on the scope of 21 IPMP Standardization - Ji Ming, e.al.10832 DMAG answer to 21 IPMP Call for Proposals - Eva Rodriguez, et.a.10839 Answer to […]: Medialiving technology - Melanie Dulong de Rosnay, e.al.10854 MOSES and ENTHRONE answer to the 21 IPMP CfP - Panos Kudumakis , et.al.10855 Answer […]: A Right Description Model on Resource Combinations - Hendry, e.al.10856 Answer […] An IPMP Description Tool for Partial Encryption of DI’s - Jeongyeon Lim,
et.al.10857 Answer to the CfP on 21 IPMP : REL DIBOs in 21 DIP for 21 IPMP - Hendry, et.al.10862 Answer to the CfP on 21 IPMP - Craig Schultz
Lassen
Tuesday
09:00-11:00
MPEG-4 Visual Profiles, joint with Video11041 MPEG4 Simple-Profile Level 4 and 5 Proposal - Joseph Meehan, e.al.10910 USNB Contribution: The need for additional levels for Visual SP - USNB
SVC Requirements – Joint with Video10822 Scalable Video Coding Requirements for Video Surveillance Systems - Robert
Prandolini10901 THOMSON requirements for Scalable Video Coding - Francois Edouard, Vieron
Jerome10995 France Telecom Requirements for Scalable Video Coding - Pateux, Amonou,
Kervadec10998 Requirements for a scalable video coding standard - Bäse, Hutter, Amon11067 Requirements for SVC for Video Surveillance Applications - Reichel, et.el.11106 Mobile communications industry comments on SVC requirements - Justin Ridge, et.al. 10932 Discussion on requirements and applications for Scalable Video Coding - Ulrich
Benzler11082 FNB Position on SVC Standardization - French National Body
Kodiak
50
11:00-11:45
MAF – joint with Systems, Audio, Video, MDS10762 AHG on Multimedia Application Format (MAF) - Wo Chang, Olivier Avaro10961 MAF Reference Software Workplan Proposal - Wo Chang, Schuyler Quackenbush10962 MAF File Format Proposal - Wo Chang
MAF Requirements
Audio
11:45-12:45 Joint with Audio10906 USNB Contribution: Proposed CfP for Scalable Audio under MPEG 21 - USNB Audio
13:00-14:00 Lunch
14:00-15:00
Joint with Systems10893 SMPTE Liaison to MPEG on OpenType® and ISO/IEC 14496-18 - Wendy Aylsworth,
et.al.10912 Proposed conversion of OpenType to an ISO/IEC standard - A. G. Tescher for USNB
Lassen
15:00-16:30
MPEG-21 Requirements – joint with MDS (and Systems for the Binarization)10774 Requirement for 21 Binarization - Thomas DeMartini10848 Application Specific Binary Coding (ASBC) of 21 descriptors for better coding
efficiency maintaining interoperability to regular 21 decoder - Itaru Kaneko et.al. (briefly)
10807 Relationship between Digital Items and Digital Item Declarations - Niels Rump, Chris Barlas
10892 Identification of a DIDL Document - Bekaert, DeMartini, Van de Walle, Van de Sompel11110 Comments on Identification of DID a Document - Gerrard Drury, Ian Burnett11081 Requirement for 21 DID - Bekaert, De Keukelaere, Van de Sompel, Van de Walle
Lassen
16:30-17:00
MPEG-21 Joint with Integration, MDS10869 21 Integration and Outreach - Chris Barlas, et.al.10874 Improving 21 IPMP Conformance - Experience from 2/4 IPMPX – Spencer Cheng,
et.al.
Lassen
17:00-18:00 Review of IPMP work (joint with MDS?) LassenWednesday
09:00-11:00
Plenary meeting
11:30-13:00
MPEG-7 Profiles etc. – joint with MDS, others10763 AHG on 7 Profiles - Wo Chang, Akio Yamada, Alan Melby10940 7 User Description Profile Update - Peter van Beek10960 Update M7ITB Testbed and Available Tools for 7 Bitstreams Repository - Wo Chang11023 Some thoughts on 7 Profiling - Masanori SANO11024 7 Core Description Profile Update - Masanori SANO11147 Liaison Statement from IEEE-LTSC - IEEE-LTSC
Lassen
13:00-14:00 Lunch
14:00-14:30M3W – Joint with Systems
10900 Contribution to MPEG Multimedia Middleware Requirements v.1.0 - Jean H.A.Gelissen
Lassen
14:30-16:30
16:30-17:00 Joint with MDS on MPEG-21 IPMP Progress10861 Response […]: Reference Model for IPMP Assessment - Sang-Hoon Oh, et.al. Lassen
17:00 - later Social Event Museum
Thursday09:00-09:15 OpenType as MPEG spec – joint with Systems Lassen
09:30-11:00Persistent Association Technologies, 3DAV, SVC and – joint with Video
(Final?) Approval of SVC Requirements Document (Final?) Approval of 3DAV Requirements Document
Kodiak
11:00-12:00 OpenType as MPEG spec – joint with Systems Lassen
12:30-13:00 Joint with JVT on FRExt Profiles (Naming and Levels) Cascade
13:00-14:00 Lunch 14:00-14:30 Symbolic Music Representation – joint with Audio
Approval of CfP Lassen
14:30-15:30MAF Joint Meeting with Audio, Video, MDS, Systems (and Wo)
MAF FCDMAF Requirements Document?
Lassen
15:30-16:45 Approval of Study of MPEG-7 Profiles FCD Lassen
51
Friday
09:00-10:00
ConcludingSVC Requirements – Ulrich BenzlerMPEG-4/2 Profiles under Consideration – Kristofer KjörlingM3W Requirements - Jean GelissenMPEG-21 IPMP Requirements document – Brad
Lassen
12:30-14:00 Lunch 14:00-22:10 Plenary meeting Audito
52
MPEG-4
Part 2: Adding Levels 4a and 5 to Simple Visual Profile11041 MPEG4 Simple-Profile Level 4 and 5 Proposal - Joseph Meehan, e.al.10910 USNB Contribution: The need for additional levels for Visual SP - USNB
Levels like these are already used in industry, without being based on an actual MPEG-defined conformance point. They extend the range of Simple Visual Profile to higher bitrates and resolutions. Adding them to MPEG-4 Visual as compliance points is a good idea. Enough support was shown from industry in m11041. Level 4a is slightly different than 4 in Advanced Simple because VGA resolution is the target. The Video group will start an Amendment.
Need to produce and cross-check the bitstreams: TI, Sarnoff, VBrick, Xilinx committed to doing this work. It was agreed that Advanced Simple @ Lx decoder should be able to decode Simple @Lx bitstreams to keep that part of the hierarchy.
Part 3: New Audio Profile?A request was put forward in a joint meeting with Audio for the definition of a new MPEG-4 Audio profile that combines AAC, SBR and Parametric Stereo tools. The proposed profile was added to the Profiles under Consideration document (N6490), and the requirements Group asked for support in a resolution.
Part 10: AVC FRExt Profiles (Joint discussions with JVT)11017 Definition of a 4:2:0 / 8-bit Profile for H.264/AVC FRExt - Thomas Wedi, et al.11116 Liaison Statement from Blu Ray Disk Founders - BD Founders via SC 29 Secretariat10867 AVC FRExt Level Requirements for D-Cinema and High Quality […] - Tom McMahon
The 4:2:2/8 profile was dropped. Several proposals were discussed for merging two profiles into one, possible addressing some factors in the Level definitions, but that approach was rejected. In the end, the following profiles were defined, with their names:
4:2:0/8 bit: High 4:2:0/10: High 10 4:2:2/10: High 4:2:2 4:4:4/12: High 4:4:4
Part 18 (?): OpenType as MPEG-4 part?10893 SMPTE Liaison to MPEG on OpenType® and ISO/IEC 14496-18 - Wendy Aylsworth, et.al.10912 Proposed conversion of OpenType to an ISO/IEC standard - A. G. Tescher for USNB
OpenType was selected a technology in the past, and met the requirements. At that point it could only be referenced by MPEG because necessary copyrights were not released to ISO for producing and ISO standard. Copyright. There is now a new desire to have this as a formal ISO standard. It is understood that MPEG usually does not rubberstamp external specifications, and also in this case a process would be followed starting with the past assessment in MPEG on font representation technology. There is a requirement to that this new part of the MPEG-4 standard do not break any references, when such references to OpenType are replaced by references to this MPEG-4 part (applies to both MPEG and non-MPEG standards).
53
An assessment (N6440) was written that summarizes the past work and lists past recommendations and conclusions. The new work would start from the past efforts.
MPEG-710763 AHG on 7 Profiles - Wo Chang, Akio Yamada, Alan Melby10940 7 User Description Profile Update - Peter van Beek10960 Update M7ITB Testbed and Available Tools for 7 Bitstreams Repository - Wo Chang11023 Some thoughts on 7 Profiling - Masanori SANO11024 7 Core Description Profile Update - Masanori SANO
A study of FCD (N6491) was created that corrects some inconsistencies in the FCD. It also clarified the difference between description profiling and systems profiling: description Profiles collect restrictions on the pure declarative XML. Systems Profiles collect restrictions on what will actually happen to them if they are binarized, transmitted, stored, etc.
11147 Liaison Statement from IEEE-LTSC - IEEE-LTSCMPEG looks forward to receiving the mapping of metadata as described in this liaison contribution.
MPEG-21
Part 2: ID for DID document?10807 Relationship between Digital Items and Digital Item Declarations - Niels Rump, Chris Barlas10892 Identification of a DIDL Document - Bekaert, DeMartini, Van de Walle, Van de Sompel11110 Comments on Identification of DID a Document - Gerrard Drury, Ian Burnett
The issue of having an ID for a DID document was resolved. The resolution is detailed in the MDS report.
Part 4: MPEG-21 IPMP10813 Overview of responses to Call for Proposals for 21 IPMP - Niels Rump, Simon Watt10860 Response to CfP for 21 IPMP - Ian S Burnett, Gerrard Drury10865 Answer to CfPs for 21 IPMP - J. J. Chae, J. Nam, B. J. Kim, J. W. Hong10866 The DRM Framework for Large-scale Broadcast - Bin Li, et.al. 10945 Comments of the proposed document M10865 - J. J. Chae et.al.10850 ENTHRONE answer to the Call for Proposal for 21 IPMP - Serrao, Kudumakis10858 IPMP_Scheme Descriptor and its Processing for DI Protection – ZY Huang et.al.10990 Suggestions on the scope of 21 IPMP Standardization - Ji Ming, e.al.10832 DMAG answer to 21 IPMP Call for Proposals - Eva Rodriguez, et.a.10839 Answer to […]: Medialiving technology - Melanie Dulong de Rosnay, e.al.10854 MOSES and ENTHRONE answer to the 21 IPMP CfP - Panos Kudumakis , et.al.10855 Answer […]: A Right Description Model on Resource Combinations - Hendry, e.al.10856 Answer […] An IPMP Description Tool for Partial Encryption of DI’s - Jeongyeon Lim, et.al.10857 Answer to the CfP on 21 IPMP : REL DIBOs in 21 DIP for 21 IPMP - Hendry, et.al.10862 Answer to the CfP on 21 IPMP - Craig Schultz
The MPEG-21 IPMP work was transferred to the MDS group. With relevant experts, this group started to look at integration, analyzing simple uses. That work will continue in an AHG meeting. Please see the MDS report for details.
10861 Response […]: Reference Model for IPMP Assessment - Sang-Hoon Oh, et.al.What was presented in this contribution would not be applicable to the current evaluation of proposals, but could become something along the lines of the PAT Technical Report, but now for IPMP tools. The group decided that more clarity on the nature of MPEG-21 IPMP was needed before the merit of the proposal could be discussed,
10874 Improving 21 IPMP Conformance - Experience from 2/4 IPMPX - Spencer Cheng, et.al.
54
Contribution presented interesting tools. Again, the group wanted to first see more clarity on what MPEG-21 IPMP is before making/discussing more concrete proposals.
Part 11: Persistent Association Technologies10876 Summary of Voting on ISO/IEC DTR 21000-1 (2nd Edition) - JTC 1 Secretariat 10887 Summary of Voting on ISO/IEC DTR 21000-11 [SC 29 N 6102] - JTC 1 Secretariat
Technical Reports of part 1 and 11 were approved as there were no comments in the respective ballots; both will now be published.
10885 Video Extension to Evaluation Tools for PATs - Jong-Tae Kim, et,.al.This contribution proposes to extend PAT with Video-specific information. See below for the discussion.
10886 The Composition of Test Video Sequences for Evaluation of the robustness of Digital Video Watermarking - Ik-Hwan Cho, Hae Kwang Kim, Weon-Geun Oh, Dong-Seok Jeong
Contribution suggests adapting choice of sequences for to watermarking techniques? Inclusion of recommendations on sequences seems a good idea. Individual sequences could be included or referenced depending on their copyright.
10895 Transaction Watermarking Model for PAT - Won-Young Yoo, et.al.No reference model for transactional watermarking yet in the PAT Technical Report (this is also called ‘active fingerprinting’). This was considered a good use case for both audio and video. The contribution provides test parameters for Video transactional watermarks
After hearing these contributions, the group discussed extending the PAT work towards video, as had been the original intention. The requirements Group thinks this is a good idea, and it could be done in a second edition if there are enough experts to complete the task. In a joint meeting with Video, this was discussed, and some support was given. The group decided to start the work in an AHG – but the AHG was unfortunately never approved in the final MPEG plenary due to an oversight (the work is now going to be done and contributed to the next meeting by individual MPEG members). A proposal for a Working Draft for a 2nd edition was approved (N6493)
At next meeting, we will assess the support for the activity and decide future actions.
Part 13: SVC10822 Scalable Video Coding Requirements for Video Surveillance Systems - Robert Prandolini10901 THOMSON requirements for Scalable Video Coding - Francois Edouard, Vieron Jerome10995 France Telecom Requirements for Scalable Video Coding - Pateux, Amonou, Kervadec10998 Requirements for a scalable video coding standard - Bäse, Hutter, Amon11067 Requirements for SVC for Video Surveillance Applications - Reichel, et.el.11106 Mobile communications industry comments on SVC requirements - Justin Ridge, et.al. 10932 Discussion on requirements and applications for Scalable Video Coding - Ulrich Benzler
There were many requirements contributions, which is a positive sign indicating interest for the work. Together, these present an analysis of requirements from the different viewpoints of various industries. The break-out group analyzed the requirements and derived an overall prioritization, denoted by ‘shall’, ‘should’, and ‘may’. There were some conflicting requirements; scalability was seen as more important to some than to others. The mobile industry seems to be ready to use it if it exists, but only if it doesn’t compromise efficiency. The surveillance industry seems to be willing to take some decrease in coding efficiency in return for scalability. A table was added to the Requirements Document (N6505) that summarizes the requirements from different constituencies. Wording was added to stress that different industries have different priorities, and that the codec will ideally accommodate these requirements as different modes.
55
10853 Finnish NB comment: SVC requirements and directions - Mauri VäänänenFinnish NB presented a contribution on requirements. It requests AVC as a base layer and calls attention to the importance of low delay (both are now adequately reflected in the Requirements Document) and remarks that some scenarios are unrealistic, but fails to mention which exactly.
11082 FNB Position on SVC Standardization - French National BodyThe French NB calls for the work not to be delayed. The meeting confirmed there are no plans to delay the work.
Binarization Tuesday 20 July 2004, 15:05 (Binarization)10774 Requirement for 21 Binarization - Thomas DeMartiniRequirement that (de)binarization process is neutral with respect to canonicalization was added to
requirements document (N6492)
10848 Application Specific Binary Coding (ASBC) of 21 descriptors for better coding efficiencyIt was suggested that this could be done using DIXO’s. MDS will study and revisit the request if this not the case
11081 Requirement for 21 DID - Bekaert, De Keukelaere, Van de Sompel, Van de WalleThe requirement was changed to
4.2.4.3 Support expressing the equivalence (including bit-equivalence) of Media resources in an unambiguous and interoperable way
and accepted in the MPEG-21 Requirements Document.
MPEG-21 Outreach10869 21 Integration and Outreach - Chris Barlas, et.al.The perception among some outside of MPEG (and even some insiders) is that “MPEG-21 is complicated set of specifications”. This work should mitigate that impression by mapping concrete MPEG-21 technologies on actual business practices. The activity would then explain how the different elements can be integrated to suit the needs of a particular industry. The group thought this was an excellent idea. It was decided to start with the motion pictures industries in an AHG.
MAF (MPEG-A)10762 AHG on Multimedia Application Format (MAF) - Wo Chang, Olivier Avaro10961 MAF Reference Software Workplan Proposal - Wo Chang, Schuyler Quackenbush10962 MAF File Format Proposal - Wo Chang
MAF Requirements The MAF’s are going to FCD at this meeting. We had a discussion on which file format to use, together with Systems, Video and Audio groups. It was decided that the ISO file format, with .mp4 extension, would be most appropriate. The file could contain MPEG-21 specific data and MPEG-4 players without knowledge of MPEG-21 would be able to understand that this is data they don’t understand – and to skip it. It was noted that play lists are more elegantly and compactly done in MPEG-21 than in MPEG-7. A remaining question is whether the MPEG-21 data should be XML or binary or if both would be allowed.
56
Explorations
Scalable Audio Coding10906 USNB Contribution: Proposed CfP for Scalable Audio under MPEG 21 - USNB A proposal for a new work item for scalable audio coding contained different elements. The discussion focused on whether this work would concentrate on:
Scalable coding, or Generic Coding, harmonizing Speech and Audio, or both simultaneously
Applications would include multicast scenarios, with truncation at points of replication, and applications that don’t know in advance what the source is going to be. Uses cases need to be developed and the desirable compression efficiency, functionality and other benchmarks need to be documented. Comparisons to the state of the art would be included in a requirement study.
It was considered too early to issue any public Call for Information at this meeting. MPEG should first get an internal understanding on the goal and merits of such a new work item before inviting external comments.,
3DAVA preliminary Call for Evidence (N6494) was approved and issued for Multiview Video Coding. The accompanying requirements (N6501), extracted from the general 3DA requirements, were approved as well.
Symbolic Music RepresentationThe Requirements group reviewed and approved the Call for Proposals for Symbolic Music Representation, edited by the Audio Group. The evaluation procedure was still draft, and was therefore put into a separate document.
M3WA new version of the requirements document was approved (N6530). It is worth noting that requirements were added for the management of multimedia resources.
57
Annex 6Report of Systems meeting
Source: Systems Chair and Break-out group ChairsTitle: Systems Meeting ReportEditor: Olivier Avaro (France Telecom R&D)
Contributors: Olivier Avaro (France Telecom R&D), Claude Seyrat (Expway), Oliver Baum (Fraunhofer IIS), David Singer (Apple)
OverviewThe main outputs of the meeting from the Systems Sub-group perspective are:
No. Title TBP Available
13818-1:2000/DCOR.3 Correction for Field Picture6582 Text of ISO/IEC 13818-1:2000/DCOR3 No 04/07/23
13818-1:2000/Amd.4 Metadata Application Format CP6583 Study Text of ISO/IEC 13818-1:2000/FPDAM4 No 04/07/23
13818-1:2000/Amd.5 New Audio P&L Signaling6584 DoC on ISO/IEC 13818-1:2000/FPDAM5 No 04/07/236585 Text of ISO/IEC 13818-1:2000/FDAM5 No 04/07/23
14496-1 :2003/Cor Items for Corrections6586 DoC on ISO/IEC 14496-1/DCOR3 No 04/07/236587 Text of ISO/IEC 14496-1/COR3 No 04/07/23
14496-1 :2003/Amd.1 Text Profile Descriptor6588 Request of ISO/IEC 14496-1:2004 Amd.1 No 04/07/236589 Text of ISO/IEC 14496-1:2004/PDAM1 No 04/07/23
14496-11 :2003/Amd.3 Audio BIFS Extensions6590 DoC on ISO/IEC 14496-11/FPDAM3 No 04/07/236591 Text of ISO/IEC 14496-11/FDAM3 No 04/07/23
14496-11:2003/Amd.4 XMT and MPEG-J Extensions6592 DoC on ISO/IEC 14496-11/PDAM4 No 04/07/236593 Text of ISO/IEC 14496-11/FPDAM4 No 04/08/136594 Text of ISO/IEC 14496-11/COR2 No 04/07/23
14496-12:2003/Amd.1 ISO File Format Extensions6595 Study Text of DoC on ISO/IEC 14496-12/FPDAM1 No 04/07/236596 Study Text of ISO/IEC 14496-12/FPDAM1 No 04/07/30
14496-17 Streaming Text Format6597 Study Text of DoC on ISO/IEC 14496-17/FCD No 04/07/236598 Study Text of ISO/IEC 14496-17/FCD No 04/07/30
14496-20 LASeR6499 Request of ISO/IEC 14496-20 No 04/07/236500 Text of ISO/IEC 14496-20/CD No 04/07/236599 Core Experiment on LASeR Binary Representation No 04/07/236606 Core Experiment on LASeR Harmonization with SVG No 04/07/236607 WD1.0 of ISO/IEC 14496-20 Reference Software No 04/07/23
58
15938-1 Systems6608 Core Experiments for Systems Extensions No 04/07/236609 MPEG-7 Systems reference software workplan No 04/07/23
21000-9 MPEG-21 File Format6610 DoC on ISO/IEC 21000-9/CD No 04/07/236611 Text of ISO/IEC 21000-9/FCD No 04/07/306612 Technology under consideration for 21000-9 No 04/07/30
21000-16 MPEG-21 Binary Format6613 Text of ISO/IEC 21000-16/CD No 04/07/23
Explorations and Support6530 Requirements on the MPEG Multimedia Middleware No 04/07/23
General issues
GeneralThe meeting report from München has been approved.
List of standards under development
Pr
Pt Edit.
Project
Description CfP WD CD FCD FDIS
2 1 2000 Amd.4 Metadata Application Format CP
03/10
04/03
04/10
2 1 2000 Cor.3 Correction for Field Picture 04/07
04/10
4 1 2004 Amd.1 Text Profile Descriptors 04/07
05/01
05/07
4 11 2003 Amd.4 XMT and MPEG-J Extensions
03/10
03/12
04/07
05/01
4 17 2003 1st Ed. Streaming Text Format 03/03
03/07
03/12
04/10
4 20 2004 1st Ed. Lightweight Application Scene
04/03
04/07
04/10
05/03
21 9 200x 1st Ed. File Format 03/12
04/03
04/07
05/01
21 16 200x 1st Ed. Binary Format 04/03
04/07
04/10
05/03
Standing Documents
Pr
Pt Documents No. Meeting
4 13 MPEG IPMP Extensions Overview N6338 04/03 München21 xx MPEG Multimedia Middleware Context and
ObjectivesN6335 04/03 München
59
DemonstrationsNone.
FAQThe FAQ were updated as needed.
AOBNone.
60
MPEG-2 Systems (13818-1)
13818-1:2000 Amd.4
Topics1. ISAN and VISAN Signaling.
ContributionsM10920: Document not available. In addition, WG11 received feed-back from its members that client bodies for this technology were preparing a thorough review of the current document. In order to benefit from this important feed-back and because there were no opposition, it is decided to delay the progression of this specification until the next meeting.
Technical Work in Progress.
13818-1:2000 Amd.5
Topics1. New Audio Profile and Level Indication; 2. Audio_Type Table split for ISO reserved and User Private
ContributionsM10921: See DoC and Text of Amd.
Technical Work Finalized.
13818-1:2000 Cor. 3
Topics1. Correction on Field Picture
ContributionsM10911: USNB Contribution: Suggested corrigendum to 13818-1:2000 related to MPEG-2 field pictures. Suggestion accepted and corrigendum started.
Technical Work in Progress.
MPEG-2 Exploratory Activities
TopicsM10907: USNB Contribution: Response to Munich resolution 2.2.3. on the consideration of the potential for definition of a form of ISO/IEC 13818-1 (MPEG-2 Systems) operation in which the PCR requirement is relaxed. Concern regarding potential interoperability problems that could be caused by the relaxation of the PCR requirement (or the creation of a separate profile or similar domain-specific difference in MPEG-2 TS requirements for this purpose). Suggestion to use of the "Private Stream" feature (preferably with registration of the Private Stream type) to support the desired functionality, as the MPEG-2 TS PCR is optional for such streams. Noted.
61
MPEG-4 Systems (14496-1)
14496-1:2003 Cor. 3M10844 : Summary of Voting on ISO/IEC 14496-1:2001/DCOR 3. GNB comment. Already taken into account in 3rd Ed (considered as editorial).
Technical Work Finalized.
14496-1:2003 Amd.1M10905: Proposal to amend ISO/IEC 14496-1:2004. Proposition accepted. Production of request of CD and CD.
Technical Work in Progress.
62
MPEG-4 Scene Description (14496-11)
14496-11:2003 Cor. 2
Topics1. Miscellaneous Corrigenda Item.
ContributionsM10845: No comment. Promotion to Cor.
Technical Work Finalized.
14496-11:2003 Amd.3
Topics1. Advanced Audio Buffer Node;2. AudioChannelConfig;3. Pre-defined effects using ExterProto;4. Support for Ambisonic.
ContributionsM10924, M11028: See DoC and Text of FDAM.M11029: See Integration report.
Technical Work Finalized.
14496-11:2003 Amd.4
Topics1. XMT Extensions;2. MPEG-J Extensions.
ContributionsM11109: Update of XMT-A and MPEG-J standards. Proposed re-organization of the XMT-A schema to facilitate maintenance of the specification. Accepted. Proposed updates of MPEG-J APIs. Accepted. Note that it would be good to have the template of the nodes made publicly available. Decision to make it available on the CVS under MPEG-4 Systems 2 as well as the executable that generates the various Systems documentation (Mikael).
M10881: KNB comment on 14496-11/PDAM4 (XMT & MPEG-J Extensions).
M10787: See DoC and Text of FPDAM.
Technical Work in Progress.
63
ISO File Format (14496-12)
14496-12:2003 Amd.1
Topics1. Support for Static Metadata;2. Support for IPMP at the File Format Level.
ContributionsM10927, M10872, M1100: See DoC and Text of FDAM.
Considered NB Comments from Sweden, Finland, UK, US, Singapore on 14496-12, prepared DoCR, FDAM in one week. Request approval for the FDAM and a second edition now, contingent on (1) no more NB comments being received and (2) on the FDAM ballot passing.
M10930: Proposal for amendment of ISO/IEC 14496-14. Not needed. Registration will be done through the RA.
Technical Work Finalized.
64
Streaming Text (14496-17)
Topics1. Coded Representation of Text Stream.
ContributionsM10913: USNB Contribution: ISO/IEC 14496-17/FCD concerns. Refers to comments made in M10838. See disposition of comments.
M10803, M10838: W3C Comments on the MPEG Timed Text specification, Summary of Voting on ISO/IEC FCD 14496-17. See disposition of comments.
M11027: Inputs on study text of timed text FCD (part 17). Taken into account in the production of Study text.
Technical Work in Progress.
65
Font Compression and Streaming (14496-18)
Exploratory Activities
Topics1. OpenType Standardization
ContributionsM10893, M10912: SMPTE Liaison to MPEG on OpenType® and ISO/IEC 14496-18 and USNB. Proposed conversion of OpenType to an ISO/IEC standard. OpenType was already selected in response to the Call on Font Format Representation and Compression. OpenType was used as an external normative reference. Agreement that OpenType can be standardized if due process is followed. The technology already fit in the scope of the previous Call on Font Representation. Owners of the OpenType solutions shall propose it as an input contribution with appropriate copyright statement.
Technical Work in Progress.
66
LASeR (14496-20)
Topics1. Lightweight Application Scene Representation
ContributionsM10812, M10814, M10815, M10816, M10817, M10818, M10819, M10820: Answers to the CfP on LASeR and SAF. All answers were processed at the Paris meeting and reviewed during the AHG in Redmond as well as in the Systems subgroup. Results of this evaluation process is reflected in M10836 (Report of the LASeR evaluation meeting ), M10833 (Proposed WD 0.1 of ISO/IEC 14496-20, LASeR and SAF), M10834 (Proposed Draft Core Experiment on LASeR Harmonization with SVG), M10835 (Proposed Draft Core Experiment on LASeR Binary Representation) and M10837 (LASeR software).
M10884: Proposal on SL-compliant SAF packet headers. This contribution was discussed and used to harmonized the draft WD as much as possible with 14496-1. Results of this discussion is reflected in the LASeR CD.
M10982, M10999: Comments on LASeR Harmonization with SVG. Comments on LASeR and SVG. Used to progress the harmonization process with SVG.
M11057: FNB comment on LASeR. Noted. The LASeR specification progressed as planned and the WD1.0 was promoted to CD.
Technical Work in Progress.
67
MPEG-7 Systems (15938-1)
GeneralJoint meeting about MPEG-7 profile
M11023: Some thoughts on MPEG-7 Profiling: Some very first proposal about MPEG-7 Systems profiles and levels have been proposed:
- levels: AU size, AU granularity, AU synchronization with the media. - Profiles: exclusive use of TeM and BiM, joint use of BiM and TeM.
M11004: MPEG-7 Systems extensions, TVAnytime indexing core experiments: Adapt TV-Anytime indexing solution to B-Tree indexing and evaluate options (index size and performance). Use the extended test set. The contribution shows that index list and B-tree indexes have complementary usage mostly dependent on application usage. Therefore the contribution recommends not dropping Index list in favour of B-Tree. Contribution m11004 is adopted as a base for a first draft which is included a core experiment about indexing. A core experiments is set up to evaluate the integration within the MPEG-7 Systems framework and to clarify use cases covered by this technology.
M11034: CE-Report on Evaluations of the Siemens Index System: The contribution presents results of the core experiments related to indexing BiM bitstreams.
M11036: Stream Reordering for Fast Random Access: The contribution presents possible improvements of the indexing framework to provide more random access functionalities. Further work on this item is welcome.
Technical Work in Progress.
68
MPEG-21 File Format (21000-9)
21000-9
Topics1. MPEG-21 File Format
Contributions
M10914, M10852: Considered NB Comments from US, Korea on 21000-9, prepared DoCR, FCD available in a week. Request NBs to look at the technologies under consideration.
Given ongoing work on new tools in MPEG-21 such as IPMP, and Event Reporting, should the file format be delayed in case this work affects it? Or should it proceed on schedule as we expect little or no impact, or the delay would be unacceptable? The ad-hoc recommends proceeding.
Systems like the secretariat to be asked to include 14496-12 second edition (see below) with any purchase of 21000-9. See Systems res.
Realized, with MDS, that we need a URL fragment syntax for ISO-family files, would like contributions on requirements and solutions. We adjusted the fragment syntax for MPEG-21 files, to leave 'space' for this work. These fragments (the part after a "#" in a URL) might include stream selection, time selection, sub-scene or object selection, selection based on meta-data, and so on.
The current file format (Part 12) allows meta-data boxes within (and thus attached to) presentations (moov box) and streams (trak box). This is appropriate for meta-data attached to media-data. It also allows a meta-box at file level when the meta-box contains the primary entry point into the file, such as an MPEG-21 DID. MPEG-7 is currently allowed in all three places. Is there, however, meaning to MPEG-7 meta-data that is not attached to media data? Allowing this effectively defines an MPEG-7 packaged file format, which perhaps is not desired.
Technical Work in Progress.
69
MPEG-21 Binary Format (21000-16)
21000-16
Topics1. Binarization of MPEG-21 Data
ContributionsM10774: Requirement for MPEG-21 Binarization. Contribution about schema based canonicalization requirements. This requirement is already satisfied by BiM. Accepted.
M10848: Application Specific Binary Coding (ASBC) of MPEG-21 descriptors for better coding efficiency maintaining interoperability to regular MPEG-21 decoder: The contribution proposes to use specific schema within the MPEG-21 framework assuming that mapping with MPEG-21 schemas is available. Further work is expected within DIP to understand the applicability of this proposal in MPEG-21. Application specific coding should be evaluated in relation with MPEG-21 DIP.
M10974: Report of CE on MPEG-21 Binarisation. This contribution presents the results of the MPEG-21 binarization. Significant testset has been gathered and binarization tests conducted. Several bugs have been identified.
Technical Work in Progress.
70
Multimedia Application Formats (23000)
Topics1. Application specific format framework;2. Usage of MP3 in MP4 with metadata;3. Usage of JPEG in MP4 with metadata.
ContributionsM10961, M10962: See REQ and Audio meting report.
Technical Work in Progress.
71
Other Exploratory Activities
Multimedia Middleware
Topics1. Use cases;2. Middleware Architecture;3. Multimedia APIs.
ContributionsM10900: Contribution to MPEG Multimedia Middleware Requirements v.1.0. Working session to complete the requirements document with multimedia specific requirements. Requirements updated.
Technical Work in Progress.
72
Latest References and Publication Status
Pr Pt Standard No. Issue Status Doc. with Purpose2 1 ISO/IEC 13818-1/Amd.7 Published 2000/122 1 ISO/IEC 13818-1:2000 (MPEG-2 Systems 2nd
Edition)00/12 Published 2000/12
2 1 ISO/IEC 13818-1:2000/COR1 (FlexMux Descr.) N3844 01/01 Pisa Published 2002/032 1 ISO/IEC 13818-1:2000/Amd.1 (Metadata on 2) + COR2 N5867 03/07
TrondheimPublished 2003/12
2 1 ISO/IEC 13818-1:2000/Amd.2 (Support for IPMP on 2) N5604 03/03 Pattaya Published 2004/032 1 ISO/IEC 13818-1:2000/Amd.3 (AVC Carriage on MPEG-
2)N5771 03/07
TrondheimFDAM ITTF FDAM 04/04/26
2 1 ISO/IEC 13818-1:2000/Amd.5 (New Audio P&L Sig.) N6585 04/07 Redmond
FDAM ITTF FDAM Ballot
2 11 ISO/IEC 13818-1:2003 (IPMP on 2) N5607 03/03 Pattaya Published 2003/124 1 ISO/IEC 14496-1 (MPEG-4 Systems 1st Ed.) Published 1999/124 1 ISO/IEC 14496-1/Amd.1 (MP4, MPEG-J) Published 2001/114 1 ISO/IEC 14496-1/Cor.1 Published 2001/114 1 ISO/IEC 14496-1:2001 (MPEG-4 Systems 2nd Ed.) Published 2001/114 1 ISO/IEC 14496-1:2001/Amd.1 (Flextime) Published 2002/104 1 ISO/IEC 14496-1:2001/Cor.1 01/07/20 FDAM SC294 1 ISO/IEC 14496-1:2001/Cor.2 02/10/26 FDAM SC294 1 ISO/IEC 14496-1:2001/Amd.2 (Textual Format) 02/03 FDAM SC294 1 ISO/IEC 14496-1:2001/Amd.3 (IPMP Extensions) FDAM ITTF FDAM 04/03/224 1 ISO/IEC 14496-1:2001/Amd.4 (SL Extension) Published 2003/124 1 ISO/IEC 14496-1:2001/Amd.7 (AVC on 4) N5976 03/10
BrisbanneFDAM SC29 FDAM to be issued
4 1 ISO/IEC 14496-1:2001/Amd.8 (ObjectType Code Points) N6202 03/12 Hawaii FDAM SC29 Final Text Editing4 1 ISO/IEC 14496-1:2001/Cor.3 N6587 04/07
RedmondFDAM SC29 FDAM Ballot
73
4 1 ISO/IEC 14496-1 (MPEG-4 Systems 3rd Ed.) N5277 02/10 Shanghai
FDIS SC29 Final Text Editing
4 6 ISO/IEC 14496-6:2000 Published 2000/124 8 ISO/IEC 14496-8 (MPEG-4 on IP Framework) N4712 02/03 Jeju FDIS SC29 FDIS 04/04/124 11 ISO/IEC 14496-11/Cor.1 (Integrated in 3rd Edition) N6203 03/12 Hawaii COR SC294 11 ISO/IEC 14496-11 (MPEG-4 Scene
Description) N5279 02/10
ShanghaiFDIS SC29 Final Text Editing
4 11 ISO/IEC 14496-11/Amd.1 (AFX) N5480 02/10 Awaji FDAM Editor Integration in 1st
Ed.4 11 ISO/IEC 14496-11/Amd.2 (Advanced Text and Graphics) N6205 03/12 Hawaii FDAM Editor Integration in 1st
Ed.4 11 ISO/IEC 14496-11/Cor.3 Valuator/AFX related
correctionN6594 04/07
RedmondCOR Editor Integration in 1st
Ed.4 11 ISO/IEC 14496-11/Amd.3 Audio BIFS
ExtensionsN6591 04/07
RedmondFDAM Editor Integration in 1st
Ed.4 12 ISO/IEC 14496-12 (ISO Base Media File
Format) N5295 02/10
ShanghaiIS ITTF To be published
03/124 12 ISO/IEC 14496-12/Amd.1 ISO FF Extension N6596 04/07
RedmondFDAM ITTF Ballot to be issued
4 13 ISO/IEC 14496-13 (IPMP-X) N5284 02/10 Shanghai
FDIS ITTF
4 14 ISO/IEC 14496-14 (MP4 File Format) N5298 02/10 Shanghai
2004/01 Published
4 15 ISO/IEC 14496-15 (AVC File Format) N5780 03/07 Trondheim
FDIS ITTF Ballot to be issued
4 18 ISO/IEC 14496-18 (Font Compression and Streaming)
N6215 03/12 Hawaii FDIS ITTF FDIS by 04/05/11
4 19 ISO/IEC 14496-19 (Synthesized Texture Stream)
N6217 03/12 Hawaii FDIS ITTF FDIS to be issued
7 1 ISO/IEC 15938-1 (MPEG-7 Systems) N4285 01/07 Sydney Published 2002/077 1 ISO/IEC 15938-1/Amd.1 (MPEG-7 Systems Extensions) N6326 04/03 Munich FDAM Editor7 1 ISO/IEC 15938-1/Cor.1 (MPEG-7 Systems Corrigedum) N6328 04/03 Munich COR SC297 2 ISO/IEC 15938-2 (MPEG-7 DDL) N4288 01/07 Sydney Published 2002/02
74
Resolutions of Systems
Cf. WG11 resolution.
List of reviewed contribution
N° Title Authors10774 Requirement for MPEG-21 Binarization Thomas DeMartini10787 Summary of Voting on ISO/IEC 14496-11/PDAM 4 SC 29 Secretariat
10794 IEC CDV 62298-1: Teleweb Application -- Part 1: General Description [SC 29 N 6016]
IEC TC 100 via SC 29 Secretariat
10795 IEC CDV 62298-2: Teleweb application -- Part 2: Delivery methods [SC 29 N 6017]
IEC TC 100 via SC 29 Secretariat
10803 W3C Comments on the MPEG Timed Text specification Glenn Adams et al.
10812 Answer to the CfP on LASeR and SAF: Streamezzo format proposal overview Jean-Claude DufourdOlivier Avaro
10813 Overview of responses to Call for Proposals for MPEG-21 IPMP Niels RumpSimon Watt
10814 Answer to Call for Proposal on Lightweight Scene Representation Joerg Heuer et al.
10815 Answer to the CfP on LASeR and SAF: Streamezzo LASeR format proposal
Jean-Claude Dufourd et al.
10816 Answer to the CfP on LASeR and SAF: Streamezzo SAF format proposal
Jean-Claude Dufourd et al.
10817 Answer to the CfP on LASeR and SAF: Streamezzo Test Set and Executables
Jean-Claude Dufourd et al.
10818 Answer to the CfP on LASeR and SAF A. Cotarmanach et al.
10819 Answer to the CfP on LASeR and SAF Renaud Cazoulat et al.
10820 Response to the CfP on LASeR : BiM SVG Profile for LASeR Robin Berjon et al.
10833 Proposed WD 0.1 of ISO/IEC 14496-20, LASeR and SAF Jean-Claude Dufourd et al.
10834 Proposed Draft Core Experiment on LASeR Harmonization with SVG Olivier Avaro et alii
10835 Proposed Draft Core Experiment on LASeR Binary Representation Olivier Avaro et alii10836 Report of the LASeR evaluation meeting Young-Kwon Lim10837 LASeR software Olivier Avaro et alii10838 Summary of Voting on ISO/IEC FCD 14496-17 SC 29 Secretariat10844 Summary of Voting on ISO/IEC 14496-1:2001/DCOR 3 SC 29 Secretariat10845 Summary of Voting on ISO/IEC 14496-11/DCOR 2 SC 29 Secretariat
10848Application Specific Binary Coding (ASBC) of MPEG-21 descriptors for better coding efficiency maintaining interoperability to regular MPEG-21 decoder
Itaru Kaneko et al.
10852 Proposed Resource Reference Box for addressing a sub-part of a media resource Yongju Cho et al.
10862 Answer to the CfP on MPEG-21 IPMP Craig Schultz10872 Finnish NB comments on 14496-12 Amd.1 Ye-Kui Wang10872 Finnish NB comments on 14496-12 Amd.1 Ye-Kui Wang10881 KNB comment on 14496-11/PDAM4 (XMT & MPEG-J Extensions) KNB10884 Proposal on SL-compliant SAF packet headers Young-Kwon Lim
10893 SMPTE Liaison to MPEG on OpenType® and ISO/IEC 14496-18 Wendy Aylsworth et al.
76
10900 Contribution to MPEG Multimedia Middleware Requirements v.1.0 Jean H.A.Gelissen
10905 Proposal to amend ISO/IEC 14496-1:2004
Alexandre Cotarmanac'hVladimir Levantovsky
10907 USNB Contribution: Response to Munich resolution 2.2.3 A. G. Tescher for USNB
10911 USNB Contribution: Suggested corrigendum to 13818-1:2000 A. G. Tescher for USNB
10912 Proposed conversion of OpenType to an ISO/IEC standard A. G. Tescher for USNB
10913 USNB Contribution: ISO/IEC 14496-17/FCD concerns A. G. Tescher for USNB
10914 Summary of Voting on ISO/IEC CD 21000-9 SC 29 Secretariat10920 Summary of Voting on ISO/IEC 13818-1:2000/FPDAM 4 SC 29 Secretariat10921 Summary of Voting on ISO/IEC 13818-1:2000/FPDAM 5 SC 29 Secretariat10924 Summary of Voting on ISO/IEC 14496-11/FPDAM 3 SC 29 Secretariat
10927 Summary of Voting on ISO/IEC 14496-12/FPDAM 1 & 15444-12/FPDAM 1 SC 29 Secretariat
10930 Proposal for amendment of ISO/IEC 14496-14 Vladimir Levantovsky
10961 MAF Reference Software Workplan ProposalWo ChangSchuyler Quackenbush
10962 MAF File Format Proposal Wo Chang
10974 Report of CE on MPEG-21 Binarisation Christian Timmerer et al.
10982 Comments on LASeR Harmonization with SVG Yesun Joung et al.
10985 Liaison Statement from the Open Mobile Alliance (OMA) [SC 29 N 6121]
OMA via SC 29 Secretariat
10999 Comments on LASeR and SVG Jean-Claude DufourdOlivier Avaro
11000 Metadata protection in ISO Base File Format Amendment Zhongyang Huang et al.
11004 MPEG-7 Systems extensions, TVAnytime indexing core experiments Ray Taylor
11027 Inputs on study text of timed text FCD (part 17) van der Meer
11028 Study Text of ISO/IEC 14496-11/2003 FPDAM-3 Juergen SchmidtOliver Baum
11029 Simple Integration Reference Software for MPEG-4 AudioBIFS, version 3
Juergen SchmidtKlaus Eilts-Grimm
11034 CE-Report on Evaluations of the Siemens Index System Joerg Heuer et al.11036 Stream Reordering for Fast Random Access Joerg Heuer et al.11057 FNB comment on LASeR Jean-Claude Dufourd
11109 Update of XMT-A and MPEG-J standards Mikael Bourges-Sevenier
77
Annex 7Report of MDS meeting
Contact (MPEG Multimedia Description Schemes Sub-group Chair):John R. SmithIBM T. J. Watson Research Center19 Skyline DriveHawthorne, NY 10532 USAjrsmith@watson.ibm.com
The MPEG Multimedia Description Schemes (MDS) sub-group’s activities included work items for MPEG-7 and MPEG-21 standards as shown in Figure 1.
MPEG- 21:• DI D 2nd Ed (FCD)• REL (“Profiles”)• RDD (COR/1)• DI A AMD/ 1 (PDAM)• DI P (FCD)• Ref SW (FCD)• Conformance (FCD)• Event Reporting (WD)
MPEG- 7 v.2:• MDS AMD/ 2
(FDAM)• MDS Cor/ 1(COR)• Conf . Ext. (FDAM)
MPEG- 7 v.1:• MDS (FDI S)• Profi les• Schema Def . (FDIS)
Figure 1. Overview of MPEG Multimedia Description Schemes Sub-Group work items for 68th Munich meeting.
The primary work items for the week included the following:
MPEG-7:o MPEG-7 Extensions (Part 5):
Review NB comments on MPEG-7 MDS FPDAM/2 MPEG-7 MDS AMD/2 FDAM Review NB comments on MPEG-7 MDS DCOR/1 MPEG-7 MDS COR/1 COR
o MPEG-7 Conformance (Part 7): Review NB comments on MPEG-7 Conformance FPDAM/1 AMD/1 (Version 2 bitstreams) FDAM
o MPEG-7 Schema Definition (Part 10): Review NB Comments on MPEG-7 Schema Definition FCD MPEG-7 Schema Definition FCD
78
Ed. Proj. Title CfP WD CD Study
FCD Study
FDIS
2002Amd.1 Systems extensions 02/03 02/07 02/12 02/03 03/072001 1st
Ed.Visual Descriptors Version 2 02/05 02/12 03/03 03/07
2001Amd.1 Extensions (Visual) 01/12 02/05 02/10 03/032001 1st
Ed.Multimedia Description Schemes 01/12 02/05 02/10 02/07
2002Amd.1 Multimedia Description Schemes Extensions
01/12 02/05 02/10 03/03
2003Amd.2 Multimedia Description Schemes Extensions
03/07 03/10 04/03 04/07 04/10
2003 Cor.1 Multimedia Description Schemes 03/12 04/03 04/072003 1st
Ed.Conformance 02/03 03/07
2004Amd.1 Conformance Extensions 03/03 03/07 03/12 04/03 04/072002 1st
Ed.Extraction and Use of MPEG-7
Descriptions01/07 02/03
2004 1st Ed.
Schema Definition 03/07 03/10 03/12 04/03 04/07 04/10
Table 2. MPEG-7 work items for MDS Sub-Group for 69th Meeting.
MPEG-21:o MPEG-21 Digital Item Declaration (Part 2):
Review NB Comments on MPEG-21 DID CD MPEG-21 DID 2nd Ed FCD
o MPEG-21 Rights Data Dictionary MPEG-21 RDD COR/1 DCOR
o MPEG-21 Digital Item Adaptation (Part 7): MPEG-21 DIA AMD/1 PDAM
o MPEG-21 Reference SW (Part 8): Review NB Comments on MPEG-21 Ref. SW CD MPEG-21 Ref. SW FCD
o MPEG-21 Digital Item Processing (Part 10): Review NB comments on MPEG-21 DIP CD MPEG-21 DIP FCD (Study of CD)
o MPEG-21 Conformance (Part 14): Review contributions MPEG-21 Conformance CD
o MPEG-21 Event Reporting (Part 15): Review CE results on MPEG-21 Event Reporting MPEG-21 Event Reporting WD v.2
Part
Ed. Proj. Title CfP WD CD / PDAM
Study
FCD / FPDAM
Study
FDIS / FDAM
2 20021st Ed.Digital Item Declaration 01/12 02/052 200x 2nd
Ed.Digital Item Declaration 03/10 04/03 04/07 05/01
3 20021st Ed.Digital Item Identification 01/07 01/12 02/03 02/074 200x1st Ed.IPMP Framework 01/07 02/05 02/10
79
5 200x1st Ed.Rights Expression Language 01/12 02/07 02/12 03/076 200x1st Ed.Rights Data Dictionary 01/12 02/07 02/12 03/076 200x Cor.1 Rights Data Dictionary7 200x1st Ed.Digital Item Adaptation 02/03 02/05 02/12 03/07 03/10 03/127 200x Amd.1MPEG-21 DIA AMD/1 WD: DIA Conversions
and Permissions03/12 04/07 04/10 05/03
8 200x1st Ed.Reference Software 03/03 04/03 04/07 05/0110I 200x1st Ed.Digital Item Processing 02/12 03/03 03/12 04/03 04/07 05/0114 200x1st Ed.Conformance 03/10 04/07 04/10 05/0115I 200x1st Ed.Event Reporting 04/03 04/10
Table 2. MPEG-21 work items for MDS Sub-Group for 69th Meeting.
MPEG Multimedia Description Schemes (MDS) Group activities
Num.
Contributions
Agenda, Goals and Issues for the Week for Multimedia Description Schemes (MDS) Sub-Group
Agenda, Goals and Issues for the Week for Multimedia Description Schemes (MDS) Group
John R. Smith
During the kick-off session, the workplan for the week for MPEG-7 and MPEG-21 development was discussed and approved. Furthermore, the following points were discussed:
Organization of work into main MDS track with BoGs (REL/RDD/DIA/DIP/ER/IPMP)
o All work held in main MDS track except where indicated for specific Break-out Groups (BoG)
Scheduling of MDS sub-group plenary meetings for Wednesday and Thursday
Plan for MPEG-7 Multimedia Description Schemes AMD/2 and COR/1 Plan for MPEG-21 Digital Item Declaration 2nd Edition Plan for MPEG-21 Rights Expression Language Plan for MPEG-21 Rights Data Dictionary Plan for MPEG-21 Digital Item Adaptation Plan for MPEG-21 Digital Item Processing Plan for MPEG-21 Event Reporting Plan for MPEG-21 IPMP Plan for software development for MPEG-21 Schedule of joint meetings
Joint Meetings (as of Monday): MPEG-7:
80
o Wed (11h30 - 13h00): MPEG-7 Profiles (with Requirements, Systems, Audio, Video)
MPEG-21:o Mon (17h00 - 18h00): MPEG-21 IPMP Handoff (with
Requirements, Systems)o Tues (11h00 - 11h30): Media Application Formats (with
Requirements, Systems)o Tues (15h00 - 16h30): MPEG-21 Requirements (with
Requirements)o Tues (14h00 - 15h00): MPEG-21 Integration (with Requirements)
Break-out Groups:
Event Reporting BoG:o Time: 09:00 – 11:30o Place: St. Helens 3 (other room to be announced)o Mandates:
Address specific recommendations from AHG and Core experiments
Create initial draft of ER v2.0 Start inter-MPEG-21 project communications for ER and its
relationship to DID, REL, DIA, IPMP, etc.o Chairs: Andrew Tokmakoff
Digital Item Processing (DIP) BoG:o Time: Tues, 11:30 – 15:00o Place: St. Helens 3o Mandates:
Review and develop initial recommendations for NB comments
Harmonize DIBOs for RELo Chairs: Gerrard Drury, Frederik
IPMP BoG:o Scope:
Interoperability across (and within) verticals Interoperability at what levels? Where to draw line (e.g., framework descriptions
systems/tools)?o Elements:
Framework Descriptions, IPMP information IPMP Systems (high-level) and IPMP Tools (bit-level) Solutions
o Start with framework: Enabling and prescriptive Draw together components of MPEG-21 Levels of flexibility (required) May need to support declaration of tools at multiple levels
(e.g., high-level, bit-level)
81
o Time: 10:30 – 17:00 Place: Baker 1
o Mandates: Start work on defining framework Interact with experts on DID, DII, REL/RDD, DIP, IPMP:
Show how elements work together (current views) – ungoverned DIs
Show how elements could work together to support IPMP (future view) – governed DIs
o What’s missing?o Identify what IPMP information is needed within
DID Re-examine input contributions related to framework Map to requirements, identify capabilities and gaps
o Output (Tues PM): Table identifying how proposals meet framework
requirements o Chairs: Simon Watt
MPEG-21 Media Locators BoGo Time: Wed, 13h00 - 16h00o Place: St. Helens 3 o Mandates:
Examine alternatives: Do not define generic fragment-id scheme – support
authoritative schemes only (+ activity to define scheme for MPEG mime-types in
context of file format) Define generic AV scheme using M21 URI syntax Define generic AV scheme using MPEG-7 XML media
locatorso Actions:
Create AhG with mandates mapping to BoG recommendations (TBD)
o Chairs: Myriam
Review of AHG resolutions and action points:
Doc No. Contribution Source
AHG on Core Experiments for MPEG-21 DID 2nd Edition Gerrard Drury, Frederik De Keukaleare
10957 Myriam Amielh Final CE report on MPEG-21 Media LocatorResults:
Developed media locator test suite – used to evaluate candidate schemes
CSIRA developed Java software for supporting URI-based fragments
URI uses XPath grammar for locating steps for logical units Demonstration of locating regions in space and time using URI-
82
based scheme Check ONYX (messaging structure) and Logical models (music
industry)Actions:
Review CE results during the meeting11032 John R. Smith, Alan Melby
CE Results on Addressing Scheme for MPEG-21 using MPEG-7 Media Locators
Results: Developed and evaluated test cases for using MPEG-7 media
locator for MPEG-21 Further improved syntax and semantics for including MPEG-7
media locator in MPEG-21 DID Further improved syntax and semantics of logical unit locator for
MPEG-7Actions:
BoG this week to determine best solution for MPEG-21 addressing requirements
AHG on Core Experiments for MPEG-21 DIPGerrard Drury, Frederik De Keukaleare, Munchurl Kim
10939Hendry, Munchurl Kim, Keunsoo Park, Eva Rodriguez, Torres , Jaime Delgado
CE report for Core Experiment on DIBOs for REL
10873 Victor Torres, Jaime Delgado, Eva Rodriguez
MPEG-21 DIP Core Experiments: A contribution to the implementation of DIBOs for REL
Results: Explored two solutions for REL related DIBOs
Actions: Need effort this week to harmonize two solutions Continue work as mandate of DIP BoG
10766 FX Nuttall, Andrew Tokmakoff AHG on MPEG-21 Event Reporting
11064Andrew Tokmakoff, Youngjoo Song, Kyunghee Ji, Senator Jeong CE-Report on MPEG-21 Event Reporting
Results: Improved Event Reporting working draft Elaborated on syntax and semantics of ER and ERR
Actions: Need more interaction with other parts of MPEG-21 Need to more completely define ER and ERR tools Continue in BoG mode this week – produce next version of WD
MPEG-21 IPMP
Doc No. Contribution Source
Results of Call on MPEG-21 IPMP RequirementsResults:
Completed handoff of MPEG-21 IPMP activities to MDS subgroup (from Requirements)
Questions: What shall be scope of MPEG-21 IPMP standardization –
framework, metadata, tools, end-to-end solutions?
83
Actions: Start intensive BoG activities this week – mandates to be
established first thing on Tues AM.
MPEG-21 DID Comments:
Doc No. Contribution Source
10889 SC 29 SecretariatSummary of Voting on ISO/IEC CD 21000-2 [SC 29 N 6107]
10971 Christian Timmerer, on behalf of the Austrian NB ANB comments on 21000-2 CD 2nd EditionResults:
NB comments on MPEG-21 DIDQuestions:
Media locator comments to be addressed in BoGActions:
Meet with NB members and resolve open issues Produce DID 2nd Edition FCD at this meeting
MPEG-21 DID Media Locators:
Doc No. Contribution Source10957 Myriam Amielh Final CE report on MPEG-21 Media Locator
11032 John R. Smith, Alan MelbyCE Results on Addressing Scheme for MPEG-21 using MPEG-7 Media Locators
11118 Myriam AmielhIssues relating to the use of URI Fragment Identifiers in MPEG-21
Results: Reviewed results of CE on Media locators for MPEG-21 using two
approaches – one using MPEG-7 standards based tools and the other using proprietary URI-based scheme.
Questions: Issues were raised about URI-based scheme because of
incompatibilities with existing W3C/IETF practices on URI-fragments
MPEG cannot define a URI-compatible fragment scheme for media types that are not under MPEG control, e.g., Quicktime
Actions: Adopt MPEG-7 based scheme into MPEG-21 DID specification Continue to explore URI-based schemes and applicability to
MPEG media types
MPEG-21 RDD
Doc No. Contribution Source
84
10786 ITTF via SC 29 SecretariatTable of Replies on ISO/IEC FDIS 21000-6 [SC 29 N 5981]
11013 Chris Barlas ISO/IEC 21000-6 COR/1 WD v.1 Editor's Input
11077Thomas DeMartini, Herbert Van de Sompel, Jeroen Bekaert Status of mpegRA activity
Results: Minor issue on MPEG-21 RDD spec. – error and inconsistency in
Fig. 1Questions:
Questions about status of MPEG-21 registration authority – seemingly no actions have been taken by appointed RA
Actions: Correct figure for RDD COR/1 RA will respond and report on status
MPEG-21 DIA AMD/1 Editing
Doc No. Contribution Source
10831 Thomas DeMartini Editor's Input: DIA AMD/1 WDv2.1
10978 Christian Timmerer, Hermann Hellwagner Comments on DIA AMD1 WDv2Results:
Minor comments on DIA AMD/1Questions:
Not all editors present – release next draft with minor revisionsActions:
Produce DIA PDAM/1
MPEG-21 DIA AMD/1 Proposals
Doc No. Contribution Source
10996
Ingo Wolf, Bernhard Feiten, Teodora Guenkova-Luy, Andreas Schorr, Franz Hauck, Andreas J. Kassler
MPEG-21 DIA based delivery using SDPng and RTP
11030 Mariam Kimiaei Asadi, Jean-claude Dufourd Possible missing features in MPEG-21 DIA
11086Christian Timmerer, Klaus Leopold, Dietmar Jannach, Hermann Hellwagner Contribution to DIA AMD1 WDv2
Results: Delivery based contribution for DIA using SFPng and RTP
(relevant for testbed) Contribution for DIA tools for describing rich text capabilities
Actions: Continue to explore rich text DIA description in AHG following
this meeting – consider adopting for future DIA
MPEG-21 Requirements
85
Doc No. Contribution Source
10774 Thomas DeMartini Requirement for MPEG-21 Binarization
10807 Niels Rump, Chris BarlasRelationship between Digital Items and Digital Item Declarations
10892Jeroen Bekaert, Thomas DeMartini, Rik Van de Walle, Herbert Van de Sompel Identification of a DIDL Document
11081Jeroen Bekaert, Frederik De Keukelaere, Herbert Van de Sompel, Rik Van de Walle Requirement for MPEG-21 DID
11110 Gerrard Drury, Ian BurnettComments on Identification of DID a Document
Results: Issues raised about identification of DID XML documents (as
opposed to DII of Digital items) Very different points of view expressed from rights holder
community vs. library science/data management communityActions:
More discussion and possible compromise needed In end, compromise is to use DID metadata field for including
identifiers for DID XML documents
MPEG-21 BSD Proposals:Doc No. Contribution Source
11087 Joerg Heuer, Gabriel Panis, Andreas HutterConsiderations for efficient Resource Adaptation based on MPEG-21 DIA
11091Debargha Mukherjee, Huisheng Wang, Sam Liu
On BSD Transformation Instructions - Streaming Implementation and updates
Results: Update on activities on DIA resource adaptations in streaming
environments and streaming implementations of BSD transformations
Actions: Explore further in form of CE and consider for future DIA
MPEG-21 DIP Proposals:
Doc No. Contribution Source
10873Victor Torres, Jaime Delgado, Eva Rodriguez
MPEG-21 DIP Core Experiments: A contribution to the implementation of DIBOs for REL
10939Hendry, Munchurl Kim, Keunsoo Park, Eva Rodriguez, Torres , Jaime Delgado
CE report for Core Experiment on DIBOs for REL
10963Myriam Amielh, Ernest Wan, Gerrard Drury, Ian Burnett Proposed DIBO for playing a Fragment
Results: Contributions for DIP including rights related DIBos
Questions: There may be some advantages for separating DIP into governed
86
vs. ungoverned, similar to DIA; although, proponents of DIP rights related tools would not like to delay those tools
Actions: Adopt revisions into current draft
MPEG-21 DIP Editing:
Doc No. Contribution Source
10797 SC 29 SecretariatSummary of Voting on ISO/IEC CD 21000-10 [SC 29 N 6103]
10973 Christian Timmerer, on behalf of the Austrian NB ANB comments on 21000-10 CD
11113 Gerrard Drury, Ian Burnett Response to Comments on DIP CDResults:
Large number of NB comments in MPEG-21 DIP CD Some issues difficult to resolve such as the interface design for
DIP toolsActions:
BoG and NB representatives to continue working on open issues Final decision on DIP to be made at end of week
MPEG-21 Conformance:
Doc No. Contribution Source
10891Eva Rodriguez, Jaime Delgado, Silvia Llorente
Revised REL Interpretation Conformance after verification of Test Cases
Results: New contribution adopted for REL aspect of MPEG-21
conformanceQuestions:
Little effort has been made to date on DID, DIA conformance; although, conformance for these parts may not be very extensive, e.g., similar to MPEG-7 for XML metadata
Actions: Need more serious effort on MPEG-21 conformance – who?
87
Summary of Results on MPEG Multimedia Description Schemes (MDS) work items:
Results on MDS MPEG-7 work items:
1. MPEG-7 MDS (Part 5): MPEG-7 Multimedia Description Schemes (Part 5):
o Disposed of National Body comments on MDS DCOR/1 (clarification of semantics when multiple profile & level indicators are signaled)
o All National Bodies approved dispositiono Output: MPEG-7 MDS COR/1 COR
MPEG-7 MDS User Preference Extensions (Part 5):o Disposed of NB comments on FPDAM/2 (updates & corrections of
syntax)o All National Bodies approved dispositiono Output: MPEG-7 MDS AMD/2 FDAM
2. MPEG-7 Conformance (Part 7) Disposed of NB comments on FPDAM/1 (finalization of MPEG-7 AMD
conformance bit-streams) All National Bodies approved disposition Editing period requested to collect final bit-streams from respective
MPEG-7 groups Output: MPEG-7 Conformance FDAM/1
3. MPEG-7 Schema Definition (Part 10) Disposed of NB Comments on FCD (synchronization of tools across
MPEG-7 parts) All National Bodies approved disposition Output: MPEG-7 Schema Definition FDIS
Results on MDS MPEG-21 work items:
1. Analyzed recommendations of AHGs and Core Experiments.
2. MPEG-21 Part 2 – Digital Item Declaration: Disposed of NB comments on CD (all National Bodies approved) Adopted <Fragment> element for locating fragments of resources
using MPEG-7 media locators and URI-authoritative fragment-id schemes
Decision to support identifier for DIDL XML documents using DIDL metadata field – clearly distinct from the DII of the Digital Item
Established AHG on Media locators: Exploring URI-authoritative fragment-id schemes (e.g., for MPEG
mime-types; use within MPEG-21 and interaction with MPEG-7 media locator solutions)
Output: MPEG-21 DID 2nd Ed FCD
88
3. MPEG-21 Rights Data Dictionary (RDD): Bug fix to Figure 1 (not consistent with text) Output: MPEG-21 RDD COR/1 DCOR
4. MPEG-21 Part 7 – Digital Item Adaptation: Promoted DIA AMD/1 to PDAM (minor editorial revisions)
o Provides normative tools for describing conversion capabilities and suggested conversions for digital item (or component)
o Provides example informative set of conversions and their mapping & term specialization in RDD
Established new DIA Core Experiments:o CE on Text Capabilities of Terminals – description of font and
rich-text capabilities of terminals and use for adaptationo CE on Conversion Parameters – DIA support for multi-step
adaptationso CE on Bitstream Adaptation in Constrained and Streaming
Environments Output:
o MPEG-21 DIA AMD/1 PDAM, o MPEG-21 DIA COR/1 DCOR
5. MPEG-21 IPMP SW (Part 4): Extensive interaction of DID, DII, REL/RDD, DIP, IPMP experts:
o Examined how MPEG-21 elements work together (ungoverned view)
o Examined how MPEG-21 elements could to work together to support IPMP (governed view) – starting point of framework
Established initial basis for MPEG-21 IPMP framework:o Starting from DIDL extension proposal from m10860 – defines
governed-versions of DIDL constructs within MPEG-21 Digital Item Declaration, e.g., <Container> and <IPMP_Container>, etc.
o Starting point of IPMP descriptors from proposals m10832, m10858 and m10865
Established IPMP AHG:o Further developing IPMP DIDL extensions, schema for IPMP
informationo Revising MPEG-21 IPMP working draft – documenting initial
framework o AHG Meetings will be held on 24-26 Aug in Mountain View and
weekend prior to 70th MPEG meeting Output: MPEG-21 IPMP WD v.1
6. MPEG-21 Reference SW (Part 8): Disposed of NB comments on CD (all National Bodies approved) Adopted new SW contributions on Mobile MPEG-21 browser and
Integration SW for REL, DID and DIA Output: MPEG-21 Ref. SW FCD
7. MPEG-21 Part 10 – Digital Item Processing: Did not fully dispose of NB comments on CD (~150 comments)
89
o Proposed change of API too extensive to be evaluated in Redmond
o Produced Draft DoC and Study of CDo Delaying MPEG-21 DIP FCD until 70th meeting
Revising DIP to operate on DID entities (not DIDL XML elements) Harmonization of solutions for REL-related DIBOs Clarification of DIP text to better define its purpose and relationship to
other MPEG-21 parts Established DIP AHG to work on:
o Signaling of DIP profileso Evaluating API revisionso Implementing PlayResource DIBO and DIXOs
Output: MPEG-21 DIP Study of CD
8. MPEG-21 Part 15 – Event Reporting: Further developed Event Reporting and its relationship to DID, REL,
DIA, IPMP, etc. Developed solutions for representing Event Reports and Event Report
Requests in Digital Items using DIDL Descriptor element More fully defined data fields of Event Report and Event Report
Request elements Demonstrated of Event Reporting software integrated with DID, REL,
DIP Output: MPEG-21 Event Reporting WD v.2
9. Edited and approved output documents (WD, CD, AHGs, new CEs, etc.)
90
List of MDS Output documents:
MPEG-7:
No. Title TBP
Available
15938-5 MPEG-7 Multimedia Description Schemes
6633 DoC on ISO/IEC 15938-5 FPDAM/2 N 04/07/2
3663
4ISO/IEC 15938-5 FDAM/2 “MDS User Preference Extensions” N 04/07/2
3663
5 DoC on ISO/IEC 15938-5 DCOR/1 N 04/07/23
6636 ISO/IEC 15938-5 COR/1 N 04/08/0
9
No. Title TBP
Available
15938-7 MPEG-7 Conformance663
7DoC on ISO/IEC 15938-7 FPDAM/1 N 04/07/2
3663
8ISO/IEC 15938-7 FDAM/1 N 04/08/1
6
No. Title TBP
Available
15938-10 MPEG-7 Schema definition 663
9DoC on ISO/IEC 15938-10 FCD N 04/07/2
3664
0ISO/IEC 15938-10 FDIS “Schema Definition” N 04/09/1
3
MPEG-21:
No. Title TBP
Available
21000-2 MPEG-21 Digital Item Declaration664
1DoC on 21000-2 CD 2nd Edition – Digital Item Declaration
N 04/07/23
6642
ISO/IEC 21000-2 DID 2nd Edition FCD N 04/07/31
No. Title TBP
Available
91
21000-3 MPEG-21 Digital Item Identification 664
3 Status of Registration Authority for DII N 04/07/23
No. Title TBP
Available
21000-4 MPEG-21 IPMP664
4ISO/IEC 21000-4 WD v.1 “IPMP” N 04/07/2
3
No. Title TBP
Available
21000-5 MPEG-21 Rights Expression Language664
5MPEG-21 REL/RDD Software Implementation Plan v.7 N 04/07/2
3
No. Title TBP
Available
21000-6 MPEG-21 Rights Data Dictionary664
6 ISO/IEC 21000-6 DCOR/1 N 04/07/23
No. Title TBP
Available
21000-7 MPEG-21 Digital Item Adaptation664
7MPEG-21 DIA PDAM/1 “Conversions and Permissions” N 04/07/2
3664
8 ISO/IEC 21000-7 COR/1 WD v.1 N 04/07/23
6649 MPEG-21 DIA Software Implementation Plan v.8 N 04/07/2
3665
0Workplan for Core Experiment on Text Capabilities of Terminals N 04/07/2
3665
1Workplan for Core Experiment on Conversion Parameters N 04/07/2
3665
2Workplan for Core Experiment on Bitstream Adaptation in Constrained and Streaming Environments
N 04/07/23
No. Title TBP
Available
21000-10 MPEG-21 Digital Item Processing665
3Draft DoC on ISO/IEC 21000-10 CD N 04/07/2
3
92
6654
Study of ISO/IEC 21000-10 CD “Digital Item Processing”
N 04/09/03
6655 MPEG-21 DIP Software Implementation Plan v.3 N 04/07/2
3
No. Title TBP
Available
21000-15 MPEG-21 Event Reporting665
6ISO/IEC 21000-15 WD v.2 “Event Reporting” N 04/07/3
1
93
List of AHGs approved by the MDS group:
N6657AHG on MPEG-21 Media Locators
Mandates 1. Investigate solutions for an authoritative URI fragment identifier scheme for mpeg media types
2. Discuss and collect comments on the collaborative solution using MPEG-7 metadata-based and URI-based schemes for DID
3. Update the DID reference software to support <Fragment> element and study the impact of the new element
4. Explore requirements for addressing schemes for mpeg and non-mpeg mime types
5. Jointly explore conventions for describing slices of composites with MPEG 21, SMIL, X3D
Chairman Myriam Amielh (myriam.amielh@cisra.canon.com.au)Co Chairs Gerrard Drury (gerrard@enikos.com)
YongJu Cho (yongjucho@etri.re.kr)Duration Until the 70th MeetingMeetings Pre-meeting to be held in Palma on the Saturday or Sunday
prior the 70th meeting.Reflector mpeg-21-list@imec.be
Please use the prefix [medialoc]Subscribe Send email to owner-mpeg-21-list@imec.beN6658 AHG on MPEG-21 IPMP Mandate: 1. To further review the proposals to identify relevant
technologies for inclusion in the working draft.2. To further develop the IPMP_DIDL extensions3. To develop a schema for IPMP informationTo make recommendations on 1), 2) and 3) to the 70th Meeting
Chairman: Simon WattDuration: Until 70th meetingMeetings: Meetings will be held:
24-26 Aug in Mountain View in Palma on the day prior to the 70th Meeting
Reflector: mpeg-21@listserv.imec.be message titles prefixed [IPMP]Subscribe: To subscribe, go to
http://listserv.imec.be/mailman/listinfo/mpeg-21
N6659AHG on MPEG-21 DIA
Mandate: 1. Carry out Core Experiments on DIA and make recommendations to modify and improve the MPEG-21 DIA AMD/1 PDAM.
2. Investigate the integration of the PDAM schema into the ISO/IEC 21000-7 schema.
3. Produce the editor’s draft of PDAM.Chairs Christian Timmerer (christian.timmerer_at_itec.uni-klu.ac.at)
Thomas DeMartini
94
(Thomas.DeMartini_at_CONTENTGUARD.COM)Duration: Until the 70th Meeting.Meetings:
AHG Meeting to be held on the weekend prior to 70th meeting. Other business will be conducted by e-mail or telephone conference.
Reflector: mpeg21-uma_at_merl.comSubscribe: To subscribe send email to chairman.N6660
AHG on MPEG-21 DIPMandates 1. Carry out editing of DIP Study of CD according to draft
disposition NB comments on CD.2. Encourage contributions on improving MPEG-21 DIP Study
of CD.3. Develop mechanisms that allow signaling of MPEG-21 DIP
profile information.4. For use cases provided in the Draft DoC for demonstrate
implementations of the concepts of the PlayResource DIBO or DIXOs.
Chairman Gerrard Drury (gerrardx@xenikos.com)Co Chair Frederik De Keukaleare (Frederik.DeKeukelaerex@xugent.be)
Munchurl Kim (mkimx@xicu.ac.kr)Duration Until the 70th MeetingMeetings AhG Meeting to be held on the Sunday prior to 70th meeting.
Other business to be conducted by email or phone.Reflector mpeg-21-dipx@xuow.edu.auSubscribe See http://mailinglists.uow.edu.au/mailman/listinfo/mpeg-21-
dipN6661
14.1.1 AhG on MPEG-21 Event ReportingMandate: 1. Finish the editing of WD 2.0
2. Continue developing the reference software, as to comply with WD 2.0
3. Make recommendations on possible improvements to WD 2.0
4. contribute an editors’ draft for the next meetingChairs: FX Nuttall (fx at nuttall.org)
Andrew Tokmakoff (tokmakoff at telin.nl) Duration: Until the 70th MeetingMeetings: A pre- meeting will be held on the weekend before the Palma
meeting.Other business will be conducted by E-mail or telephone conference.
Reflector: mpeg-21-event-reporting@lists.telin.nl Subscribe: See http://lists.telin.nl/mailman/listinfo/mpeg-21-event-
reporting
95
MPEG MDS group schedule for 69th meeting:
MDS Sub-Group Schedule MPEG MDS Chair: John R. Smith
MPEG-7 and MPEG-21 v.3.2 Numb
er Source Title STD NOTES
Monday Morning (9h00-13h00) MPEG Plenary Plenary room
Monday Afternoon (14h00-20h00)
Kick-off of MPEG MDS activities (14h00-14h30) Hood 2 (MDS Room) ALL JRS
Agenda, Goals and Issues for the Week for MDS Group John R. Smith
Review of AHG resolutions, CE results and action points (14h30-16h30) Hood 2 (MDS Room) ALL JRS
AHG on Core Experiments for MPEG-21 DID 2nd Edition Gerrard Drury, Frederik De Keukaleare
10957 Myriam Amielh Final CE report on MPEG-21 Media Locator
11032 John R. Smith, Alan MelbyCE Results on Addressing Scheme for MPEG-21 using MPEG-7 Media Locators
AHG on Core Experiments for MPEG-21 DIP
Gerrard Drury, Frederik De Keukaleare, Munchurl Kim
10939
Hendry, Munchurl Kim, Keunsoo Park, Eva Rodriguez, Torres , Jaime Delgado
CE report for Core Experiment on DIBOs for REL
10873Victor Torres, Jaime Delgado, Eva Rodriguez
MPEG-21 DIP Core Experiments: A contribution to the implementation of DIBOs for REL
10766 FX Nuttall, Andrew Tokmakoff AHG on MPEG-21 Event Reporting
11064Andrew Tokmakoff, Youngjoo Song, Kyunghee Ji, Senator Jeong CE-Report on MPEG-21 Event Reporting
Define BoGs and Mandates (16h30-17h00) Hood 2 (MDS Room) ALL JRS
MPEG-7, REL, RDD, DID, DIA, DIP, ER, IPMP BOG Room = St. Helens 3
MPEG-21 IPMP (17h00- 18h00) with Requirements,
Lassen Room (Requirements)
MPEG-21
JRS
96
Systems Tuesday Morning (09h00-13h00) MPEG-21 Event Reporting (ER) BoG (09h00- 11h30) St Helens 3
MPEG-21
MPEG-21 IPMP (09h00 - 09h30) Hood 2 (MDS Room)
MPEG-21 JRS
MPEG-21 DID Comments (09h30 - 10h00) Hood 2 (MDS Room)
MPEG-21 JRS
10889 SC 29 SecretariatSummary of Voting on ISO/IEC CD 21000-2 [SC 29 N 6107]
10971Christian Timmerer, on behalf of the Austrian NB ANB comments on 21000-2 CD 2nd Edition
MPEG-21 DID Media Locators (10h00 - 11h00) Hood 2 (MDS Room)
MPEG-21 JRS
10957 Myriam Amielh Final CE report on MPEG-21 Media Locator
11032 John R. Smith, Alan MelbyCE Results on Addressing Scheme for MPEG-21 using MPEG-7 Media Locators
11118 Myriam AmielhIssues relating to the use of URI Fragment Identifiers in MPEG-21
MPEG-21 IPMP BoG (10h30- 17h00) Baker 1
MPEG-21
Media Application Formats (11h00- 11h30) with Req., Video, Audio, Systems
Lassen Room (Requirements) MAF JRS
10961Wo Chang, Schuyler Quackenbush MAF Reference Software Workplan Proposal
10962 Wo Chang MAF File Format Proposal MPEG-21 Digital Item Processing (DIP) BoG (11h30- 15h00) St Helens 3
MPEG-21
MPEG-21 RDD (11h30 - 12h00) Hood 2 (MDS Room)
MPEG-21 JRS
10786 ITTF via SC 29 SecretariatTable of Replies on ISO/IEC FDIS 21000-6 [SC 29 N 5981]
11013 Chris Barlas ISO/IEC 21000-6 COR/1 WD v.1 Editor's Input
11077Thomas DeMartini, Herbert Van de Sompel, Jeroen Bekaert Status of mpegRA activity
97
Tuesday Afternoon (14h00-20h00) MPEG-21 DIA AMD/1 Editing (13h00- 14h00) Hood 2 (MDS Room)
MPEG-21 JRS
10831 Thomas DeMartini Editor's Input: DIA AMD/1 WDv2.1 10978
Christian Timmerer, Hermann Hellwagner Comments on DIA AMD1 WDv2
MPEG-21 DIA AMD/1 Proposals (14h00- 15h00) Hood 2 (MDS Room)
MPEG-21 JRS
10996
Ingo Wolf, Bernhard Feiten, Teodora Guenkova-Luy, Andreas Schorr, Franz Hauck, Andreas J. Kassler
MPEG-21 DIA based delivery using SDPng and RTP
11030Mariam Kimiaei Asadi, Jean-claude Dufourd Possible missing features in MPEG-21 DIA
11086
Christian Timmerer, Klaus Leopold, Dietmar Jannach, Hermann Hellwagner Contribution to DIA AMD1 WDv2
MPEG-21 Requirements (15h00- 16h30) w. Requirements, Systems
Lassen Room (Requirements)
MPEG-21 JRS
10774 Thomas DeMartini Requirement for MPEG-21 Binarization
10807 Niels Rump, Chris BarlasRelationship between Digital Items and Digital Item Declarations
10892
Jeroen Bekaert, Thomas DeMartini, Rik Van de Walle, Herbert Van de Sompel Identification of a DIDL Document
11081
Jeroen Bekaert, Frederik De Keukelaere, Herbert Van de Sompel, Rik Van de Walle Requirement for MPEG-21 DID
11110 Gerrard Drury, Ian BurnettComments on Identification of DID a Document
MPEG-21 Event Reporting (16h30 - 17h00) Hood 2 (MDS Room)
MPEG-21 IB
10766 FX Nuttall, Andrew Tokmakoff AHG on MPEG-21 Event Reporting
11064
Andrew Tokmakoff, Youngjoo Song, Kyunghee Ji, Senator Jeong CE-Report on MPEG-21 Event Reporting
MPEG-21 IPMP (17h00 - 18h00)
Lassen Room (Requirements)
MPEG-21 JRS
MPEG-21 DIA BSD Proposals (18h00- 18h30) Hood 2 (MDS Room)
MPEG-21 JRS
11087Joerg Heuer, Gabriel Panis, Andreas Hutter
Considerations for efficient Resource Adaptation based on MPEG-21 DIA
11091Debargha Mukherjee, Huisheng Wang, Sam Liu
On BSD Transformation Instructions - Streaming Implementation and updates
98
Wednesday Morning (09h00-13h00)
MPEG Plenary (9h00-11h00) Plenary roomMPEG Plenary
MPEG-21 IPMP BoG (11h30- 16h30) Baker 1
MPEG-21
MPEG-21 DIP Proposals (11h30 - 12h30) Hood 2 (MDS Room)
MPEG-21 IB
10873Victor Torres, Jaime Delgado, Eva Rodriguez
MPEG-21 DIP Core Experiments: A contribution to the implementation of DIBOs for REL
10939
Hendry, Munchurl Kim, Keunsoo Park, Eva Rodriguez, Torres , Jaime Delgado
CE report for Core Experiment on DIBOs for REL
10963Myriam Amielh, Ernest Wan, Gerrard Drury, Ian Burnett Proposed DIBO for playing a Fragment
MPEG-7 Profiles (11h30 - 13h00) with Req., Video, Audio, Systems
Lassen Room (Requirements)
MPEG-7 JRS
10763 Wo Chang, Akio Yamada, Alan Melby AHG on MPEG-7 Profiles 10940 Peter van Beek MPEG-7 User Description Profile Update 11023 Masanori SANO Some thoughts on MPEG-7 Profiling 11024 Masanori SANO MPEG-7 Core Description Profile Update
Wednesday Afternoon (14h00-17h30) MPEG-21 DID Media Locators BoG (13h00 - 16h00) St. Helens 3 (BoG Room)
MPEG-21
MPEG-21 IPMP BoG (11h30- 16h30) Baker 1
MPEG-21
MPEG-21 DIP Editing (13h00 - 14h00) Hood 2 (MDS Room)
MPEG-21 IB
10797 SC 29 SecretariatSummary of Voting on ISO/IEC CD 21000-10 [SC 29 N 6103]
10973Christian Timmerer, on behalf of the Austrian NB ANB comments on 21000-10 CD
11113 Gerrard Drury, Ian Burnett Response to Comments on DIP CD MPEG-21 Integration (14h00 - 15h00) with Requirements, Integration
Lassen Room (Requirements)
MPEG-21 IB
MPEG-21 Conformance (15h00 - 16h00) with
Hood 2 (MDS Room) MPEG-21
IB
99
Integration
10891Eva Rodriguez, Jaime Delgado, Silvia Llorente
Revised REL Interpretation Conformance after verification of Test Cases
MPEG-21 DIP BoG (16h00 - 17h00) St. Helens 3 (BoG Room)
MPEG-21
MPEG-21 IPMP (16h30 - 17h00)
Lassen Room (Requirements)
MPEG-21 JRS
MPEG Social Event (17h00 - midnight) Thursday Morning (09h00-12h30)
MPEG-21 IPMP BoG (09h00- 16h00) Baker 1
MPEG-21
MPEG-21 File Format (09h00 - 10h00) with Systems (Systems Room)
MPEG-21 IB
MPEG-21 DIP Editing (10h00 - 11h00) St. Helens 3 (BoG Room)
MPEG-21 IB
10963Myriam Amielh, Ernest Wan, Gerrard Drury, Ian Burnett Proposed DIBO for playing a Fragment
10797 SC 29 SecretariatSummary of Voting on ISO/IEC CD 21000-10 [SC 29 N 6103]
10973Christian Timmerer, on behalf of the Austrian NB ANB comments on 21000-10 CD
11113 Gerrard Drury, Ian Burnett Response to Comments on DIP CD
MPEG-7 MDS Extensions (09h00 - 10h00) Hood 2 (MDS Room)
MPEG-7 JRS
10790 ITTF via SC 29 SecretariatTable of Replies on ISO/IEC 15938-5:2003/FDAM 1 [SC 29 N 6001]
10925 SC 29 SecretariatSummary of Voting on ISO/IEC 15938-5:2003/FPDAM 2
11121 John R. Smith, Alan K. MelbyRevised Logical Media Locator for MPEG-7 & MPEG-21
MPEG-7 MDS COR/1 (10h00 - 10h30) Hood 2 (MDS Room)
MPEG-7 JRS
10846 SC 29 SecretariatSummary of Voting on ISO/IEC 15938-5:2003/DCOR 1 [SC 29 N 6072]
MPEG-7 Schema Definition (10h30 - 11h00) Hood 2 (MDS Room)
MPEG-7 JRS
10926 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 15938-10 MPEG-7 Conformance Hood 2 (MDS Room) MPEG JRS
100
Extensions (10h30 - 11h00) -7
10806 SC 29 SecretariatSummary of Voting on ISO/IEC 15938-7/FPDAM 1 [SC 29 N 6046]
MPEG-21 Ref. SW (11h00 - 12h00) with Integration Hood 2 (MDS Room)
MPEG-21 JRS
10847 SC 29 SecretariatSummary of Voting on ISO/IEC CD 21000-8 [SC 29 N 6075]
10864Xin Wang, Venugopal Venkatraman, Thomas DeMartini
Simple Integration Reference Software for MPEG-21 REL, DID and DIA
10942 Shane Lauf, Ian S Burnett Mobile MPEG-21 browser implementation
10871
Jeho Nam, Hyuk-Min Kwon , Man-Bae Kim, Seungji Yang, Truong Cong Thang, Rin-Chul Kim, Hae-Kwang Kim
Updated Status of MPEG-21 DIA Utility Software Modules
Thursday Afternoon (14h00-19h00)
MDS Liaison Responses (13h00 - 14h00) Hood 2 (MDS Room)
MPEG-21 JRS
10783 IEC TC 100 via SC 29 Secretariat
IEC CDV 62328-3: Multimedia home server systems -- Interchangeable volume/file structure adaptation for broadcasting receivers -- Part 3: Broadcasting system specific recording structure -- ISDB [SC 29 N 5963]
10784 ITU-T SG 17 via SC 29 SecretariatLiaison Statement from ITU-T SG 17 [SC 29 N 5968]
10897 TVA via SC 29 SecretariatLiaison Statement from the TV-Anytime Forum [SC 29 N 6114]
11147 IEEE LTSC via SC 29 Secretariat Liaison Statement from IEEE LTSC Media Application Formats (14h00 - 15h00) with Requirements Requirements IB MPEG-21 DIP BoG (14h00 - 15h00) St. Helens 3 (BoG Room)
MPEG-21
MPEG-21 REL (14h00 - 15h00) Hood 2 (MDS Room)
MPEG-21 IB
10855Hendry, Kyung-Ae Cha, Munchurl Kim, Keun Soo Park
Answer to the CfP on MPEG-21 IPMP : A Right Description Model on Resource Combinations
Plenary MDS and Reports of BoG (15h00 - 16h00) Hood 2 (MDS Room) MDS Plenary Review of Output documents, AHGs, CEs, DoC, Std (16h00- 18h00) Hood 2 (MDS Room) Friday Morning (09h00-
101
13h00)Wrapping up (09h00 - 13h00) Hood 2 (MDS Room) MDS Plenary
Approval of resolutions, AHGs and Output documents
Friday Afternoon (14h00-21h00)
MPEG Plenary Plenary roomMPEG Plenary
Contact: John R. Smithx
102
Annex 8Report of Video meeting
Source: Jens-Rainer Ohm, Miroslaw Bober
Source: Jens-Rainer OhmContributors: Miroslaw Bober, Aljoscha Smolic, Euee S. Jang
MPEG-4
New Levels in Visual Simple Profile
A request was made for two new levels in Visual Simple Profile. It was emphasized that actually solutions that use the SP for image resolutions larger than CIF presently already exist in the market, but are not actually supported as conformance points. In a joint meeting with the Requirements subgroup, it was therefore decided to start an amendment, both for the standard text (14496-2:2004 Amd.2) and conformance (14496-4:2004 Amd.10) parts. It is planned to go for FPDAM in October and to FDAM in January 2005 meetings. It was considered important that the new levels are defined as compatible with the Advanced Simple Profile, such that eg. SP@L4 could be decoded by an ASP@L4 device.
Documents reviewed: M10910 A. G. Tescher for USNB USNB Contribution: The need for
additional levels for Visual SPM11041 Joseph Meehan, Minhua Zhou, Jennifer
Webb, Felix FernandesMPEG4 Simple-Profile Level 4 and 5 Proposal
New Version of MPEG-4 Visual List of Problems Reported Version 13 of the document "MPEG-4 Visual List of Problems Reported" (N6514) was issued. One issue related to text part (14496-2:2004) was added which is a typo in symbolic code and may therefore lead to mis-interpretation. In general, all remaining issues are of low priority, to be resolved in a later corrigendum. All known bugs in Momusys and Microsoft parts of the reference software are fixed at this time.
Conformance Corrigendum WD2.0
Fixing of Conformance streams being listed as erroneous in the WD 1.0 from previous meeting is still at a very early stage. A website to upload and retrieve corrected bitstream has been installed, but only one additional contribution was made in this period. Therefore, only a small update was made towards WD 2.0 (N6515) The further procedure of this corrigendum is planned as follows:
– The DCOR will be issued October 2004;– All bitstreams that are not available until then will be flagged as to be removed from the
conformance part (14496-4);– As no conformance would exist any more, this would imply a follow-up action where the
related profiles and levels would have to be removed from the standard text (14496-2) at the time the conformance corrigendum is issued (Jan. 2005). As of today, this would affect all video profiles except for the two Studio Profiles. Simple Scalable and Error-resilient Simple
103
Scalable Profiles would not be affected directly, but they would not have a base layer after removal of Simple Profile, which would make them useless.
Documents reviewed:
M10958 Yoshihiro Miyamoto
Proposed Corrigendum to ISO/IEC 14496-4:200X 2nd Edition
AVC
In Redmond, a JVT meeting took place in parallel with the Video Subgroup. Main topics in MPEG-4 part 10 (AVC) were related to the Fidelity Range Extensions amendment (FDAM in N6539), edition 3 (N6540), conformance (N6532, N6533, N6534) and software (N6535, N6536, N6537).The video subgroup recommended approval of all the JVT-related documents by MPEG.
Output documents related to MPEG-4 Video and AVC
No. Title TBP Available
14496-2 MPEG-4 VisualN6495 Request for ISO/IEC 14496-2:2004 Amd.2 No 04/07/21
N6496 Text of ISO/IEC 14496-2:2004 PDAM2 New Levels in Simple Profile
No 04/07/21
N6514 MPEG-4 Visual: List of Problems Reported version 13.0 Yes 04/07/2314496-4 MPEG-4 Conformance
N6497 Request for ISO/IEC 14496-4:2004 Amd.10 No 04/07/21
N6498 Text of ISO/IEC 14496-4:2004 PDAM10 Conformance Extensions for New Levels of Visual Simple Profile
No 04/07/21
N6532 Disposition of Comments on ISO/IEC 14496-4:2004 FPDAM6 No 04/09/15N6533 Text of ISO/IEC 14496-4:2004 FDAM6 AVC Conformance No 04/09/15N6534 Text of ISO/IEC 14496-4:2004 PDAM9 AVC FRExt Conformance No 04/09/15N6515 WD 2.0 of 14496-4 Visual Bitstreams Conformance Corrigendum Yes 04/07/23
14496-5 MPEG-4 Reference SoftwareN6535 Disposition of Comments on ISO/IEC 14496-5:2004 FPDAM6 No 04/09/15N6536 Text of ISO/IEC 14496-5:2004 FDAM6 AVC Reference Software No 04/09/15
N6537 Text of ISO/IEC 14496-5:2004 PDAM8 AVC FRExt Reference Software
No 04/09/15
14496-10 Advanced Video Coding N6538 Disposition of NB Ballot Comments on ISO/IEC
14496-10:2004/FPDAM1 AVC Professional ExtensionsYes 04/08/31
N6539 Text of ISO/IEC 14496-10:2004/FDAM1 AVC Fidelity Range Extensions
No 04/08/31
N6540 Text of ISO/IEC 14496-10 Advanced Video Coding 3rd Edition No 04/08/31
MPEG-7
MPEG-7 related work in Redmond
The MPEG-7 breakout group was active during the whole week. Input documents as reviewed are listed in the subsequent table.
104
M10778 SC 37 via SC 29 Secretariat ISO/IEC FCD 19794-6: Information technology -- Biometric data interchange formats -- Part 6: Iris image data [SC 29 N 5958]
M10779 SC 37 via SC 29 Secretariat SC 37 NP on Vascular Biometric Image Interchange Format [SC 29 N 5959]
M10806 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-7/FPDAM 1 [SC 29 N 6046]
M10842 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 15938-3:2002/FDAM 1 [SC 29 N 6063]
M10916 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-6:2003/FPDAM 1
M10917 JTC 1 Secretariat via SC 29 Secretariat
Summary of Voting on ISO/IEC TR 15938-8/DAM 1
M10933 Karol Wnukowicz, Wladyslaw Skarbek
Dominant Color Temperature Descriptor
M10938 Robert O'Callaghan, Miroslaw Bober
Preliminary Results on Situation/View-Based Clustering
M10947 Sang-Kyun Kim, Seungji Yang, Yong Man Ro, Ji-Yeun Kim
Consideration on the clustering evaluation method for situation/view based photo clustering experiment (VCE-1)
M10948 Sang-Kyun Kim, Seungji Yang, Yong Man Ro, Ji-Yeun Kim
CE Report for situation/view based photo clustering experiment (VCE-1)
M10949 Sang-Kyun Kim, Seungji Yang, Yong Man Ro, Ji-Yeun Kim
GT set proposed for situation/view based photo clustering experiment (VCE-1)
M10950 Sang-Kyun Kim, Seungji Yang, Yong Man Ro, Ji-Yeun Kim
Consideration on the photo categorization scheme (VCE-2)
M10951 Sang-Kyun Kim, Seungji Yang, Yong Man Ro, Ji-Yeun Kim
Model set and GT set for the photo categorization experiment (VCE-2)
M10953 Sang-Kyun Kim, Seungji Yang, Yong Man Ro, Ji-Yeun Kim
Consideration of face based photo clustering and retrieval
M10955 Akio Yamada, Sang-Kyun Kim
MPEG-7 Visual XM Document version 20.1
M10956 Akio Yamada, Sang-Kyun Kim
WD 1.1 of MPEG-7 New Visual Extensions
M10977 Soo-Jun Park, Myung Gil Jang
Cross verification of Model set and GT set for the photo categorization experiment (VCE-2)
M10979 Soo-Jun Park, Myung Gil Jang
Cross verification of GT set proposed for situation/view based photo clustering experiment (VCE-1)
M10980 Soo-Jun Park, Myung Gil Jang
Cross verification reprot of situation/view based photo clustering experiment (VCE-1)
M10981 Soo-Jun Park, Myung Gil Jang
Dataset of VCE-1 and 2
M10986 Soo-Jun Park, Chee Sun Won A proposal for a hierarchical grouping of digital photos CE
105
M10778 SC 37 via SC 29 Secretariat ISO/IEC FCD 19794-6: Information technology -- Biometric data interchange formats -- Part 6: Iris image data [SC 29 N 5958]
The recommendations of the AHG were approved. Two Core Experiments (on Situation/view based image clustering and Categorisation of images) will continue. Two new Core Experiments will start: the first one on Dominant Colour Temperature descriptor and the second one on use of AFR descriptor for ID-based annotation of images. The description of CE is in the output document N6518. The library of images for experimentation was further extended.
Joint meeting was held on file formats for the Photo Album MAF – it was agreed that the latest ISO-based file format can support both media-centric and meta-centric items.
We reviewed updated and issued WD 2.0 of the MPEG-7 new visual extensions. Also, Visual XM document version 21 was reviewed, updated and issued.
Output documents related to MPEG-7 Visual
No. Title TBP Available
15938-3 MPEG-7 VisualN6516 WD 2.0 of MPEG-7 New Visual Extensions No 04/07/23N6517 MPEG-7 Visual XM Document version 21.0 No 04/07/23N6518 Description of Core Experiments for MPEG-7 New Visual
ExtensionsNo 04/07/23
MPEG-21
Scalable Video Coding
The first task was review and interpretation of CE results. It was inherently clear that Core Experiments 1 and 2 were mainly targeting the compression performance over wider ranges of spatial, temporal & SNR resolutions, while keeping the effort for encoding/decoding as low as possible. Therefore, the following conditions had been defined in Munich, to be equally used in CE 1 and CE 2:
• Test 1 scenario: 3 spatial & 3 temporal resolutions at 6 rate points• Test 2 scenario: 2 spatial & 3 temporal resolutions at 5 rate points• 4 sequences in each test
In addition, Core Experiment 3 investigated possible mappings of PSNR and visual perception by performing an in-depth analysis of the CfP results. As a result from this CE, it can be concluded that in cases where SVC algorithms of rather different nature are compared, a useful mapping of subjective and PSNR seems to be impossible. There may be some indicators that PSNR is useful for two different variants of the same algorithm, provided that a comparison can be made against a "high rate reference" (which should be free of visible distortions) as the optimum decoding result. This would, for example, not be useful for the comparison of de-blocking and other post-processing algorithms. Due to the result of this CE, it became clear that it would be necessary to perform subjective viewing tests, for which a new procedure of expert viewing had been proposed (M 10935).
106
The following CEs had been executed:• CE1: MCTF/2D Wavelet solutions. For each of the following sub-experiments, bitstreams were
provided for both Test 1 and Test 2 scenarios. Participants had agreed on one best solution for each sub-experiment during the AHG pre-meeting. All CE1 results were obtained by the software provided by MSRA, or extensions thereof (see AHG report M10758 for more details).
– 1a: Scalable motion information. The participants agreed that the improvement achieved is not significant in terms of visual quality, Therefore, 1a did not participate in the expert viewing tests. As scalable motion is partially integrated in the original MSRA algorithm, this was taken as a placeholder.
– 1b: Spatial transforms. Only one result was reported, which did not show any significant visual improvement yet, according to the participants' judgement. 1b was therefore skipped from the viewing tests.
– 1c: Intra coding. The participants selected a 'best choice' for visual improvement, which moderately applies over most rates.
– 1d: Introduction of base layer. In this CE, it was shown that the MCTF/2D Wavelet algorithm can be significantly improved by introduction of an AVC (compliant) base layer at the lowest QCIF rate. It was reported that also an improvement of the CIF resolutions is achieved, while no significant decrease in quality at the highest (4CIF) spatial resolution was observed. The participants were able to select a "best choice" of the different methods investigated.
– 1e: De-blocking in MC. The participants selected a 'best choice' for visual improvement, which moderately applies over most rates.
Unlike originally planned, it was not possible to combine the best results from the different sub-experiments. Therefore, these were compared against each other and against the CE2 methods in the experts viewing tests. It could however be assumed that a combination of the different best results would improve the overall performance of the MCTF/2DWT algorithms.
• CE2: AVC-based and -extending solutions. CE results were brought by using two different algorithms, one (2a) being an MCTF-extension of AVC without base-layer compatibility, the other two (2b and 2c) using a conformant AVC base layer with scalability extensions. Unfortunatelly, the 2c proponents still used the old rate/resolution settings from the previous CfP, such that it was not possible to compare with any other algorithms. Two different software implementations (HHI, University Póznan) were used in CE2.
– 2a: AVC+MCTF+Differential Pyramid (Test scenarios 1 and 2). Results were reported on sub-experiments 2.1-2.4, a combination of these was provided for the experts viewing tests.
– 2b: AVC+SNR scalability (Test Scenario 2). Results were reported on sub-experiments 2.5. AVC B-slice pyramid (UMCTF-like) was used.
It was decided to compare the results of 1a (original MSRA algorithm), 1c, 1d, 1e, 2a and 2b in the experts viewing tests. It was found that the best performance overall is achieved by the algorithm from 2a (AVC+MCTF+Differential Pyramid). This applies for the wide range of test points, however some detail loss can be observed in two sequences at 4-CIF resolution, as compared to the MCTF/2DWT algorithms. On the other hand, the latter ones produce significantly more artifacts, in particular at low rates. These artifacts are again reduced by the introduction of an AVC base layer (experiment 1d). 1c and 1e are at many points judged better than 1a (all three of them without base layer). 2a also outperformed 2b at most rate/resolution points that were available, where however the comparison is difficult due to the fact that 2b only provided results for Test Scenario 2. The Results of the visual assessment are documented in N6513.From the discussions during the Munich meeting, it was considered important to map the capabilities of scalable codecs with application requirements. A considerable number of input documents was received on this topic, which were summarized in a new version of the SVC
107
applications and requirements document (N6505), and used in the weighting of different algorithms' capabilities, for the purpose of the WD decision that was planned for the Redmond meeting. In general it was found, that different SVC application domains (such as surveillance and mobile services) emphasize different requirements to be of central focus (e.g. surveillance: Support for many combinations of spatial/temporal/SNR scalability; mobile: Compression performance must be comparable or better than single layer). Therefore, one main driving factors for the standardization of SVC is for sure the good compression performance, which should however come with minimum penalty when additional functionality is supported. A solution that performs good at some rate points, but significantly worse at others would not be a good choice. Exactly such behaviour had been the reason to reject other algorithms from the results of the CfP.Objections were raised that the CEs that were run prior to the Redmond meeting might not bring evidence about all possible/useful combinations of scalability, FGS or medium-grain scalability (MGS) capabilities, capabilities for ROI access etc. Proponents of all solutions claimed they can fulfill such additional functionalities. On the other hand, evidence is clearly shown from this reduced set of rate/resolution points that technology exists that can perform high-quality decoding from truncated bitstreams over wide ranges of rates. Therefore, from the results of the past round of Core Experiments, the solution 2a must be regarded as the current "benchmark" of the SVC standardization process. As it could however happen that another algorithm performs significantly better at intermediate rate points or more flexible combinations of spatial/temporal/SNR scalability (as to be proven by evidence from future Core Experiments), a certain danger exists that this benchmark might partially or completely be exchanged by another solution. It is however a part of the MPEG standards success comes due to the fact that stable solutions are developed (not exchanging complete concepts at stages of WD or beyond, as it may indeed be practice in other standardization bodies). Therefore, it was widely agreed in the closing plenary to describe the benchmark algorithm of CE 2a in a document entitled "Technologies under Consideration for Working Draft 1.0 of ISO/IEC 21000-13 Scalable Video Coding" (N6519) ("TuCfWD"). This describes the MCTF process and the differential encoding methods with reference to parts of AVC edition 3.
As a complement, the Scalable Video Model V 2.0 (N6520) was approved. This document• describes the requirements for and capabilities of the SVC software (to be used in core
experiments and later be developed into the standard reference software) • Describes the different capabilities of scalability combinations to be supported and to be
easily implemented (including known technical solutions at high level, such as 2D+t, t+2D, quantization, entropy coding etc.)
• describes the encoding and decoding processes assigned with specific tools of the benchmark ("TuCfWD") more precisely
It was agreed in the video group that presently, SVC CEs should be developed from the basis of the SVM document, i.e. to admit a CE it should fit into the high-level framework of the SVM. In a later stage, this can be developed into a description of non-normative processes related to SVC (similar to MPEG-4 Visual VM or MPEG-7 Visual XM).
The Software to be used in the CEs can be regarded as instantiation of the SVM. It should support easy implementation of the capabilities described in the SVM, as well as extensions thereof. As a part thereof, software exactly mapping the "TuCfWD" benchmark was donated by FhG-HHI under MPEG licensing rules. In fact, not all perspectives of the SVM may presently be supported by the software pacakages provided so far (MSRA, HHI). In the development of the standard, it will be necessary to further develop into one consistent reference software, which would however be premature to start before the WD decision is taken. Due to the importance of this, it was decided to establish an AHG responsible for maintenance of the SVM and the SVC software to be used in the
108
CEs, where already both packages will be run in combination in some activities. This AHG should also discuss concepts about possible integration of only one package.
The previous round of Core Experiments showed a number of deficiencies, which are only partially explainable by the fact that the SVC standardization process is just starting its transition into the convergence/collaboration phase. In particular, it must be stated that many timelines were missed, and the instability of the CE document could be the reason for some mis-interpretations that happened. The following guidelines for the CE document and the description of the single CEs were therefore agreed; it was furthermore agreed that a more precise document describing the SVC CE process will be developed by the next meeting.
The CE document shall describe precisely for each CE- a tool or combination of tools that shall be experimented- the purpose of this tool (or combination of tools) that is challenging the benchmark, shall
improve the benchmark or shall provide functionality that the benchmark is not supporting- the test sequences and test points used in the experimentation (mapping useful application
requirements)- the timeline and responsibilities, partners, cross-check parties etc.- the software configuration (e.g. providing configuration files) that shall be used- criteria to evaluate this CE
Interrelationship of different CEs must be considered, which can best be achieved by using common test sequences and test points (whenever possible) to make results comparable. These common experimental conditions with lowest possible number of test points must be kept fixed (if reasonable) to be able to track the progress that is made from one meeting to the next. For this purpose, it is reasonable to retain the sequence/rate/resolution definitions used in the Test 1 and 2 Scenarios of previous round. It is known that these provide operating points for viewing tests with distinguishable results. In addition, it was agreed that it will be necessary to add more test points. These will be used to explore the performance of algorithms for a wider variety of scalability combinations. To make this possible without being forced to compare a large number of results visually, additional points from a table (t.b.d. in the CE document) will be selected randomly. This selection will only be made after the bitstreams, bitstream extractors and decoders have been provided. Therefore, it is expected that it will not be possible to tune an algorithm for optimum performance only at pre-selected rate points. Core Experiments newly defined may use any of the software package that have been made available, combinations or extensions thereof. The CEs can be clustered into three different categories:
• CE 1: The purpose of this CE is to compare complete algorithms, layered combinations of algorithms or combinations of tools into algorithms. Only a complete solution that has brought evidence by participating CE 1 can be accepted into WD by the next meeting. If a solution from one of the other CEs (2-6) intends to be approved for WD, it must become readily integrated into an algorithm proposed in CE 1 and show CE 1 evidence in time for the next meeting. CE 1 should provide results from the fixed rate/resolution conditions (as from Munich) and the new procedure of randomly selected points. Results of CE 1 will again be compared by the same procedure of experts viewing tests.
• CE 2-6: The purpose of these CEs is to compare evidence of single tools, mostly in terms of compression performance improvement. The purpose of these CEs is to find promising techniques that are worthwhile to become integrated into CE 1 by the mid of the period, or need further investigation in future CEs. Whenever possible, these CEs should stick to the Test 1 and 2 Scenarios of previous round, to minimize the effort. When useful for the purpose of a specific CE, it might also be subsets or extensions thereof.
109
• CE 7-8: The purpose of these CEs is to explore additional functionality that are useful from specific application perspectives.
The list of second and third category CEs is as follows (see details in CE document, N6521):• CE 2: Base-layer investigation• CE 3: Coding efficiency vs. low-delay constraints• CE 4: Adaptation of MCTF update step• CE 5: Spatial scalability• CE 6: SNR scalability and FGS• CE 7: Non-linear adaptation
– Explores the capability of different "traces" of multiple adaptations (e.g. for erosion storage)
• CE 8: Error resiliency and robustness– Explores behaviour of SVC in presence of channel errors– Typically IP, 3G networks– Usage of MPEG-21 resource delivery testbed planned
Due to the lack of time during the meeting, N6521 needs further improvement, and a 2 weeks editing period is requested. It is consensus in the group that any experiments which do not provide the refined description with sufficient precision to guarantee success will be cancelled.
In addition to the reports about CE results, which were treated with highest priority, a number of technical input documents were reviewed, for which some notes are shortly summarized here. A complete list of titles can be found below under table c):M11131. Modify EBCOT such that not the directional correlation is used in temporal lowpass frame encoding, instead directional prediction is performed. Directional angles are estimated locally, each macroblock uses only one prediction direction. Gives up to 2 dB for Barbara in JPEG-2000 (less in others), and 0.5 dB in Foreman for MSRA MCTF. No other sequences investigated.M10904. Goal: Design better lowpass filters for aliasing cancellation. Used the filters only for SD->CIF conversion, CIF->QCIF was again done by 9/7. In City sequence, loss of 0.5 dB on SD, gain of 1 dB at CIF. M11096) Joint estimation for multiple rate points, some visual gain at highest QCIF rateM10902. Accuracy scalability of motion vectors, modification of the estimation. Gain of up to 0.75 dB at highest rate (City, other sequences much lower, usually 0.1..0.2)M11016. Motion coding based on prediction, differences handled by bit-plane coding. Rate distortion optimization, distortion criterion is difference between "true" H frame and H frame as generated by scalable motion representation. Implemented in SDMCTF of VUB. Gain of up to 2 dB at lowest rate for sequences with complex motion, less for sequences with simple motion. Also integrated into MSRA software; similar gain. All results only in context of quality scalability at CIF resolution.M11100. Coarse-to-fine and fine-to-coarse prediction of motion vectors, Laplacian pyramid approach. CotoFi: Slight increase of PSNR if QCIF motion vectors are used for interpolative prediction of CIF resolution. FitoCo: Usage of decimated CIF motion vectors improves performance at CIF (Foreman 1dB, other sequences less), but predictive coding from decimated vectors leads to some loss at CIF. However, a larger number of blocks is used at QCIF when the decimated vectors are used.M11039. Five different intra prediction or interpolation modes. Usually gain at low bit rates and in cases of complex motion (eventually already at near transition towards "bad quality"?).M10875. Propose different temporal scalability structures in AVC (p-frame, b-frame, hierarchical b-frame). Up to three layers, moderate loss as compared to non-lossless.M11126. 2D+t scheme: problems are high-subband leak and mismatch, non-exchangeability between s+t. Different methods are investigated (incl. ODWT). Approach that selects additional
110
highpass coefficient to prevent drift appears most promising. Additional buffers necessary for the upsampling to full resolution (overcomplete). Request for investigation in CE. M10993. MSRA barbell lifting uses bilinear interpolation in update step, in case of motion discontinuities artifacts can occur. In case of homogeneous motion, 2D+t and t+2D would be equivalent. In case of motion discontinuity, additional highpass coefficients would have to be transmitted to make it equivalent. Have implemented in reference software. Encoder not changed, only decoder, DWT interpolation used rather than sinc. Gain approx. 0.1 dB. Small gain visually at data rates testedM10997. Propose hybrid layered compression with AVC base and MCTF enhancement. Shows clear improvement, also in cases of low delay. "Should become basis approach in SVC".M11084. Investigate different structures wrt delay, e.g. 5/3, Haar etc. E.g. by not performing update, the delay can be bounded. Generally, performance increases with increased delay. Find that it is better to keep the update, usually gives better performance in case of equal delay. This is of course sequence dependent.M11045. spatial and temporal transforms not interchangeable. Use overcomplete representation to solve the problem. Tendency: At low rates IBMCTF better by up to 4 dB, at high rates usually 0.5 dB worse than SDMCTF.M11130. Problem in 2D+t: shift variance of wavelet transform. In principle similar to a complete-to-overcomplete transform. Use AVC codecs to code the single subbands. Loss as compared to t+2D relatively low (but SNR ??) Propose CE to study other structures such as 2D+t or 2D+t+2D.M10868. Application (JPIP, similar to the military surveillance) which cannot be done without scalability. Ghosting artifacts if motion trajectory is not appropriate. Adaptively adapt the update step to circumvent this problem, which even gives sometimes higher compression performance. Spatial scalability: No interchangeability. Efficient spatial scalability cannot be achieved without 2D+t. 2D+t shows higher aliasing than t+2D, but latter one is inferior when motion model fails. Best would be to combine both. Use MJPEG2000 variant which extends the blocks into the third dimension, such that adaptation becomes better.
Joint meetings were held with JPEG and VCEG, the purpose of which was to inform the other bodies about progress in the SVC standardization process. Unfortunately, when the meetings were held, it was not yet possible to give any concrete information about progress in technology selection. Therefore, only information about the status of CE results (including the algorithms behind) could be given, and the results of experts viewing were shortly imported. Both groups showed high interest in SVC, in particular raised by the fact that the solutions investigated are using or extending parts of their own standardization work.Documents reviewed:
a) GeneralM10935 Vittorio Barboncini, Tobias
OelbaumA Multimedia material Visual quality ranking procedure based on Single or Multiple Viewing
M11012 DANAE Consortium Licensing status of software in SVC standardizationM11108 Justin Ridge, Marta
Karczewicz, Yiliang Bao, Shawn Wang
Comment regarding SVC software selection
b) Core Experiments
M10931 Ulrich Benzler, Mathias Wien
Results of SVC CE3 (Quality Evaluation)
M10934 Han-Kuang Hsu, Chia-Yang Response to CE1b in SVC-- SB-Reach Method for
111
Tsai, Hsiang-Cheh Huang, Hsueh-Ming Hang, Tihao Chiang
Entropy Coding
M10946 Takahiro Kimoto, Yoshihiro Miyamoto
Response to SVC Core Experiment 1d. Introduction of a Base-Layer
M10987 Julien Reichel, Guillaume Baud, Francesco Ziliani
Responses of CE1e in SVC: Adaptive update step in MCTF
M10988 Diego Santa Cruz, Julien Reichel, Francesco Ziliani
Responses of CE1d in SVC: Base Layer
M10989 Francesco Ziliani Summary of responces to Ce1d: Introduction of a Baser Layer
M11010 Konstantin Hanke SVC CE1e - Verification of Visiowave Results on Adaptive Update Step in MCTF
M11011 Konstantin Hanke Response to SVC CE1e - Spatial Highpass Transition Filtering
M11020 Thomas Wedi Verification of HHI Results for Core Experiments on AVC-Based Scalable Video Coding
M11040 Mathias Wien CE2.4 Adaptive Spatial Transforms: Verification of HHI results
M11042 Woo-Jin Han Verification of SAIT results for SVC on CE1a Motion Scalability
M11043 Heiko Schwarz, Detlev Marpe, Thomas Wiegand
SVC Core Experiment 2.1: Inter-layer prediction of motion and residual data
M11047 Woo-Jin Han, Sang-Chang Cha
Verification of OES/ITRI results for SVC on CE1c Intra Prediction
M11048 Heiko Schwarz, Detlev Marpe, Thomas Wiegand
SVC Core Experiment 2.2: Influence of the update step on the coding efficiency
M11049 Woo-Jin Han, Ho-Jin Ha Verification of VisioWave results for SVC on CE1d Base Layer
M11050 Woo-Jin Han, Sang-Chang Cha, Jae-Young Lee
Verification of MSRA results for SVC on CE1e Deblocking
M11051 Heiko Schwarz, Detlev Marpe, Thomas Wiegand
SVC Core Experiment 2.3: Spatial interpolation
M11052 Heiko Schwarz, Detlev Marpe, Thomas Wiegand
SVC Core Experiment 2.4: Adaptive Spatial Transforms
M11054 Woo-Jin HanSang-Chang Cha
Responses of SVC CE1c Intra Predictionl; Pixel-interpolated prediction
M11055 Woo-Jin Han, Ho-Jin Ha Responses of SVC CE1d Base Layer; R-D optimized base-layering
M11056 Woo-Jin Han, Sang-Chang Cha, Jae-Young Lee
Responses of SVC CE1e Deblocking; In-loop prediction smoothing
M11069 Vatis Jörn Ostermann verification of HHI results for core experiment on scalible video coding
M11074 Davide Maestroni, Marco Tagliasacchi, Stefano Tubaro
Responses of CE1d in SVC: Base Layer
M11085 Gregoire Pau, Beatrice Pesquet-Popescu
Cross-verification of RWTH results on SVC CE-1e
M11095 Diego Santa Cruz Cross-verification of results for SVC on CE1dM11099 Rafal Lange, Marek Response to SVC CE2: inter-layer motion
112
Domanski information predictionM11101 Laukasz Blaszak, Marek
Domanski, Rafal Lange, Adam Luczak
Response to SVC CE2: testing of SNR scalability technologies
M11107 Justin Ridge, Marta Karczewicz, Yiliang Bao, Shawn Wang
Extension to AVC-based scalable video coding
M11120 Francois Edouard CE1a : cross verification of MSRA proposalM11122 Giovanni Cordara CE1a: TILAB-PdM solutionM11123 Ji Jizheng Xu Verification of NCTU results for SVC on CE1b,
entropy codingM11124 Xiong Jizheng Xu Verification of TILAB/PdM results for SVC on
CE1aM11125 Song Jizheng Xu Verification of SUMSUNG results for SVC on CE1cM11127 Ji Jizheng Xu Debin Zhao
Feng WuResponses of CE1d in SVC: Base layer
M11128 Xiong Jizheng Xu Feng Wu Responses of CE1a in SVC: Scalable MotionM11129 Song Jizheng Xu Hongkai
Xiong Feng WuResponses of CE1e in SVC: Adaptive update based on human vision system
M11136 Feng Pan, Yin Sun SVC CE1e - Verification of MSRA Results on MCTF adaptation in the temporal update step
M11137 Joohee Kim, Hyeyeon Kim Responses to SVC CE1a: scalable motion information coding
M11138 HsinHao Chen Verification Report of Samsung results for SVC on CE1c: Intra-prediction
M11139 Giovanni Cordara CE1a : cross verification of Samsung proposal
c) Other technical input
M10868 David Taubman, Nagita Mehrseresht, Raymond Leung
SVC Technical Contribution: Overview of recent technology developments at UNSW
M10875 Shijun Sun Temporal Scalable Coding Using AVC Coding ToolsM10902 Francois Edouard,
Boisson Guillaume, Vieron Jerome, Bottreau Vincent, Guillemot Christine
Evaluation of Motion accuracy scalability - SVC Core experiment 1a
M10904 Vincent Bottreau, Christine Guillemot, Rashid Ansari, Edouard Francois
SVC Technical Contribution to CE1b: Spatial Transform using Three Lifting Steps
M10993 Pateux, Amonou, Kervadec
A generic framework for MCTF-based coding
M10997 Ihor Kirenko, Rene van der Vleuten, Fons Bruls
Flexible Scalable Video Compression
M11016 Joeri Barbarien, Adrian Munteanu, Yiannis Andreopoulos, Fabio
Prediction-based scalable motion vector coding
113
Verdicchio, Jan Cornelis, Peter Schelkens
M11039 Leszek Cieplinski, Soroush Ghanbari
Preliminary Results of SVC CE1c
M11045 Y. Andreopoulos, A. Munteanu, M. van der Schaar, J. Cornelis, P. Schelkens
Comparison Between t+2D and 2D+t Architectures with Advanced Motion Compensated Temporal Filtering
M11084 Gregoire Pau, Beatrice Pesquet-Popescu, Mihaela van der Schaar, Jerome Vieron
Delay-Performance Trade-Offs in Motion-Compensated Scalable Subband Video Compression
M11096 Thomas Rusert, Mathias Wien
Multi-Layered Motion Estimation with Constrained Enhancement (SVC CE1a)
M11100 Deepak Turaga, Ali Tabatabai, Minh Do
Multiresolution Representation of Motion Information for Scalable Video Coding
M11119 Hsin-Hao Chen, Guo-Zua Wu, Yi-Jung Wang
Proposed CE for Exploiting the Spatial Correlation within the Low-Pass Frames
M11126 Xiong, Jizheng Xu, Feng Wu
Spatial Scalability in 3D Wavelet Coding with Spatial Domain MCTF Encoder
M11130 Zhang, Jizheng Xu, Hongkai Xiong, Feng Wu
Sub-pixel phase over-complete sub-band transform
M11131 Zhang, Wenpeng Ding, Jizheng Xu, Hanqin Lu, Feng Wu
Responses of CE1b in SVC: Direction prediction for spatial transform
d) Requirements
M10822 Robert Prandolini Scalable Video Coding Requirements for Video Surveillance Systems
M10853 Mauri Väänänen Finnish NB comment: SVC requirements and directions
M10901 Francois Edouard, Vieron Jerome
Discussion on requirements and applications of Scalable Video Coding
M10909 A. G. Tescher for USNB USNB Contribution: Response to Munich resolution 2.2.2
M10932 Ulrich Benzler Discussion on requirements and applications for Scalable Video Coding
M10941 Sachin Deshpande HTTP Agent-Driven Content Negotiation for Scalable Video Coding
M10995 Pateux, Amonou, Kervadec France Telecom Requirements for Scalable Video Coding
M10998 Gero Bäse, Andreas Hutter, Peter Amon
Requirements for a scalable video coding standard
M11067 Julien Reichel, Francesco Ziliani
Requirements for Scalable Video Coding for Video Surveillance Applications
M11082 French National Body FNB Position on SVC StandardizationM11097 Ali Tabatabai, Rohit Puri Multiple description coding for generalized layeringM11106 Justin Ridge Mobile communications industry comments on SVC
114
requirementsM11133 Guillemot, Liebl,
Stockhammer, JenkacDiscussion on requirements and applications of Scalable Video Coding for MBMS
Output documents related to MPEG-21 SVC
No. Title TBP Available
21000-13 Scalable Video Coding
N6519 Technologies under Consideration for Working Draft of ISO/IEC 21000-13 Scalable Video Coding
No 04/07/23
N6520 Scalable Video Model Version 2.0 No 04/08/06
N6521 Description of Core Experiments in MPEG-21 Scalable Video Coding
No 04/08/06
N6513 Results of the visual assessment of the results of the CEs on Scalable Video Coding Technology
No 04/07/23
N6505 Applications and Requirements of Scalable Video Coding No 04/07/23
Explorations
3D AV Coding
Multiview video coding (MVC) is a “tool” needed for new and emerging applications such as Free Viewpoint Video (FVV) or 3D-TV. A straight-forward solution would be simulcast of AVC streams. By input brought to this and previous meetings, initial evidence is given that dedicated MVC methods could outperform AVC simulcast. To prove this, a formal Call for Evidence (CfE) shall be issued, which may lead to a subsequent CfP on MVC. Such new technology should expose significant improvement of coding efficiency compared to AVC simulcast, which means significant improvement of PSNR results and/or significant improvement of visual quality, to be measured most probably by expert viewing (similar to the procedure employed in SVC development) in the CfE. Elaboration of an appropriate testing methodology is of high importance in this context. A proposal was made in M10870 to use DSIS compared to original, which would give a scaled and quantified test result. This would however be difficult to perform in reviewing CfE results during an MPEG meeting (maybe later in formal subjective tests when it comes to a CfP). A-B comparison of anchors against proposals by a more coarse decision (better, equal, worse) would provide the evidence that is needed, and could easily be performed by an experts viewing procedure.It is of high importance also to judge the quality distribution over all camera views of a data set. This means that proponents shall provide detailed PSNR results such as
– Plots of PSNR over frame for each sequence of each data set– Mean PSNR over each sequence of each data set– Mean PSNR over all sequences of each data set
This needs to be produced also for the anchors. Results have to be made available for the complete test data set. The proponents shall report
– detailed PSNR results (as above)– algorithms– complexity in relation to AVC (informative, brief)– target application
For the purpose of the CfE, 10 test sequence sets with 5-16 views were provided and encoded using AVC simulcast anchors. If each set of sequences would have to be encoded at 3 bitrates, this would
115
make the comparison of » 210 sequences for each proposal necessary. To reduce this effort, only two views shall be selected randomly for the viewing. Additionally, results bringing evidence about the interrelation between compression and view interpolation could be submitted.The following timeline is planned
– Preliminary Call for Evidence issued in Redmond (public)– Preliminary results are requested for Palma meeting to further refine testing
methodology when necessary– Final Call for Evidence issued in October– Results expected for January 2005
Technical input was reviewed as follows:M10929 showed the effect of a spatio-temporal prediction scheme (kind-of multi-frame prediction), Flamenco and Xmas test sequences were chosen. Large gains are reported for Xmas. Subsampling is performed by omitting views, gain decreases with camera distance. No gain for Flamenco, gain increases with temporal subsampling.M10976 resumes the GoGOP proposal from last meeting, presents extended spatio-temporal prediction structure. Reports gain of over 1 dB for most sequences of Race2 data set, also visual quality is improved. M11014 uses the Aquarium sequence and evaluates spatial and temporal frame differences before and after compensation. It presents a projective transform (rectification) and evaluates residual error before and after transformation, which is reduced.M11132 proposes illumination compensation (IC) for MVC, compares ST method with and without IC and reports gain from IC in some (sparse) cases. It compares also to AVC simulcast and reports gain for some sequencesDocuments reviewed:M10870 Marco Rittermann A Proposal for Testing Multi-View
Video CodingM10894 Stephan Würmlin, Michael Waschbüsch,
Edouard Lamboray, Peter Kaufmann, Aljoscha Smolic, Markus Gross
Image-space Free-viewpoint Video
M10928 Wook-Joong Kim, Euee. S. Jang Consideration on the MAF for omni-directional AV
M10929 Ulrich Fecker, Andre Kaup Transposed Picture Ordering for Dynamic Light Field Coding
M10943 Sun Lifeng, Zhang Hu, Yang Shiqiang, Cheng Xiaoyu, Li Fang
Results for EE3 on evaluation of MAC for stereoscopic video coding (contributors not present)
M10952 Cheng Xiaoyu Consideration on Quality Measure for Multiview Video (contributors not present)
M10970 Li Fang, Sun Lifeng, Yang Shiqiang Consideration on Synthesis Method for Multiview Video
M10975 Hideaki Kimata, Masaki Kitahara Anchor bitstreams for experiments on multiple view video coding (3DAV)
M10976 Hideaki Kimata, Masaki Kitahara Preliminary results on multiple view video coding (3DAV)
M11014 Masayuki Tanimoto, Toshiaki Fujii Utilization of inter-view correlation for multiple view video coding
M11132 Chen Jae, Hoon Kim, Joaquín López, Antonio Ortega
Illumination Compensation for Multi View Compression
116
Video Coding Tools Repository
Two breakout meetings were held to discuss VCTR matters during the MPEG week. Three contributions are reviewed. A joint meeting with Implementation Study Group was also arranged to discuss issues regarding software and hardware implementation aspects of this work. Throughout the discussion, the updates are made to the Study 2.0 document as an output.
Some highlights of VCTR discussions are: What is the Repository? - Is a collection of decoding functional units extracted from
existing MPEG standards and updated with new tools whose addition has been considered beneficial by MPEG.
What is a Decoder Configuration? - A collection of functional units drawn from the repository. A decoder configuration may be an existing MPEG standard or a new standard that includes new functional units.
Intra-only video coding as a starting point – it is decided to pursue VCTR from intra-only video coding first. It is expected to extend VCTR further to encompass inter-frame coding and other functionalities in the future.
Remaining issues – There are some remaining open issues such as software implementation of VCTR and detailed picture of VCTR. These remaining issues will be discussed through the continuing AhG activity till October.
Details on VCTR can be found in Study 2.0 document (N6522).
Documents reviewed:M10966 Euee S. Jang, Lee, Cho, Lee Initial thoughts on VCTR activityM11142 C.J. Tsai Universal Video Codec Architecture
SuggestionsM11143 Kohtaro Asai Exercise of intra-only video coding tools
repository
Output documents related to Explorations
No. Title TBP Available3D AV
N6494 Preliminary Call for Evidence on Multiple View Video Coding Yes 04/07/23N6501 Applications and Requirements of Multiple View Video
Coding Yes 04/07/23
Video Coding Tools RepositoryN6522 Study of Video Coding Tools Repository No 04/07/23
Miscellanea
A joint meeting was held with Requirements on issues of Persistent Association Technologies (PAT). It was identified that some technical aspects fall for sure into the competence of the Video group; on the other hand, aspects such as visibility of watermarks that seem to be more important at this moment from a requirements perspective, should rather be discussed with the Test group.Documents reviewed
M10885 Jong-Tae Kim, Weon-Geun Oh, Hae- Video Extension to Evaluation Tools for
117
Kwang Kim, Heung-Kyu Lee, Young-Ho Seo
Persistent Association Technologies
M10886 Ik-Hwan Cho, Hae Kwang Kim, Weon-Geun Oh, Dong-Seok Jeong
Composition of Test Video Sequences for Evaluation of the robustness of PAT
AHGs established by the Video Subgroup No. Title Mtg652
3AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance
N
6524
AHG on Maintenance of MPEG-7 Visual related Documents and Reference Software
N
6525
AHG on Description Tools for New MPEG-7 Visual Extensions Y
6526
AHG on Core Experiments in Scalable Video Coding Y
6527
AHG on Scalable Video Model and SVC Software N
6528
AHG on 3DAV Coding Y
6529
AHG on Video Coding Tools Repository Y
118
Annex 9Report of Audio meeting
Source: S. Quackenbush, Chair, Audio Subgroup
1 OPENING OF THE MEETING..........................................................................................................3
2 ADMINISTRATIVE MATTERS.........................................................................................................3
2.1 Approval of previous meeting report........................................................................................................3
2.2 Approval of agenda and allocation of contributions................................................................................3
2.3 Communications from the Chair.............................................................................................................. 3
2.4 Joint meetings............................................................................................................................................ 3
2.5 Received National Body Comments and Liaison matters........................................................................3
2.6 Task Groups.............................................................................................................................................. 3
3 AHG MEETINGS.............................................................................................................................. 3
3.1 Synthetic Music Representation (Sunday 0900 – 1800)............................................................................3
3.2 MPEG-4 Lossless Coding (Sunday 1000-1200).........................................................................................4
3.3 Spatial Audio Coding (Sunday 1200-1800)...............................................................................................4
4 AUDIO PLENARY, JOINT MEETING AND TASK GROUP ACTIVITIES..........................................6
4.1 Review of AHG reports............................................................................................................................. 7
4.2 Received national body comments and liaison matters............................................................................7
4.3 Audio plenary discussions......................................................................................................................... 74.3.1 Parametric Stereo Verification Test Report..........................................................................................74.3.2 Spatial Audio Evaluation..................................................................................................................... 7
4.4 Joint Meetings........................................................................................................................................... 74.4.1 With Requirements, Systems and MDS on MAF Tue 1100-1130.........................................................74.4.2 With Requirements on US NB Comment Tue 1130-1200.....................................................................84.4.3 With Systems on Audio Codec Behavior, Wed 1600-1700...................................................................84.4.4 With Systems on AU ballot comments on MAF, Thu 1230-1400.........................................................84.4.5 With Requirements New Profiles and SMR CfP Thu 1400-1430..........................................................8
4.5 Task Group discussions............................................................................................................................. 84.5.1 HE-AAC.............................................................................................................................................. 84.5.2 Layer III.............................................................................................................................................. 9
119
4.5.3 MPEG-4 Lossless Audio Coding.......................................................................................................... 94.5.4 MPEG-7 Audio.................................................................................................................................. 104.5.5 MPEG-A............................................................................................................................................ 104.5.6 MPEG-4 Audio.................................................................................................................................. 104.5.7 Spatial Audio Coding......................................................................................................................... 114.5.8 Symbolic Music Representation......................................................................................................... 114.5.9 Scalable Audio Coding...................................................................................................................... 11
5 MEETING DELIVERABLES...........................................................................................................11
5.1 Press statement........................................................................................................................................ 11
5.2 Dispositions of Comments....................................................................................................................... 11
5.3 Responses to Liaison and NB comments.................................................................................................11
5.4 Recommendations for final plenary........................................................................................................ 11
5.5 Establishment of Ad-hoc Groups............................................................................................................ 11
5.6 Approval of output documents................................................................................................................ 11
6 FUTURE ACTIVITIES....................................................................................................................11
6.1 Schedule of future meetings.................................................................................................................... 11
6.2 Agenda for next meeting......................................................................................................................... 11
6.3 All other business..................................................................................................................................... 11
6.4 Closing of the meeting............................................................................................................................. 12
ANNEX A PARTICIPANTS...............................................................................................................13
ANNEX B AUDIO CONTRIBUTIONS AND SCHEDULE...................................................................14
ANNEX C TASK GROUPS...............................................................................................................18
ANNEX D OUTPUT DOCUMENTS...................................................................................................20
Annex E Agenda for the 70th MPEG Audio Meeting..........................................................................22
120
Opening of the meetingThe MPEG Audio Subgroup meeting was held during the 69th meeting of WG11, July 19-23, 2004, Redmond, WA, USA. The list of participants is given in Annex A.
Administrative matters
Approval of previous meeting reportThe 68th Audio Subgroup meeting report had been previously distributed by e-mail and was approved.
Approval of agenda and allocation of contributionsThe agenda and schedule for the meeting was discussed, edited and approved. It shows the documents contributed to this meeting and presented to the Audio Subgroup, either in the task groups or in Audio plenary. The Chair brought relevant documents from Requirements, Systems and MDS to the attention of the group. It was revised in the course of the week to reflect the progress of the meeting, and the final version is shown in Annex B.
Communications from the ChairThe Chair summarised the issues raised at the Sunday evening Chair’s meeting, proposed task groups for the week, and proposed agenda items for discussion in Audio plenary.
Joint meetingsThe joint meetings with Audio over the course of the week are listed here and are reported on below.
Groups What Where Day TimeAudio, Req, Sys, MDS
10944, AUNB Comments10962, MAF file format
Audio Tue 1100-1130
Audio, Req USNB Comment Audio Tue 1130-1200Audio, Systems 11080, Audio Codec Behavior Audio Wed 1600-1700Audio, Req AUNB DoC Audio Thu 1230-1400Audio, Req Review SMR CfP requirements
Review new profile proposalsAudio Thu 1400-1430
Received National Body Comments and Liaison mattersThe NB Comments and Liaison documents for the meeting that require a response are as shown below.No. Title Response by
10906 USNB Contribution: Proposed CfP for Scalable Audio under MPEG 21 S. Quackenbush
10991 SgNB Comment on the Lossless Audio Coding Work S. Quackenbush11102 FNB Position Paper on MPEG applications, context and objective s S. Quackenbush
Task GroupsTask groups were convened for the duration of the MPEG meeting, as shown in Annex C Results of task group activities are reported below.
AhG meetings
121
In order to obtain a compete view of the business of this MPEG meeting, discussion of contributions in AhG meetings are recorded in this section of the Audio report.
Synthetic Music Representation (Sunday 0900 – 1800)Micheal Good, Recordare, presented
11083 Michael Good Response to Draft Call for Proposals N6457
There was considerable discussion of this document and of the CfP and the Evaluation document. Paolo Nesi presented the following documents:
11002 James Ingram Comments on Symbolic Music Representation requirements
11021
Paolo NesiPierfrancesco BelliniJerome BarthelemyJames IngramNeil McKenzie
Examples of matching SMR aspects and available technologies
11019
Paolo NesiGiorgio ZoiaPierfrancesco BelliniJerome BarthelemyJames IngramDavid Crombie
Draft Evaluation Criteria for Assessing SMR Proposals
11025
Paolo NesiGiorgio ZoiaJames IngramPiefrancesco Bellini
Study on Draft CfP on Symbolic Music Representation
MPEG-4 Lossless Coding (Sunday 1000-1200)Ralf Geiger, FhG, presented
11079 Ralf GeigerJuergen Herre On the Performance of MPEG-4 SLS RM4
Rongshan Yu, I2R, presented
11059 Rongshan YuCrosscheck on FhG’s Proposed Core Experiment for MPEG-4 Audio Scalable to Lossless (SLS) Coding
The Audio Chair proposed that Audio Subgroup document the current performance and complexity of SLS and ALS as a Task Group activity. The various authors each presented:
11062
Rongshan YuSusanto RahardjaXiao LinHaibin Huang
Reduce Complexity for MPEG-4 Audio Scalable Lossless (SLS) Coding
11063 Tilman Liebchen Proposed Core Experiment on Higher Predictor Orders in MPEG-4 ALS
11114 Yuriy A. Reznik Proposed CE on Additional Enhancements for Lo ssless Audio Coding
122
Spatial Audio Coding (Sunday 1200-1800)Werner Oomen presented
11001 Heiko PurnhagenWerner Oomen
CT/Philips contribution to CfP on spatial audio coding
Philips and CT presented their submission in response to the CfP on spatial audio coding (M11001). The Philips/CT architecture is completely based on the parametric strereo technology as standardised in Amd2. Philips/CT presented informal test results for all the 3 configurations that will be evaluated prior to the next meeting. Additionally, the document contained input on this evaluation process. Listening test participants were given careful instructions with respect to assessment of coding distortions and sound stage distortions. Three test results were presented for 5-1-5 and 5-2-5 with AAC core and 48 kb/s with HE-AAC core. Proposals for evaluation of multi-channel material
Use 5.0 material only Use 44.1 kHz material only
Evaluation of downmixed material Use band-limited ITU downmixes as lowpass anchors Use RMS values for normalization of downmixes
Selection criterion1. mean quality is paramount2. Consistency of individual items (select technology that maximizes the minimum
performance)3. Complexity4. Features
Spatial side information bitrate Higher for 5-1-5 and 5-2-5, e.g. 32 kb/s total Lower rates will be tested by 48 kb/s HE-AAC test scenario 48 kb/s test will use a single integrated bitstream (with side information muxed into the
main bitstream) so that one can insure that the AAC input buffer requirements are met.Test material categories
“orchestral” sound stage “synthetic” sound stage movie sound track (i.e. strong center channel dialog) “pathological” material (e.g. castpan or applause)
Jim Johnston, Microsoft, noted that it would be very good if some of the test items represented acoustic soundfields as result from actual recordings. Many currently available test items are mixed from discrete voices which may not represent a soundfield of an actual performance. Kok-Seng Chong presented
11015Naoya TanakaKok-Seng ChongKazuhiro Iida
Technical Description and Performance Test Results of Panasonic Spatial Audio Coding
This document presented listening test results for 6-1-6 and 6-2-6 modes using an AAC core. It noted that the bandwidth of the proposed technology was limited due the bandwidth of the AAC core. Side information rate was less than 24 kb/s for 6-1-6 and less than 32 kb/s for 6-2-6. They matched the level of the Dolby Prologic II signal to that of the other processed test items via multi-listener subjective assessment.
123
Kazuhiro Iida presented comments on the evaluation process. The perception of multi-channel signals have three attributes:
Spatial (soundstage) Temporal (reverberation) Qualitative (e.g. timber)
He proposes that listening test responses try to capture Spatial attribute (e.g via a separate response panel) Timber (e.g. via a conventional MUSHRA response panel)
There was some very interesting discussion on low anchors: low “frequency” filtered or low “space” filtered. The Audio Chair suggested that it might be best if the Audio Subgroup not make the CfP evaluation into a research project on low anchors for spatial audio coding.Juergen Herre, FhG, presented
11075
Juergen HerreChristof FallerC. SpengerJ. HilpertK. Linzmeier
Fraunhofer/Agere Submission to Spatial Audio CfP
Proposed the following general system characteristics That the technology be “coder-agnostic.” One outcome of this position is that the technology needs to adapt
to a range of coder frame lengths. That the system does not depend on a given downmix procedure. One extreme of this position is that the
technology support arbitrary, externally generated downmixes of the multichannel signal, most significantly as done by an expert sound engineer.
Side information rate was less than 20 kb/s for 5-1-5 and below 24 kb/s for 5-2-5.
The presentation suggested that the evaluation might want to consider multiple technology solutions that may present complexity/quality tradeoffs.
Mark Vinton presented
11090
Matt FellersMark VintonMark DavisGrant Davidson
Dolby Laboratories Submission to CfP on MPEG-4 Spatial Audio Coding
Listening test used 16 kb/s for side information and 64 kb/s AAC for encoding the downmix. The test evaluated two systems for n-1-n and one system for n-2-n. Dolby is able to make available a new 5.1 test item (“Stomp”) for this MPEG work.
Dolby’s only comment on evaluation process is that the currently proposed Test 3 should instead use a “black box” encoder rather than a “user-optimized” encoder.
Juergen Herre presented
11076 Juergen Herre
Evaluation of Spatial Audio Coding Schemes
This contribution made two points concerning evaluation. First point is that systems that exploit spatial coding may be optimal at one listener position but not another. Hence it proposes that systems be evaluated for “off-center” listening positions, or at least that a “sanity check” be conducted at off-center listening positions. This may be implemented as additional listener instructions and associated listener comments.
The second point is that support for external downmixes (e.g. hand-crafted stereo mixes) is very important for success in the marketplace. Potential customers that currently rely on such hand-crafted stereo mixes may be reluctant to adopt a technology that has been tested only on automatically generated stereo mixes. FhG has made available two sets of hand-crafted material, one stressing the instruments present in the downmix, the other stressing the soundstage of the downmix. The goal in using these downmixes is twofold: first to test that a “well-behaved” hand-crafted downmix can lead to a highly acceptable multichannel signal; the second is that a “pathological” hand-crafted
124
downmix (e.g. missing an instrument) does not result in a multichannel signal with artefacts due to the missing instrument.
Finally, the contribution observes that certain test items will stress the core coder (i.e. AAC at 64 kb/s/channel) to the extent that the core coder distortion will dominate the spatial audio coder presentation.
FhG endorses evaluation using 5.1 (i.e. subwoofer) signals.
Discussion of evaluation
Paul Jessop, IFPI, stated that many respected mastering studios only produce separate hand-crafted stereo and multichannel mixes. He suspects that technology that can only present automated stereo downmix from the multichannel signal will not be endorsed by artists or mastering engineers and hence might not be accepted in the marketplace.
Werner Oomen, Philips, stated that a significant number of SACDs have their associated stereo mixes generated automatically. Furthermore, he noted that many hand-crafted downmixes may involve dubs to analog tape, such that they are no longer exactly time-aligned with the 5-channel mix.
This may argue for two use cases: Compatible with hand-crafted downmixes. Ultimate compression of 5-channel signal, in which case downmix signal does not have to be evaluated.
Jim Johnston, Microsoft, noted that he endorses off-axis evaluation. He also recommends that material be selected so that it is well-behaved in off-axis listening.
Schuyler Quackenbush, Audio Research Labs, presented
11065 Schuyler Quackenbush
DRAFT Procedures for the Evaluation of Spatial Audio Coding Systems
This draft document will be discussed during the MPEG week.
Audio plenary, joint meeting and task group activities
Review of AHG reportsThere were no requests to review any of the AHG reports.
Received national body comments and liaison mattersThe Audio Chair presented the NB Comments listed in Section .
Audio plenary discussions
Parametric Audio Coding Verification Test Report
Werner Oomen presented
11005 Martin Link
Subjective results formal verification test MPEG4-Ext2. (Parametric)
Martin Link from the IRT has conducted the formal verification test for Amd2 (parametric). FhG provided the AAC coded items. The tests have been performed for mono and stereo at bitrates around 20kbps total, using headphones with 26 subjects. The raw test results were submitted as an input document to the meeting (M11005). From these test results it could be concluded that the acceptance criteria were met for stereo. For mono, there were two items that performed statistically significant worse than AAC on the same bit-rate. It was noted that one of these items was bandlimited. Overall, the parametric coder performance was comparable to AAC when the latter was running at 25% higher bit-rate. Werner Oomen presented
125
11037 Werner Oomen
Complementary information to Formal verification test parametric
Philips brought informal test results (M11037) illustrating the relative performance of parametric at 24kbps stereo compared to AAC at 32kbps stereo. Furthermore, this input showed the capabilities of the parametric stereo tool. For the same bitrate there is only a slight decrease in quality for mono compared to stereo. The audio subgroup agreed to incorporate the information given in M11037 into the final test report (N6675) under the heading “discussion.”
Spatial Audio Evaluation
This was the most important work for the week, and the task group spent considerable time editing the text so that it expressed a consensus view. The result is in N6691, “Workplan for the Evaluation of Spatial Audio Coding.” Responses
Joint Meetings
With Requirements, Systems and MDS on MAF Tue 1100-1130
Review of AHG reportPart 1 will give an overview of the framework of the MPEG Application Format, while subsequent parts will specify the application formats themselves. It is envisioned that the reference code for this specification will be only the “glue” code that is required to integrate the various parts of the MPEG specifications (and there associated reference software). The file format could be MPEG-4 (*.mp4) or MPEG-21 (*.m21) or one file that is both.
On MAF
10961 Wo Chang, Schuyler Quackenbush
MAF Reference Software Workplan Proposal
10962 Wo Chang MAF File Format Proposal
We expect that there will be two MAF-1 implementations in October. A workplan was presented, and it was noted that either Osmo4 or mplayer player could be used as a playback vehicle.Quackenbush reviewed the anticipated DoC for the MAF Music Player CD text, which is summarized here:
MP4 file containing a song MP21 file containing a song MP21 file that is collection of songs (included as actual MP4 files in mdat area) MP21 DiD that declares a playlist Inclusion of binary metadata
Olivier Alvaro suggested that it might be interesting to include explicit presentation information as part of the document. There was some discussion, but the consensus was that it would be appropriate to keep things simple at this stage.
With Requirements on US NB Comment Tue 1130-1200
Jim Johnston, Microsoft, presented
10906 A. G. Tescher for USNB
USNB Contribution: Proposed CfP for Scalable Audio under MPEG 21
The goal of the proposed work item would be to see what performance could be achieved if there was No requirement for low-latency (i.e. the system would not be used for two-way interactive
communication) No requirement for MPEG-backward-compatability.
126
And to see if, given this scenario, there is a compression scheme that could approach the performance of the best speech coders and the best music coders. Because the MPEG week was very busy, a complete discussion of this task was deferred to an AhG 6668, AHG On Exploration of Scalable Audio and Speech Coding. It is envisioned that the evidence that would motivate a new work item would be:
Use case scenarioso one to many in radio broadcast networks
Compression efficiency required for success in the marketplace Compelling functionalities
o bandwidth shedding in the network via simple frame truncation
Yuriy Resnik, Realnetworks, noted that we must define “scalability,” For example, is it “mid-stream” (i.e. in-network) scalability or is it a scalable representation on “disk” by which a server could stream at various rates. Contact Voiceage/Erikson on whether AMR-WB+ can be made available for MPEG use
With Systems on Audio Codec Behavior, Wed 1600-1700
The group reviewed m11080, “Description of Audio Codec Behavior” and made some corrections to the text, which is available as
N6682, “Timestamps and Audio Codec Behavior.” The document concludes that Systems must adjust time stamps in the case that the audio decoder can operate in a regular (higher delay) or “backward compatible” (lower delay) modes.
With Systems on AU ballot comments on MAF, Thu 1230-1400
The group met over lunch and competed the DoC for the Music Player CD text. The following items will be incorporated in the FCD text:
MP4 file containing a song MP21 file containing a song MP21 file that is collection of songs (included as actual MP4 files in mdat area) MP21 DiD that declares a playlist
With Requirements New Profiles and SMR CfP Thu 1400-1430
Kristofer Kjörling presented the proposed HEAAC V2 profile, which was discussed. It is necessary to register statements of support in order to motivate creation of a new profile. Requirements will sponsor a resolution asking for statements of support as contributions to the next MPEG meeting.The Audio subgroup will document the proposal in a new version of N6384, “MPEG-4 profiles under consideration,” which will be an output of this meeting. The Requirements Chair noted that a request for amendment and associated amendment text must be approved at the Wednesday Plenary of the next MPEG meeting in order to progress as quickly as possible.Paulo Nesi presented CfP on SMR, which was approved by Requirements. However, the Requirements Chair requested that the WG11 IPR policy be explained in a short paragraph in the Call and also as an attachment to the Call.
Task Group discussions
HE-AAC
Kristofer Kjörling, Coding Technologies, presented
10842 ITTF via SC 29 Secretariat
Table of Replies on ISO/IEC 15938-3:2002/FDAM 1 [SC 29 N 6063]
10921 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-1:2000/FPDAM 5
11008 Kristofer Kjörling New profile proposal combining HE-AAC and Parametric Stereo
127
The proposed profile was discussed, and the conclusion was to add it to the WG11 document “New Profiles under Consideration.”Andreas Schneider, Coding Technologies, presented
11009Per EkstrandAndreas SchneiderKristofer Kjörling
Proposed additions to Sbr conformance test ing
This was discussed. The Audio Chair noted that it is not possible for Conformance to modify a standard, which this seems to be doing. The consensus was that the Reference Code be modified to teach how to realize the filterbank options and that Conformance be modified as proposed to test the various filterbank realization options.
Layer III
Ralph Sperschneider, FhG, presented
10804 Ralph Sperschneider Study on ISO/IEC 14496-3:2001/FPDAM 3 (MP3onMP4)
10809 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-3/FPDAM 3 [SC 29 N 6047]10922 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-4:200X/FPDAM 2
10788 SC 29 Secretariat Summary of Voting on ISO/IEC TR 13818-5:1997/Amd.1:1999/DCOR 2 [SC 29 N 5998]
The proposed changes, except that the proposed 96 kHz sampling rate, were accepted into the MP3onMP4 FDAM text. This included a mechanism to extend the audioObjectType field.
MPEG-4 Lossless Audio Coding
ALS
The various authors each presented:
11060 Tilman Liebchen
Verification Report on MPEG-4 ALS Core Experiment 5 (Coding of LPC Coefficients)
11112 Yuriy A. Reznik Verification Report on MPEG-4 ALS Core Experiment 4 (Coding of Random Access Frames)
10968 Noboru HaradaYongshan Yu
Proposal of CE for improved floating-point compression in ALS (Audio Lossless Coding)
10969Yutaka KamamotoNoboru Harada
Proposal of CE on Multi channel extension for ALS (Audio Lossless Coding)
SLS
The various authors each presented:
11058
Rongshan YuXiao LinSusanto RahardjaHaibin Huang
Proposed WD3 of ISO/IEC 14496-3:2001/AMD 5, Audio Scalable Lossless Coding (SLS)
11061
Tilman LiebchenYuriy A. Reznik
Proposed Text of ISO/IEC 14496-3:2001/PDAM 4, Audio Lossless Coding (ALS)
11078 Ralf Geiger Proposed WD4 of ISO/IEC 14496-3:2001/AMD 5, Audio Scalable Lossless Coding (SLS)
Oversampled Audio
128
At this meeting the Lossless coding of oversampled audio progressed to FPDAM (N6674). Since there were no ballot comments, there was no DoC. Discussion on ALS and SLS
The task group members did a huge amount of work during the MPEG week to gather information on performance and computational complexity. The results are found in N6676, “Status of Performance and Complexity of MPEG Lossless Audio Coding Architectures.”Compression performance of both systems is very similar, so that the data set does not permit us to resolve any differences between the performances of the two systems. Tillman wishes to reference performance of initial submissions. ALS might address very different markets, e.g. the professional digital audio workstation marketplace, in which processors are floating-point CISC, and the embedded processor market, in which processors are 32-bit integer RISC processors. SLS is envisioned to address the embedded market. It was agreed that the Performance Report will not sum the multiplies and additions into a “Total” column, since some platforms (e.g. RISC) may realize these as separate instructions, while other platforms (e.g. DSP chips) may realize these as a single instruction. In general, the document will refrain from drawing conclusions, but rather just present complexity numbers for various architecture and operating point configurations.Jim Johnston, Microsoft, presented a list of CDs that he felt would be appropriate for expanding the lossless coding data set. His proposal was that:
Everyone purchase CDs and rip them using “eac” (exact audio copy – freeware) and document rip using cksum.
Process using ALS and SLS technology using various parameter settings.
MPEG-7 Audio
Matthias Gruhne, FhG, presented
10806 SC 29 Secretariat
Summary of Voting on ISO/IEC 15938-7/FPDAM 1 [SC 29 N 6046]
10916 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-6:2003/FPDAM 1
11033 Matthias GruhneJan Rohden Proposed Core Experiment on Audio Rhythm Pattern s
The Audio subgroup agreed to accept the proposed core experiment.
MPEG-A
Schuyler Quackenbush, Audio Research Labs, presented
10878 SC 29 Secretariat
Summary of Voting on NP MPEG-A [SC 29 N 6099]
10879 SC 29 Secretariat
Summary of Voting on CD MPEG-A [SC 29 N 6101]
11006 Adam Lindsay ID3v2 Tags in M PEG-A Most of the discussion of this topic occurred in the joint meeting with Systems (see Section ).
MPEG-4 Audio
The various authors of each contribution presented:
10841 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-3:2001/FDAM 2 [SC 29 N 6062]
11018 Eunmi OhMiyoung Kim Proposed changes in MPEG-4 BSAC multi-channel audio coding
129
11026JungHoe KimSangWook KimEunmi Oh
Comments on MPEG-4 BSAC Conformance
11029Juergen SchmidtKlaus Eilts-Grimm
Simple Integration Reference Software for MPEG-4 AudioBIFS, version 3
11035 Werner OomenHeiko Purnhagen Proposed corrigenda to AMD2, (parametric)
11071 Ralph Sperschneider
Problem with buffer fullness derivation in the case of number_of_raw_data_blocks_in_frame>0 and protection_absent=0
11072 Ralph Sperschneider Status on MPEG-4 Audio Conformance
11073 Ralph Sperschneider Proposed ISO/IEC 14496-3:2004 (Audio 3rd Edition)
Due to the very full Audio schedule, there was not sufficient time to discuss and decide on the proposals made in m11018 or m11029.
Spatial Audio Coding
On Tuesday afternoon the task group listened to proponent submissions in the Microsoft 5.1 channel listening room.On Wednesday afternoon the task group selected test material for use in evaluating the Spatial Audio Coding Call for Proposals. The test items will be:Number
Name Category Remarks
1 pops music (back: direct)2 chostakovitch music (back: direct)3 poulenc music (back: direct)4 jackson1 music (back: ambience)5 rock concert music (back: ambience)6 indie2 movie sound7 Stomp movie sound LFE
available8 ARL applause pathological & ambience9 BBC applause pathological & ambience10 glock pathological & ambience11 fountain music pathological & ambience
Symbolic Music Representation
The SMR Call for Proposals document and the Draft Evaluation document both had extensive editing by the task group Tuesday and Wednesday in the MPEG week. This resulted in significantly better text in the CfP and a much clearer articulation of the evaluation process. The Draft Evaluation document will be included in the CfP public package.
Meeting deliverables
Press statementThe Audio part of the press statement was prepared, but there was not sufficient time for it to be reviewed.
Dispositions of CommentsAll DoC were prepared and reviewed.
130
Responses to Liaison and NB commentsThere were no liaison responses. The response to the NB were prepared and approved.
Recommendations for final plenaryThe Audio recommendations were presented and approved.
Establishment of Ad-hoc GroupsThe following ad-hoc groups were established by the Audio subgroup:
No. Title Mtg6664 AHG on Audio Standards Maintenance No6696 AHG on MPEG-7 Audio No6665 AHG on Spatial Audio Coding Yes6666 AHG on MPEG-4 Lossless Audio Coding Yes6667 AHG on Symbolic Music Representation Yes6668 AHG On Exploration of Scalable Audio and Speech Coding Yes
Approval of output documentsAll output documents, shown in Annex D, were presented in Audio plenary and were approved.
Future activities
Schedule of future meetingsAd Hoc group meetings are indicated in Section . Unless otherwise indicated, Ad Hoc group meetings will be held at the location of the next MPEG meeting on the weekend preceding that meeting.
Agenda for next meetingThe agenda for the next MPEG meeting is shown in Annex E
All other businessThere was none.
Closing of the meeting The 69th Audio Subgroup meeting was adjourned Friday at 14:00.
131
Annex A ParticipantsFirst Name Last Name Country AffiliationSchuyler Quackenbush USA ARLKristofer Kjörling S Coding TechnologiesHeiko Purnhagen S Coding TechnologiesBernhard Feiten DE Deutsche TelekomIngo Wolf DE Deutsche TelekomKhosrow Lashkari USA DoCoMo USA Labs Matt Fellers USA DolbyMark Vinton USA DolbyGiorgio Zoia CH EPFLJeongil Seo KR ETRIBernhard Grill DE FhG IISJürgen Herre DE FhG IISRalph Sperschneider DE FhG IISRalf Geiger DE FhG IIS AEMTMatthias Gruhne DE FhG IIS AEMTCotarmanac’h Alexandre FR France Telecom R&DSusanto Rahardja SG I2RLin Xiao SG I2RRongshan Yu SG I2RJames Johnston USA MicrosoftMauri Väänänen FIN Nokia Res. CenterToshiyuki Nomura JP NECTakehiro Moriya JP NTTYutaka Kamamoto JP NTT/The Univ. of TokyoSua Hong Neo SG PanasonicWerner Oomen NL PhilipsYuriy Reznik USA RealNetworksSang-Wook Kim KR SamsungEunmi Oh KR SamsungBoehm Johannes CE ThomsonTilman Liebchen DE TU BerlinDai Yang USA Vidiator TechnologyDai YANG USA Vidiator Technology
(US) Inc
Annex B Audio Contributions and Schedule
Time Agenda Item MPEG-2/4/7
SMR
Number Title Source
Sunday0900-1800 AHG on Symbolic Music
Representation
11083 Michael Good Response to Draft Call for Proposals N6457 X
11002 James Ingram Comments on Symbolic Music Representation requirements
X
11021
Paolo NesiPierfrancesco BelliniJerome BarthelemyJames IngramNeil McKenzie
Examples of matching SMR aspects and available technologies
X
11019
Paolo NesiGiorgio ZoiaPierfrancesco BelliniJerome BarthelemyJames IngramDavid Crombie
Draft Evaluation Criteria for Assessing SMR Proposals
X
11025
Paolo NesiGiorgio ZoiaJames IngramPiefrancesco Bellini
Study on Draft CfP on Symbolic Music Representation
X
1000-1200 AHG on Lossless Coding
11079 Ralf GeigerJuergen Herre
On the Performance of MPEG-4 SLS RM4
X
11059 Rongshan YuCrosscheck on FhG’s Proposed Core Experiment for MPEG-4 Audio Scalable to Lossless (SLS) Coding
X
11062Rongshan YuSusanto RahardjaXiao LinHaibin Huang
Reduce Complexity for MPEG-4 Audio Scalable Lossless (SLS) Coding
X
11063 Tilman Liebchen Proposed Core Experiment on Higher Predictor Orders in MPEG-4 ALS
X
11114 Yuriy A. Reznik Proposed CE on Additional Enhancements for Lo ssless Audio Coding
X
1300-1700 AHG on Spatial Audio Coding
11001 Heiko PurnhagenWerner Oomen
CT/Philips contribution to CfP on spatial audio coding
X
11015Naoya TanakaKok-Seng ChongKazuhiro Iida
Technical Description and Performance Test Results of Panasonic Spatial Audio Coding
X
11075Juergen HerreChristof FallerC. SpengerJ. HilpertK. Linzmeier
Fraunhofer/Agere Submission to Spatial Audio CfP
X
133
Time Agenda Item MPEG-2/4/7
SMR
Number Title Source
11090Matt FellersMark VintonMark DavisGrant Davidson
Dolby Laboratories Submission to CfP on MPEG-4 Spatial Audio Coding
X
11076 Juergen Herre Evaluation of Spatial Audio Coding Schemes
X
11065 Schuyler Quackenbush
DRAFT Procedures for the Evaluation of Spatial Audio Coding Systems
X
Monday0900-1330 MPEG Plenary1330-1430 Lunch1430-1800 Audio Plenary
Opening of the meetingAudio Chair
Administrative mattersApproval of agenda XApproval of 68th MPEG meeting report
X
Communications from the Chair- Review of Sun Chairs meeting
X
Allocation of contributions to agenda and schedule
X
Joint meetings XReview of AhG reports
X
10767 S. Quackenbush AHG on Spatial Audio Coding X
10768 Tilman Liebchen AHG on MPEG-4 Lossless Audio Coding
X
10769 Paolo NesiGiorgio Zoia
AHG on Symbolic Music Representatio n X
Task groups and mandatesNational body comments X
10906 A. G. Tescher for USNB
USNB Contribution: Proposed CfP for Scalable Audio under MPEG 21
X
10991 LEE SgNB Comment on the Lossless Audio Coding Work
X
11102 FNB FNB Position Paper on MPEG applications, context and objective s
X
1400-1600Plenary discussionsSGNB comment XFNB comment XUSNB comment X
1600-1630 MPEG-4 Issues
11005 Martin Link Subjective results formal verification test MPEG4-Ext2. (Parametric)
X
11037 Werner Oomen Complementary information to Formal verification test parametric
X
1700-1800 Spatial CfP Evaluation
1800- HOD Meeting
Tuesday0900 Audio Plenary Audio Chair
134
Time Agenda Item MPEG-2/4/7
SMR
Number Title SourceOutline plan for the day
0800-1230 Symbolic Music Representation
0900-1130 MPEG-4
10841 ITTF via SC 29 Secretariat
Table of Replies on ISO/IEC 14496-3:2001/FDAM 2 [SC 29 N 6062]
X
11018 Eunmi OhMiyoung Kim
Proposed changes in MPEG-4 BSAC multi-channel audio coding
X
11026JungHoe KimSangWook KimEunmi Oh
Comments on MPEG-4 BSAC Conformance
X
11029 Juergen SchmidtKlaus Eilts-Grimm
Simple Integration Reference Software for MPEG-4 AudioBIFS, version 3
11035 Werner OomenHeiko Purnhagen
Proposed corrigenda to AMD2, (parametric)
X
11071 Ralph Sperschneider
Problem with buffer fullness derivation in the case of number_of_raw_data_blocks_in_frame>0 and protection_absent=0
X
11072 Ralph Sperschneider Status on MPEG-4 Audio Conformance X
11073 Ralph Sperschneider Proposed ISO/IEC 14496-3:2004 (Audio 3rd Edition)
X
1100-1130 Joint with Sys, MDS, Req Multimedia Application Format Req
10961 Wo Chang, Schuyler Quackenbush MAF Reference Software Workplan Proposal X
10962 Wo Chang MAF File Format Proposal X
1130-1200 Joint with Req US NB Comment Audio
10906 A. G. Tescher for USNB
USNB Contribution: Proposed CfP for Scalable Audio under MPEG 21
X
1300-1700 Spatial Coding listening session Microsoft listening room
1200-1300 Lunch
1300-1500 Lossless Coding
11060 Tilman LiebchenVerification Report on MPEG-4 ALS Core Experiment 5 (Coding of LPC Coefficients)
X
11112 Yuriy A. ReznikVerification Report on MPEG-4 ALS Core Experiment 4 (Coding of Random Access Frames)
X
10968 Noboru HaradaYongshan Yu
Proposal of CE for improved floating-point compression in ALS (Audio Lossless Coding)
X
10969 Yutaka KamamotoNoboru Harada
Proposal of CE on Multi channel extension for ALS (Audio Lossless Coding)
X
11058Rongshan YuXiao LinSusanto RahardjaHaibin Huang
Proposed WD3 of ISO/IEC 14496-3:2001/AMD 5, Audio Scalable Lossless Coding (SLS)
X
135
Time Agenda Item MPEG-2/4/7
SMR
Number Title Source
11061 Tilman LiebchenYuriy A. Reznik
Proposed Text of ISO/IEC 14496-3:2001/PDAM 4, Audio Lossless Coding (ALS)
X
11078 Ralf GeigerProposed WD4 of ISO/IEC 14496-3:2001/AMD 5, Audio Scalable Lossless Coding (SLS)
X
1830-1900 Audio PlenaryStatus for Chairs Meeting
1800-1900 Liaison Meeting1900- Chairs Meeting
Wednesday0900-1100 MPEG Plenary1100-1130 Audio Plenary Audio Chair
Report on Chairs meeting and outline of plan for the day
1130-1300 Layer III
10804 Ralph Sperschneider Study on ISO/IEC 14496-3:2001/FPDAM 3 (MP3onMP4)
X
10809 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-3/FPDAM 3 [SC 29 N 6047]
X
10922 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-4:200X/FPDAM 2
X
MPEG-2 AAC
10788 SC 29 SecretariatSummary of Voting on ISO/IEC TR 13818-5:1997/Amd.1:1999/DCOR 2 [SC 29 N 5998]
X
1300-1700 Spatial Coding listening session Microsoft listening room
1300-1400 Lunch
1400-1500 HE-AAC
10842 ITTF via SC 29 Secretariat
Table of Replies on ISO/IEC 15938-3:2002/FDAM 1 [SC 29 N 6063]
X
10921 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-1:2000/FPDAM 5
X
11008 Kristofer Kjörling New profile proposal combining HE-AAC and Parametric Stereo
X
11009Per EkstrandAndreas SchneiderKristofer Kjörling
Proposed additions to Sbr conformance test ing
X
1500-1600 MPEG-7
10806 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-7/FPDAM 1 [SC 29 N 6046]
X
10916 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-6:2003/FPDAM 1
X
11033 Matthias GruhneJan Rohden
Proposed Core Experiment on Audio Rhythm Pattern s
X
1600-1700 MPEG-A
136
Time Agenda Item MPEG-2/4/7
SMR
Number Title Source
10878 SC 29 Secretariat Summary of Voting on NP MPEG-A [SC 29 N 6099]
X
10879 SC 29 Secretariat Summary of Voting on CD MPEG-A [SC 29 N 6101]
X
11006 Adam Lindsay ID3v2 Tags in M PEG-A X
1600-1700 Joint with Systems Audio
11080 S. QuackenbushH. Purnhagen Description of Aud io Codec Behavior
X
1800-2200 Social
Thursday
1230-1400 Joint with Systems
10944 AUNB AUNB Comments on MPEG-A CD
1300-1400 Lunch
1400-1430 Joint with Req At Requirements (Lassen)Proposed new profilesSMR
1830-1900 Audio Plenary Audio ChairReview list of deliverablesReview list of AHGsStatus for Chairs Meeting
1900- Chairs Meeting 0938
Friday
0900-1300 Audio PlenaryReport on Chairs meeting and outline of plan for the day Audio Chair
Discussion of unallocated contributionsMeeting deliverables
Press statementDispositions of commentsResponses to NB commentsLiaison statementsRecommendations for final plenaryEstablishment of new Ad-hoc groupsApproval of output documents
Future activitiesAgenda for next meeting
A.O.B.Closing of the Audio meeting
1300-1400 Lunch
1400- MPEG Plenary
137
138
Annex C Task Groups1. HE-AAC
Chair: Heiko Purnhagen13818-1:2000/AMD 5:200x FDAM14496-5:XXX/AMD 6 FDAMMandates:1.1. Review contributions1.2. Produce final text of 13818-1:2000/FDAM 5:2004 “New audio profile and level
signaling”1.3. Insure that HE-AAC code is available as part of 14496-5:XXX/AMD 6 “Advanced Video
Coding and HE-AAC Audio reference software”
2. Layer IIIChair: R. Sperschneider13818-4:200X/AMD 2:2000x FDAM14496-3:2001/AMD 3 FDAMMandates:2.1. Produce DoC on 13818-4:200X/ FPDAM 2:200x “Audio Conformance Extensions”2.2. Produce text of 13818-4:200X/ FDAM 2:200x “Audio Conformance Extensions”2.3. Produce final text of Draft 11172-3:xxxx/ FDAM 3 “MPEG-1 Access Units”2.4. Produce “Study on MPEG-1 LIII new sampling rates”
3. Lossless CodingChair: S. Quackenbush14496-3:2001/AMD 4 TBD14496-3:2001/AMD 5 TBDMandates:3.1. Review contributions3.2. Compile latest performance results3.3. Discuss next steps for work
4. MPEG-7Chair: Matthias Gruhne15938-6:200X/AMD 1 FDAM15938-7:200X/AMD 1 FDAMMandates:4.1. Review contributions4.2. Insure that reference software and conformance descriptions are available4.3. Produce final text of 15938-7:200X/ FDAM 1 “Audio conformance extensions”
5. MPEG-AChair: S. Quackenbush24736 FCDMandates:5.1. Review contributions5.2. Move to part 2 (part 1 is “Introduction”)5.3. Prepare DoC on 24736:200X CD, “Player Application Format”5.4. Prepare text of 24736:200X FCD, “Player Application Format”
6. MPEG-4 Audio Issues
139
Chair: S. QuackenbushMandates:6.1. Review contributions6.2. Produce “Formal Verification Report on MPEG-4 Parametric Audio Coding”6.3. Discuss MPEG-4 Audio conformance issues and revise status as necessary6.4. Discuss and possibly revise “Timestamps and Audio Codec Behavior”6.5. Discuss Proposed ISO/IEC 14496-3:2004 (Audio 3rd Edition)6.6. Discuss FNB comment on Audio overview
7. Spatial Audio CodingChair: S. QuackenbushMandates:7.1. Review submissions to the CfP7.2. Select Evaluation Test Material7.3. Produce “Workplan for the Evaluation of Spatial Audio Coding Systems”
8. Symbolic Music RepresentationChair: P. NesiMandates:8.1. Review contributions8.2. Produce “DRAFT Procedures for the Evaluation of Symbolic Music Representation”8.3. Produce “Call for Proposals for Symbolic Music Representation”
9. Scalable Audio CodingChair: J. JohnstonMandates:9.1. Review and respond to USNB comment9.2. Draft workplan for exploration
Standards under Development:Name Description Progress to13818-1:2000/AMD 5:200x New audio profile and level signaling and changes to audio type FDAM13818-4:200X/AMD 2:2000x Audio Conformance Extensions (new bitstreams for Audio LIII) FDAM14496-3:2001/AMD 3 MPEG-1 Access Units and New sampling rates FDAM14496-3:2001/AMD 4 ASL CD14496-3:2001/AMD 5 SLS CD14496-5:XXX/AMD 6 Advanced Video Coding and HE-AAC Audio reference software FDAM15938-6:200X/AMD 1 Audio software extensions FDAM15938-7:200X/AMD 1 Audio conformance extensions FDAM24736-1:200X MPEG-A: Music Player Application Format CD
Note: FDAM is final document (no more comments!)
140
Annex D Output DocumentsMPEG-2
No. Title TBP Available
13818-7 MPEG-2 AAC
6669 Text of 13818-7:2004/DCOR 1 “AAC ADTS buffer fullness correction”
23/7/04
MPEG-4
No. Title TBP Available
14496-3 MPEG-4 Audio6670 DoC on 14496-3:2001/FPDAM 3, MPEG-1/2 Audio in MPEG-4 23/7/046671 Text of 14496-3:2001/FDAM 3, MPEG-1/2 Audio in MPEG-4 23/9/046672 Text of 14496-3:2001/PDAM 4, Audio Lossless Coding (ALS) 30/8/046673 Text of 14496-3:2001/PDAM 5, Scalable Lossless Coding (SLS) 30/8/04
6674 Text of 14496-3:2001/FPDAM 6, Lossless coding of 1-bit oversampled signals
6/8/04
6675 Formal Verification Report on MPEG-4 Parametric Audio Coding 23/7/04
6676 Status of Performance and Complexity of MPEG Lossless Audio Coding Architectures
23/7/04
6677 Proposed 3rd Edition of 14496-3 23/9/046678 Study on High-Sampling Rate for MPEG-1/2 Layer III 23/9/046679 Proposed Enhancements to MPEG-4 BSAC multi-channel 23/7/04 6680 Workplan for Audio Lossless Coding (ALS) 23/7/04 6681 Workplan for Scalable Lossless Coding (SLS) 23/7/04 6682 Timestamps and Audio Codec Behavior 23/9/04
No. Title TBP Available
14496-4 MPEG-4 Conformance6683 Status of MPEG-4 Audio Conformance 23/7/046684 Proposed New Audio Conformance Bitstreams for BSAC 23/7/04
MPEG-7
No. Title TBP Available
15938-4 MPEG-7 Audio6685 Workplan for Audio Rhythmic Pattern 23/7/04
MPEG Application Formats
No. Title TBP Available
23001-1 Application Formats: Introduction
141
6686 Introduction to MPEG Application Formats 23/7/04
No. Title TBP Available
23001-2 Application Formats: Music Player6687 DoC on 23001-1:200X CD, “Player Application Format” 23/7/046688 Text of 23001-1:200X FCD, “Player Application Format” Yes 23/9/04xxxx Request for Subdivision of ISO/IEC 23000-1 23/7/04
Explorations and support
No. Title TBP Available
Music notation6689 Call for Proposals for Symbolic Music Representation Yes 23/7/046690 DRAFT SMR Evaluation Procedure Yes 23/7/04
No. Title TBP Available
Spatial audio coding6691 Workplan for the Evaluation of Spatial Audio Coding Responses 6/8/04
142
Annex E Agenda for the 70th MPEG Audio MeetingAgenda Item1. Opening of the meeting2. Administrative matters
2.1. Approval of agenda2.2. Approval of 69th meeting report2.3. Communications from the Chair2.4. Allocation of contributions2.5. Joint meetings2.6. Review of AhG reports2.7. Review of task groups and mandates2.8. Received national body comments and liaison matters2.9. Plenary issues
3. Task group activities3.1. MPEG Maintenance3.2. MPEG-4 Lossless Coding3.3. MPEG-7 Audio3.4. MPEG-Music Player Application Format3.5. Spatial Audio Coding3.6. Music Notation
4. Discussion of unallocated contributions5. Meeting deliverables
5.1. Press statement5.2. Dispositions of comments5.3. Responses to NB comments5.4. Responses to Liaison statements5.5. Recommendations for final plenary5.6. Establishment of new Ad-hoc groups5.7. Approval of output documents
6. Future activities6.1. Agenda for next meeting
7. A.O.B.8. Closing of the meeting
143
Annex 10Report of SNHC meeting
Source: Mikaël Bourges-Sévenier (Mindego Inc.)
Opening of the Meeting
Approval of the agenda
Goals for the weekThe goals of this week are:
Finalize ISO/IEC 14496-5/FDAM7 AFX reference software Issue ISO/IEC 14496-16/PDAM1 with new tools available in reference software Start ISO/IEC 14496-21 WD 1.0 Update ISO/IEC 14496-11/FPDAM4 with XMT-A reorganized and augmented with all
AFX encoding tools represented in XML.
144
ScheduleMonday Tuesday Wednesday Thursday Friday
:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30
14
15
08
09
10
11
20
21
22
Time
16
17
18
19
12
13
Lunch break
MPEG Plenary
Lunch break Lunch break Lunch break Lunch break
MPEG Plenary
MPEG Plenary
Roll call, agendaFAQ, web site, ref sw, conf.
Graphics Arch.3DAV
10965 - 3DMC
10937 - urban rep
10994 - CE shadow11031 - CE multitex11038 - point
11066 - morphing appearances
Review of XMTReview of WDReview PDAM: ref. soft., AMD1
Document reviewPresentation reviewDocument number attribution… last items...
Social event
Liaison
Chairs Chairs
Liaison
Solids (2 contribs)XMT (6 contribs)
11109 + 10881
10898 - PointTexture
AFX document updatesGraphics APIArchitecture
Graphics APIArchitecture11022 - SMR
LaSeR overview(in SNHC)
Graphics APIMPEG-J extensions
XMT for AFXMPEG-J extensions
Graphics API
145
Allocation of joint meetingsSub-Groups Monday Tuesday Wednesday Thursday Friday
Systems 17:00-18:00XMT, MPEG-J
16:00-17:00LaSeR
RequirementsMPEG-7
VideoVideo/3DAV
MDS
Rooms allocationSNHC Rainier 1, Break-out (Graphics): Rainier 2Systems Hood 1Requirements LassenChairs/HoD/LiaisonsLassen
Allocation of contributions
N° Title Schedule ActivityD1 Monday D1
MPEG Plenary D1 09h00-14h00 MPEG Gen.
Report of AhG on MPEG-J extensions Mikaël Bourges-Sévenier
SNHC D1 15h00-16h00 SNHC Gen.
Agenda, FAQ, Web site Mikaël 15:00AFX Reference software, integration issues Patrick 15:30SNHC D1 16h00-19h00 AFX
10936 Simplification of AFX/SolidRep node Alain MignotPierre Garneau
16:00
11134 Solid implementation into IM1 Jeremie FarretOlivier Bellis
146
N° Title Schedule Activity10880 Update of XMT-A for AFX Gyeong Ja Jang
James D. K. Kim17:00
10882 Updates on the reference software of AFX Encoder
Gyeong Ja JangJames D. K. Kim
10899 Update on XMT-A specification for encoding parameter of PointTexture Compression
Gyeong Ja JangShinjun LeeJames D.K. KimMahnjin Han
11046 Proposal for the XMT-A specifications for MeshGrid
Alexandru SalomieAdrian MunteanuRudi DeklerckPeter Schelkens
11068 Textual BBA Marius PredaFrancoise Preteux
SNHC D1 16h00-19h00 Graphics
11003 Comments on MPEG-4 part 21 MPEG-J extension for rendering
Itaru KanekoMark Callow
16:00
11111 Considerations for MPEG-J extensions for rendering
Mikael Bourges-SevenierVishy Swaminathan
D2 Tuesday D2SNHC D2 9:00 – 13:00 AFX
10965 On the status of 3D Mesh Compression in MPEG-4 Euee S. Jang, Ja Kim 9:00
10937 Proposal for multi-resolution urban representation
Patrick GioiaJérôme Royan
10:00
10994 CE - Shadow: Preliminary Results on Reference Software Implementation Helge Drumm 11:00
11031View-Dependent Multi-Texturing for MPEG-4 AFX, Syntax and semantics specification update
Karsten MüllerAljoscha Smolic
12:00
147
N° Title Schedule Activity
11038Results on Reference Software Implementation on Point based Rendering for MPEG-4 AFX
Stephan WürmlinChristopher LeeMatthias ZwickerMichael WaschbüschMarkus GrossHanspeter Pfister
12:30
SNHC D2 14:00 – 17:00 AFX
11066 Morphing AppearancesMarius PredaFrançoise PreteuxOlivier Marre
14:00
11022 Graphic functionality in MPEG-4 and Symbolic Music Representation
Giorgio ZoiaPierfrancesco BelliniJerome BarthelemyPaolo Nesi
15:00
10898 Addition to PointTexture Compression for future extensions Mahnjin Han 16:00
Systems D2 17:00 – 18:00 Graphics
11109 XMT and MPEG-J updates Mikaël Bourges-Sévenier
10881 KNB on XMT and MPEG-J updates Mahnjin Han
D3 Wednesday D3MPEG Plenary D3 09h00-11h00 MPEG Gen.SNHC D3 11h00-16h00 GraphicsPart 21 architecture discussionsSNHC D3 16h00-17h00 General
LaSeR overview Olivier AvaroJean-Claude Dufourd
16:00
D4 Thursday D4SNHC D4 9h00-13h00 AFX
148
N° Title Schedule ActivityPart 21 architecture discussionsSNHC D4 14h00-18h00 AFXAFX document review 14:00Part 21 architecture 15:00
D5 Friday D5SNHC D5 9h00-11h00 SNHC Gen.
Document number attribution 9:00
MPEG Plenary D5 14h00-22h00 MPEG Gen.
149
General issues
Web siteThe SNHC Web site is http://www.sait.samsung.co.kr/snhc/
AFX Reference softwareThe AFX Reference Software has been transferred to NIST and is available via CVS at
1. Register your login/password at http://mpeg.nist.gov/reg/login_new.php2. :pserver:<your login>@mpeg.nist.gov:/big/mpegcvs3. <your password>4. Checkout "MPEG-4/Systems2/IM1" module (case sensitive).
The AFX-related code is in OpenGL/AFX and conformance samples are in Tests/AFX.
AFX encoder and other toolsWe create MPEG-4/SNHC/AFX_Encoders repository in CVS server.Add an informative note in AFX/AMD1 Reference software document about this tool.
New tools added since March:DIBR v2 (splats), morphing, point-texture compression, multitexturing, Solids
Miscellaneous The MPEG node templates used to be maintained by MPEG-4 Systems editors. It has been
decided to upload them into CVS repository. Mikaël Bourges-Sévenier will upload into CVS the executables of his programs to generate
node coding tables and XMT-A Schema (BIFS part). XMT-A Schema organized in 4 parts will be uploaded into CVS.
Standards from SNHCIn red, status reached at this meeting. In yellow, status reached at next meeting. Projects that reached International Standard status have been removed.
Std
Pt Edit.
Project
Description CfP WD CDPDAMDCOR
FCDFPDA
M
FDISFDAMCOR
4 5 2003 Amd.7 AFX Reference SW 02/10
02/12 03/12 04/07
4 11 2003 Amd.4 XMT and MPEG-J extensions
03/12 04/07 05/01
4 16 2004 Cor.1 AFX Corrigendum 04/03
04/07 05/01
4 16 2004 Amd.1 AFX extension 03/07
04/07 05/01 05/07
4 21 2005 MPEG-J extensions for rendering
03/12
04/07
04/10 05/01 05/07
150
AFX activities
Specifications updatesThe list of modifications for existing specifications handled by SNHC is as follows.
Part 5/AMD7Solid Modeling framework has been added.
Part 11/AMD4Monolithic XMT-A schema reorganized in a modular manner.All nodes from MPEG-4 Part 11 and Part 16 have been added, up to Part 11 AMD6 and Part 16/AMD1.AFX node specific encoding hints and parameters added.
Part 16/COR1Light-field mapping and Particle systems have been removed.
Part 16/AMD1Finalized: Multitexturing framework, Point-based representation, Morphing
Part 21/WD 1.0Just started: uses JSR-184 and JSR-239. MPEG-J is augmented to support these APIs and interface with MPEG-4 Systems terminal.
Conformance and reference software
M: 10936 Simplification of AFX/SolidRep node Alain Mignot, Pierre GarneauProposal: - Reduce the complexity of using the SolidRep by adding support of solid operations directly at the scene graph node level; thus no need of using the script node.- keep only the logic operators (3) from the 45 operators currently standardized.- a new node proposed: SolidRepV2 which contains the solidOp field indicating the operation attached to the node.
Resolution: Create a CE on differences between script with SolidRepV1 and SolidRepV2 with the following goals: - What is the extra cost for using script node for solid?- What are the limitations when not using the script but having the SolidRepV2?
Jeremie (SGDL) and Alain (SolidSpace) participate to the CE and edit the CE description.
M11134: Solid implementation into IM1, Jeremie Farret, Olivier Bellis- renew involvement of SGDL in MPEG-4 normalization- implementation of Solid representation in AFX reference software- full support for script node (new java script library is available)
Resolution: validate the implementation and check that all the conformance bitstreams for all the AFX tools are working (action done on Thursday morning in the SNHC plenary)
Naming problem: change symbols for operators in strings; advantages: light update of the java script parser, solve ambiguities methods.
151
Resolution: update the DCOR with the operators names for the sake of the non-ambiguities.
M10880: Update of XMT-A for AFX, Gyeong Ja Jang, James KimProposal:
- add DIBR encoding hints in bitwrapper;- add DIBRDecoderInfo in AFXConfigType- change the place of the AFXConfigType; put it in the object descriptor part
Resolution:All the proposed modifications are accepted.
M10882: Updates on the reference software of AFX Encoder, Gyeong Ja Jang, James KimProposal:- add support for multiple BitWrapper parser- add support for octreeImage encoding
Resolution:Upload the software in the CVS as part of MPEG-4 reference software. Add the description of the tool and hints to be used and updated.
M10899: Updates on XMT-A specification for encoding parameter of PointTexture Compression, Gyeong Ja Jang, Shinjun Lee, James Kim, Mahnjin HanProposal:Add the element PointTextureEncodingParameter and the associated attribute in the BitWrapper encoding parameters section.
Resolution:Accepted
M10899: Proposal for the XMT-A specifications for MeshGrid, Alexandru Salomie, Adrian Munteanu, Rudi Deklerck, Peter SchelkensProposal:- Add the MeshGridEncodingParameters element in the BitWrapper encoding parameters section.- Add the MeshGridDecodingSpecificIndo element in the AFX decoder specific section.
Resolution:Accepted
M10899: Textual BBA, Marius Preda, Francoise PreteuxProposal:- Add the description of the BBA related elements in the XMT-A, including textual animation parameters and encoding parameters
Resolution:- Accepted
- Check the schema with Intellij
152
M10965 – On the status of 3DMC in MPEG-43DMC provides 30-40 times compression of IndexedFaceSet node. The major supporters were IBM and Samsung. 3DMC reached IS status since 2001 but no commercial application exists so far. IBM and Samsung said informally that they have no immediate plan to deploy this technology.
Technical issuesCoverage of 3D models3DMC cannot support non-manifolds or non-orientable meshes without breaking the model into multiple components.
Lossless/near lossless compressionHigh quality compression of 3D models for archiving and distribution is in high demands but this may not have been well understood in the original design of 3DMC.
Lossless feature is available in AFX VM but promotion unclear.
Vertex order changeFor non-rigid deformations of models, vertex order must be preserved. 3DMC does change vertex order.
Possible solutions1. 3DMC encoder could output the changed vertex order information so the compression of
interpolator etc. so 3DMC encoder would drive the encoding of the entire scene (BIFS, Scripts, MPEG-J)
2. Transmit the changed order of vertex. This is n log n information, so an overhead increase3. Use 3DMC only for rigid-body animation. Then vertex order doesn’t matter4. Redesign 3DMC
ResolutionGather industry interest before starting a new 3DMC. Contributions would be expected in further meetings.
M10937 – Proposal for multi-resolution urban representationWe need progressive transmission and adaptive rendering during navigation.
For such adaptation, the scene is really a polygon soup of building blocks that are refined at interactive frame rate.
With such contents, it is easy to navigate inside a city but much harder to have fly over views because in a city many occlusions enables less polygons to be sent to the card while on fly over, there are no such occlusions.
The scene is represented as a hierarchical representation of building blocks (i.e. real buildings). The leaves (buildings) are rendered. The refinement applies at the footprint of the buildings, which are contours represented as line segments (hence only position is needed). Messages are sent to the server to refine these contours during navigation. To represent the building, extra information such as height, textures are sent. As navigation progresses the root contours are split into multiple contours.
153
The proposal doesn’t expose geometry information that could be helpful to combine with other 3D models.
ResolutionStart a CE on this representation to understand how such contours could be used in a BIFS scene
M10994 – CE - Shadow: Preliminary Results on Reference Software Implementation, Helge DrummReport: - The work on implementation in the AFX reference software is not completed;- Implementation in Iavas MPEG-4 player (in Java)- Add in the AFX reference software some light related issues which were missing in the implementation;Proposal: Simplify the node interface in order to simplify the implementation.
Resolution:Keep the CE open with the following goal:- indicate which functionalities are not supported anymore by the simplified node;- what is the cost of keeping the initial node? Only an implementation issue or some theoretical aspects are also involved.
M11031 – View-Dependent Multi-Texturing for MPEG-4 AFX, Syntax and semantics specification update, Karsten Müller, Aljoscha SmolicProposal:
Update the Multitexturing node: Change the “weight” field with the “cameraVector”. Advantages: not need of using the script node but multitexturing directly implemented by the player.
Resolution: Adopt the new node as part of the CD of AFX Amd1.
M11038 – Results on Reference Software Implementation on Point based Rendering for MPEG-4 AFX, Stephan Würmlin, Christopher Lee, Matthias Zwicker, Michael Waschbüsch, Markus Gross, Hanspeter PfisterProposal:Implementation of the DIBRV2 nodes in the reference software
Resolution:Validate the implementation, DIBRv2 nodes go in CD of AFX Amd1
M11038 – Addition to PointTexture Compression for future extensions, Mahnjin HanProposal: add a flag isExtension in order to support future compression scheme.
Resolution:Accepted
M11066 – Morphing Appearances, Marius Preda, Françoise Preteux, Olivier MarreProposal:- Update the MorphShape node for supporting morphing for the appearance field by changing the type of the targetShapes from the MFGeometryNode into MFShapeNode
154
- Implemntation of the new node in the reference software
Resolution:- validate the implementation, MorphShape node go in the CD of AFX Amd1.
MPEG-4 Part 21
M11003 – Comments on MPEG-4 Part 21HI Corp. strongly supports standardization of MPEG-4 Part 21 or Graphics API.M3G has been found as the best starting point for Graphics API during 68 th meeting and the AhG meeting in Tokyo in May.MPEG-4 Part 21 should not be too attached to one specification. HI has about 30M devices and their experience is that each operator has strong control of the specification and they often prefer the latest version of the API. So every year a new version provides new features. Therefore, locking into one API is not a good idea.
HI Corp. proposed a simpler version of APIs that is not M3G but already publicly royalty-free available.
Conformance and reference softwareHI can provide a binary version of their optimized renderer.
Non-synthetic 3D renderingIn 3DAV, capture of 3D information from images is being worked on. In many apps, mixing synthetic and non-synthetic objects is useful and therefore the APIs should be unified.Fog and depth effects are needed, environment mapping
ProposalHI suggests looking at old version of the API, which still has many apps being developed. The new version of the API is M3G.Mobile manufacturers have embraced M3G, which is now available on phones shipping this summer. DiscussionM3G is the right starting point for this activity but M3G being controlled by its own standard body is an issue. MPEG/SNHC should establish liaison with M3G. However, M3G (JSR-184) is finished and hence the group is closed, so no liaison or working relationship is possible.
Many participants expressed concerned about M3G future because of Nokia’s licensing. Likewise, it is unclear if M3G will be updated in a near future even with basic features present in OpenGL ES but apparently forgotten in M3G. Informal conversion with JSR-184 Chairman seems to indicate extensions will happen but probably not this year.
In conclusion of this proposal, an M3G like graphics API is needed but not necessarily M3G itself alone. Commonality of various APIs in the market must be studied.
M11111 – Considerations for MPEG-4 Part 21This contribution details missing features in M3G and possible solutions. It also raises some issues related to the integration of MPEG-4 systems with M3G.
155
The proposal simply intends to start the discussion on these issues.
3DAV needsVideoTiming + synchronizationMulti-texturingPoint rendering
M11022 – Symbolic Music Representation (SMR)Needs to represent music notation:
Lines, path, curves Color support Text support Selection of notes or groups of notes according to rules of symbolic music. Synchronization of audio-visual elements: playback + animation sync’d etc…
ConclusionUsing Part 21, SMR can be easily rendered. This path seems easier to use than describing the complete framework in BIFS.
MPEG-4 Part 21 architecture
Supporting JSR-184 and JSR-239During 68th meeting, we selected JSR-184 as the starting point of MPEG-4 Part 21. During the AhG meeting in May, we found it was, technically-speaking a good choice even though some technologies were missing and the licensing model didn't seem to please many participants.
In the last 10-15 years, many high-level APIs (e.g. with a scene graph) have been proposed but almost none has survived more than 2 years in the market; developers and especially game developers seem to agree only at low-level. In other words, developers like to design their own scene graph, scene management and so on for their applications. JSR-184 (M3G) is one example of a high-level API and, if history repeats, may not survive long.
On the other hand, OpenGL ES is finalized and is becoming available in software and in hardware (chips) today. In the long run, OpenGL ES has better chance to survive as the long history of OpenGL suggests (almost 20 years!).
Therefore, it is important to support both M3G and Java bindings to OpenGL ES. Such bindings are not finalized yet but will be by the end of the year as part of JSR-239. Some participants believe that M3G will be used for simple applications but complex games will use JSR-239. It is also worth to mention that on desktops, a thin layer for OpenGL ES on top of OpenGL is already freely available, making applications using OpenGL ES working from embedded devices to desktops.
Finally, almost all implementations of JSR-184 are implemented on top of OpenGL ES. For devices with no OpenGL ES support (as there are already millions in Japanese market) JSR-184 can be implemented on top of a proprietary rasterizer.
In conclusion, JSR-184 must be supported for applications using its high-level API. For general applications, JSR-239 must be supported. The choice of using one or the other will be the responsibility of the application developer. We will establish a liaison to JSR-239 so to access its
156
specification and provide them feedback on the interfacing requirements we need, if any. Figure 1 summarizes this discussion.
Application (MPEGlet)
Other SG(incl. BIFS) JSR-184
Proprietaryrasterizer
JSR-239
OpenGL ES
MPEG-J(ISO/IEC 14496-11)
MPEG terminal(Systems / Decoders)
Java (in terminal)
Native (in terminal)
Java (sent to terminal)
Figure 1 – Block diagram of MPEG terminal with graphics enabled MPEGlets.
What remains to be done is the interfacing with an MPEG-4 terminal i.e. the so-called MPEG-J extensions. But first, we describe the architecture that enables all applications.
ArchitectureAfter many discussions, Figure 2 summarizes the MPEG terminal architecture using MPEGlets. Compare to MPEG-4 Systems (ISO/IEC 14496-1) architecture, Compositor and Renderer are arranged in a different manner albeit their definitions are the same:
A renderer is used to draw synthetic operations (2D/3D graphics) into an image (or pixels buffer),
A compositor is used to mix (or to compose) zero or more pixel buffers to create a final image.
As specified in ISO/IEC 14496-11, an MPEGlet is received from an MPEG-4 stream and placed into a decoding buffer (this is a Java class implementing MPEGlet interface alone or within a Java archive (jar)). From the decoding buffer (DB), the Java Virtual Machine (JVM) starts the MPEGlet.
In MPEG-4 Part 11, an MPEGlet has no access to graphic resources and has been thought as an application running in the background controlling the terminal. As such, it can access the BIFS scene graph, modify it, and receive events from it. The BIFS compositor then renders its scene graph and a final image is produced; this happens at every frame.
In MPEG-4 Part 21, we view an MPEGlet has a video decoder i.e. a component producing pixel buffers. The MPEGlet can draw into a pixel buffer using JSR-184 or JSR-239. The MPEGlet can also control the compositing process. In the simplest compositing case, the video buffer would be in the background and the MPEGlet pixel buffer will be drawn on top; transparent areas would show the video image underneath. The MPEGlet can also access composition buffers (i.e. pixel buffers) of other video decoders and use them as textures mapped onto synthetic 2D/3D objects.
DB
CompositingCompositing Final imageDeMux
DB
Video Dec
MPEGletGraphics operations
pixels
pixels(Composition Buffers)
RendererJSR-239/184
RendererJSR-239/184
(Decoding Buffers)
Figure 2 – MPEG terminal architecture with MPEGlets.
157
With this architecture in mind, the existing MPEG-J API defined in ISO/IEC 14496-11 can be reused with possibly minor modifications and more importantly with extensions for renderer, composition buffers, and compositing access. Since all media must be composed given time constraints, MPEG-J must also be extended with timing and synchronization.
MPEG-J extensionsTiming and synchronizationIn order to synchronize composition buffers with an MPEGlet, we need timing information from the buffers.
Q: Do we need to query time or be event triggered? A: Different scenarios are possible and it seems both features should be supported.We need CTS, an abstraction to media position (in time and in sample). It is not clear if decoding buffers (and hence DTS) is needed.Composition buffer accessIf we want to use pixels from a visual decoder, we need an abstraction to CBs.Efficient renderingRenderers need to be bound to a composition buffer for rendering. The compositor is the component managing the buffers to produce the final image. Therefore, an MPEGlet should ask the Compositor for one or more composition buffers, which in turn may provide a software or hardware accelerated buffer that match the MPEGlet requirements and the available resources in the terminal.
We need an abstraction from MpegjTerminal to access the compositor.We need a facility in the Compositor to create buffers with some configuration hints.
At each frame, an MPEGlet should be able to bind to a pixel buffer, draw whatever rendering commands, release this pixel buffer. This mechanism is already possible with JSR-184, we must ensure it is also the case with JSR-239.MPEGlets initializationThe MPEGlet interface (ISO/IEC 14496-11) is simply a Runnable. In other words, an MPEGlet is a task running in a thread. In order to initialize hardware accelerated pixel buffers, an application must access native rendering peers.In the last section, we described that through the MpegjTerminal, an MPEGlet can access the Compositor and create hardware accelerated buffers since the Compositor makes the final image and hence has access to native rendering peers.User interactionAn application wouldn't be interactive without keyboard, mouse or other devices access. Java provides such mechanisms for keyboard and mouse so there is no need to define anything if we support J2ME, J2SE, J2EE, and whatever profiles of each Java edition.Misc.From this discussion, it seems some areas must be queried by an MPEGlet in order to discover what a terminal supports. For example, one might want to know if the terminal supports JSR-184 and/or JSR-239. Rendering and Compositing properties should be queried so that an MPEGlet can adapt its processing. This remains to be discussed.
MPEG-4 Part 20 – LaSeR (overview)LaSeR stands for Lightweight scene representation.
158
LaSeR is based on W3C Scalar Vector Graphics but is much smaller. It has features such as being able to move from one scene to another and preserve the status of the scene.
Node features Laser shapes is just polygons (actually, 2D filled contours) and polylines. SVG path will be
added later. No picking at this moment but will be added during CE harmonizing Laser and SVG. AnimateXXX is like SVG without splines. AnimateActivate to animate ID of nodes like a
Switch with a sequence. Cursor is to emulate a stylus with keys on a phone. TextInput is an interface with character input in a phone. xxxKey nodes are configurations for other elements but may not remain for alignment with
SVG. No Inline (as with SVG Tiny) No script (conditional + action is enough)
File format and OD enhancementsThe binary syntax is like BIFS but without context. So you can decode a command without memory of previous scene.
Simple Aggregation Format (SAF) SAF is a way to package scene + audio + video to do cheap streaming over HTTP. Mapping to over transport mechanism is very easy with this format.
Cache mechanism: CacheObject Enables objects to remains in the cache of the phone for faster access.
End of stream signaling Missing in MPEG-4, used to reclaim memory and kill decoders
OD enhancements SimpleDecoderConfig = like DecoderConfig but simpler SimpleDecoderSpecificInfo = just the header of the stream
NotesJSR-226 is aligned with SVG 1.1 and would be useful for a Java access to LaSeR scene.
Main targeted applications portals, services (traffic, maps, weather…), database interrogation, stock quotes, decoration of video clips (e.g buttons to start/stop clips), news service (BBC trying this LaSeR application now) etc…Designed for mobiles applications.
ConclusionMPEG-4 Part 20 (LaSeR) is a simplified version of SVG Tiny with a binary representation simpler than BIFS. It is designed to be a sort of "Flash for mobiles" within a simplified MPEG-4 terminal implementation. Therefore, LaSeR is simplified 2D version of BIFS designed for mobiles harmonized with SVG.
159
Resolutions of SNHC
Output documentsNo. Title TBP Availabl
eEditor
14496-16 MPEG-4 Animation Framework eXtension (AFX)
6543
AFX Reference software FPDAM7 No 04/07/23 Patrick Gioia
14496-16 MPEG-4 Animation Framework eXtension (AFX)
6544
ISO/IEC 14496-16/PDAM1 No 04/07/23 Marius Preda
6545
ISO/IEC 14496-16/DCOR1 No 04/07/23 Marius Preda
6546
AFX CE description No 04/07/30 Marius Preda
6547
AFX VM 15.0 No 04/07/30 Marius Preda
6548
SNHC FAQ 12.0 Yes 04/07/23
6572
Request for ISO/IEC 14496-16/AMD1 No 04/07/23 Marius Preda
14496-21 MPEG-J extensions for rendering6549
ISO/IEC 14496-21 WD 1.0 No 04/08/06 Mikaël Bourges-Sévenier
ResolutionsMPEG-4Part 5
The SNHC subgroup approves the integration of Solid Modeling into the AFX reference software.
Part 16 The SNHC subgroup informs that, following 68th meeting resolutions, Solid Modeling
framework remains in ISO/IEC 14496-16 and Light-Field Mapping and Particle Systems are removed by corrigendum.
The SNHC subgroup informs that XMT and MPEG-J representations for AFX tools are available in ISO/IEC 14496-11/AMD4.
Part 21 The SNHC subgroup informs that, following 68th meeting resolutions, Solid Modeling
framework remains in ISO/IEC 14496-16 and Light-Field Mapping and Particle Systems are removed by corrigendum.
The SNHC subgroup informs that XMT and MPEG-J representations for AFX tools are available in ISO/IEC 14496-11/AMD4.
Establishment of SNHC Ad-Hoc groups
160
No. Title Meeting ChairN6662 AhG on AFX documents, CEs, and
softwareMarius Preda
N6663 AhG on MPEG-J extensions for rendering Mikaël Bourges-Sévenier
N6662 Ad Hoc Group on AFX documents, CEs, and softwareMandates: 1. Maintain and edit SNHC VM document.
2. Coordinate SNHC CE activities.3. Coordinate AFX/AMD1 software implementation
Chairman: Marius Preda (INT)Co-chairs: Mahnjin Han (Samsung AIT)
Patrick Gioia (France Telecom R&D)Duration: Until 70th meeting Meetings Sunday before 70th meetingReflector: mpeg-snhc AT gti. ssr. upm. esSubscribe: Send an email to mpeg-snhc-request AT gti. ssr. upm. es with the message
“subscribe” as the first line in the body.
N6663 Ad Hoc Group on MPEG-J extensions for renderingMandate: 1. Maintain and edit 14496-21 WD document
2. Harmonize MPEG-J systems interfaces for rendering needsChairman: Mikaël Bourges-Sévenier (Mindego Inc.)Co-chairs: Vishy Swaminathan (Sun Microsystems)
Itaru Kaneko (Waseda University)Duration Until 70th meeting Meetings: Sunday before 70th meetingReflector: mpgj-sys AT advent. ee. columbia. eduSubscribe: Send an email to mpegj-sys-request AT advent. ee. columbia. edu with the
message “subscribe” as the first line in the body.
Closing of the MeetingSee you in Palma de Mallorca in October (and bring your swim suits ).
161
Annex 11Report of Integration meeting
Source: Jean-Claude Dufourd, ENST
Opening of the Meeting
Allocation of contributionsMonday Plenary
10755 T. Chiang et al AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance
10756 L. Cieplinski et al AHG on Maintenance of MPEG-7 Visual related Documents and Reference Software
Joint with MDS on MPEG-21 Conformance, Wed 15:00 to 16:00
10874 Spencer Cheng et al Improving MPEG-21 IPMP Conformance - Experience from MPEG-2/4 IPMPX
10891 Eva Rodriguez et al Revised REL Interpretation Conformance after verification of Test Cases
Joint with MDS on MPEG-21 Reference Software, Thu 11:00 to 12:0010847 SC29 Secretariat Summary of Voting on CD of 21000-8
10864 Xin Wang et al Simple Integration Reference Software for MPEG-21 REL, DID and DIA
10942 Shane Lauf et al Mobile MPEG-21 browser implementationIntegration plenary, Thursday 14:00-16:00, Systems room
11117 Chun-Jen Tsai et al Scalable Multimedia Streaming Test Bed for Media Coding and Testing in Streaming Environments
10792 SC 29 Secretariat Summary of Voting on ISO/IEC PDTR 21000-12
11029 Juergen Schmidt et al
Simple Integration Reference Software for MPEG-4 AudioBIFS, version 3
10882 Gyeong Ja Jang et al Updates on the reference software of AFX Encoder10918 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-5:2001/FPDAM 6
11038 Stephan Würmlin et al
Results on Ref. Soft. Impl. on Point based Rendering for MPEG-4 AFX
11134 Jeremie Farret et al Solid implementation into IM1
11103 Alexandre Cotarmanac'h Updated software for SL extension
10983 ITTF via SC 29 Sec. Table of Replies on ISO/IEC 14496-5:2001/FDAM 4 [SC 29 N 6078]10984 ITTF via SC 29 Sec. Table of Replies on ISO/IEC 14496-5:2001/FDAM 5 [SC 29 N 6079]Conformance10922 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-4:200X/FPDAM 210923 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:200X/FPDAM 810958 Yoshihiro Miyamoto Proposed Corrigendum to ISO/IEC 14496-4:200X 2nd Edition
162
11072 Ralph Sperschneider Status on MPEG-4 Audio Conformance
List of standards under developmentStd
Pt
Edit.
Project
Description CfP
WD CD FCD FDIS
2 4 2004 Amd.1 IPMP Conformance Ext. 03/03
03/07
03/12 04/07
2 4 2004 Amd.2 Audio Conformance Ext. 03/10
03/12
04/03 04/07
2 5 2004 Dam1 IPMP Ref.Soft. Ext. 03/07
04/07
4 4 2004 Cor.1 Visual Bitstreams 04/03
04/10
05/01
4 4 2004 Amd.6 AVC 03/07
03/12 04/07
4 4 2004 Amd.8 HE-AAC, ABIFS and SA 03/10
03/12
04/03 04/07
4 4 2004 Amd.9 AVC FRExt Conformance 04/03
04/07
05/01 05/07
4 4 2004 Amd.10 New Levels of SP Conf 04/07
05/01 05/07
4 5 2004 Amd.6 AVC and HE-AAC 03/03
03/07
03/12 04/07
4 5 2003 Amd.7 AFX Reference SW 02/10
02/12
03/12 04/07
4 5 2004 Amd8 AVC FRExt Ref Soft 04/07
04/10 05/04
7 6 2001 Amd.1 Reference software extensions 01/12
03/03
03/12 04/07
7 7 2004 Amd.1 Conformance extensions 03/03
03/07
03/12 04/07
21 8 200x 1st Ed. Reference software 03/03
04/03
04/07 05/01
21 12 200x 1st Ed. Test Bed for MPEG-21 Resource Delivery
02/12
03/12
04/07
21 14 200x 1st Ed. Conformance 03/10
04/10
05/04 05/07
Latest references
Project P.
Standard Issue No.
MPEG-4
4 ISO/IEC 14496-4:2003 (MPEG-4 Conformance 2nd
Ed.)02/12 Awaji N5457
MPEG-4
4 ISO/IEC 14496-4:2001/Amd.1 (FlexTime, Studio and Streaming Video Profile)
02/07 Klagenfurt
N5083
MPEG-4
5 ISO/IEC 14496-5:2001 (Ref. Soft 2nd Ed.) 01/07 Sydney N4368
MPEG-4
5 ISO/IEC 14496-5:2001/Amd.1 (FlexTime) 02/03 Jeju N4711
MPEG-4
5 ISO/IEC 14496-5:2001/Amd.2 (XMT) 02/05 Fairfax N4865
MPEG-7
6 ISO/IEC 15938-6:2002 (Reference Software) 01/12 Pattaya N4475
MPEG-7
7 ISO/IEC 15938-7:2002 (Conformance) 02/07 Klagenfurt
N4937
163
Request documents
MPEG-2 Conformance10922 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-4:200X/FPDAM 2Usual « please fix all bugs » comment
MPEG-2 Reference Software
MPEG-4 Conformance (14496-4) 10923 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:200X/FPDAM 8Usual « please fix all bugs » comment, and the rest was dealt with in Audio
10958 Yoshihiro Miyamoto Proposed Corrigendum to ISO/IEC 14496-4:200X 2nd EditionNo one presented the contribution
11072 Ralph Sperschneider Status on MPEG-4 Audio ConformanceThis document was presented in Audio, and only one issue was brought to Integration: all mp4 test sequences in Audio need to be made compliant with the filetype requirement of the latest MP4 file format amendment. After some verification, it is optional to bring all sequences to mp4 v2, not mandatory.
MPEG-4 Reference Software (14496-5) 10882 Gyeong Ja Jang et al Updates on the reference software of AFX EncoderNo one presented the contribution
10918 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-5:2001/FPDAM 6Usual « please fix bugs » comments
10983 ITTF via SC 29 Sec. Table of Replies on ISO/IEC 14496-5:2001/FDAM 4 [SC 29 N 6078]
Only YES votes
10984 ITTF via SC 29 Sec. Table of Replies on ISO/IEC 14496-5:2001/FDAM 5 [SC 29 N 6079]
Only YES votes
11029 Juergen Schmidt et al Simple Integration Reference Software for MPEG-4 AudioBIFS, version 3
This document reports on the implementation of the version 3 of AudioBifs in IM1. This implementation uses manually generated files, it needs to be brought in sync with the automatically
164
generated templates. This does composition. Rendering is under discussion with Systems: is it required and how?
11038 Stephan Würmlin et al
Results on Ref. Soft. Impl. on Point based Rendering for MPEG-4 AFX
No one presented the contribution
11103 Alexandre Cotarmanac'h Updated software for SL extension
No one presented the contribution
11134 Jeremie Farret et al Solid implementation into IM1No one presented the contribution
Issue: no reference software for part 15: “AVC file format”. This is on Dave Singer’s todo list.
Issue: do we need reference software for part 17: “Streaming Text”. Jan Van der Meer acknowledged that presence of reference software is a prerequisite to promotion to FDIS of the specification.
MPEG-21 Conformance
10874 Spencer Cheng et al Improving MPEG-21 IPMP Conformance - Experience from MPEG-2/4 IPMPX
No one presented the contribution
10891 Eva Rodriguez et al Revised REL Interpretation Conformance after verification of Test Cases
This document was presented: it presents work on the conformance “streams”.Discussion of the state of the M21 Conformance: the WD is pretty skimpy, and we do not think it should be progressed. In general, REL is the “good student” for conformance, but this does not say much…
MPEG-21 Reference Software
10864 Xin Wang et al Simple Integration Reference Software for MPEG-21 REL, DID and DIA
The document was presented : it describes a software, extended from previous version with a DIA functionality. The DIA functionality is provided by a piece of DIA reference software. This falls into the category of integrated utility software.
10847 SC29 Secretariat Summary of Voting on CD of 21000-8AU nb comment : « update to FDIS status » is acceptedUS nb comments:
- clarify introduction: accepted- clarify content of each section: accepted- use consistent presentation: accepted
165
- use consistent organisation of the software: acceptedKR nb comment:
- test bed: acknowledged, another solution is proposed (normative reference to the TR)- integrated software plan for new parts: acknowledged, these parts are out of scope of the
current document (because no FDIS yet)- comment on FF software: not relevant for this document- list of DIA utility module: accepted
10942 Shane Lauf et al Mobile MPEG-21 browser implementationThe document presents a J2ME implementation of a M21 browser, with an impressive demo on a phone.
Multimedia Test Bed10792 SC 29 Secretariat Summary of Voting on ISO/IEC PDTR 21000-12 Discussion of the responses to the various votes. The US comments are accepted. The AU and UK comments are not really technical and do not address shortcomings of the document, but evoke higher level issues.
11117 Chun-Jen Tsai et al Scalable Multimedia Streaming Test Bed for Media Coding and Testing in Streaming Environments
Presentation of small changes to the test bed software.
MPEG Reference Software Guide
166
Resolutions of Integration
Resolutions
Documents
MPEG-2
No. Title TBP Available
13818-4 MPEG-2 Conformance 6624 DoC on ISO/IEC13818-4/FPDAM1 IPMP Conformance Ext. N 04/07/236616 ISO/IEC13818-4/FDAM1 IPMP Conformance Ext. N 04/07/236617 DoC on ISO/IEC13818-4:200X/FPDAM2 Audio Conformance Ext. N 04/07/236618 ISO/IEC13818-4:2004/FDAM2 Audio Conformance Ext. N 04/09/23
13818-5 MPEG-2 Reference Software 6619 DoC on ISO/IEC 13818-5/Dam2 IPMP Reference Software Ext. N 04/07/236620 ISO/IEC 13818-5/AMD2 IPMP Reference Software Ext N 04/07/236621 ISO/IEC 13818-5:1997/Amd1:1999/COR2 N 04/07/23
MPEG-4
No. Title TBP Available
14496-4 MPEG-4 Conformance 6532 DoC on ISO/IEC 14496-4/FPDAM6 AVC Conformance Y 04/09/156533 ISO/IEC 14496-4/FDAM6 AVC Conformance Y 04/09/15
6622 DoC on ISO/IEC 14496-4/FPDAM8 HE-AAC, ABIFS and SA Conformance
N 04/07/23
6623 ISO/IEC 14496-4/FDAM8 HE-AAC, ABIFS and SA Conformance N 04/09/236534 ISO/IEC 14496-4/PDAM9 AVC FRExt Conformance Y 04/09/156498 ISO/IEC 14496-4/PDAM10 New levels of Simple Profile Conformance N 04/07/19
14496-5 MPEG-4 Reference Software
6535 DoC on ISO/IEC 14496-5/FPDAM6 AVC and HE-AAC reference software
N 04/09/15
6536 ISO/IEC 14496-5/FDAM6 AVC and HE-AAC reference software N 04/09/236625 DoC on ISO/IEC 14496-5/FPDAM7 AFX reference software N 04/07/236626 ISO/IEC 14496-5/FDAM7 AFX reference software N 04/07/236537 ISO/IEC 14496-5/PDAM8 AVC FRExt reference software Y 04/09/15
MPEG-21
No. Title TBP Available
21000-8 MPEG-21 Reference Software6627 DoC on ISO/IEC 21000-8/CD MPEG-21 reference software N 04/07/23
167
6628 ISO/IEC 21000-8/FCD MPEG-21 reference software N 04/09/10
No. Title TBP Available
21000-12 MPEG-21 Test Bed for MPEG-21 Resource Delivery
6629 DoC on ISO/IEC 21000-12/PDTR Test Bed for MPEG-21 Resource Delivery
N 04/07/23
6630 ISO/IEC 21000-12/DTR Test Bed for MPEG-21 Resource Delivery N 04/07/23
AHG
168
Annex 12Report of Test meeting
Source: Tobias Oelbaum
Opening of the Meeting
Goals for the weekThe goals of this week are:
Conduct “Expert testing” for SVC CE Processing the results of the SVC CE tests and presentation of the results Discussion about testing for the 3DAV CfE, review of selected bitrates for 3DAV CfE
Joint MeetingsThe following joint meetings were scheduled
with Video - SVC CE testing with Video – 3DAV CfE preparation
Contributions10935 A Multimedia material Visual quality ranking procedure based on Single or Multiple Viewing (Baroncini / Tan / Oelbaum)
Test Activities
SVC CE testingResults of the CEs were evaluated at the meeting using the new “Expert viewing” method described in 10935. Five different test sessions with spatial resolutions ranging from QCIF to 4CIF were conducted with five experts participating at each test session.Results were presented at a joint meeting with Video and are documented in Nxxxx
3DAV, preperation of the CfE First discussions about possibilities to test 3DAV proposals. It was proposed to use the same “Expert viewing” method for 3DAV that was used for the SVC CE tests.Bitrates selected for the CfE were reviewed and modified to allow meaningful tests at the next meeting.It was agreed that for MVC (Multible Viewpoint Videocoding) two different views that will be tested will be selected randomly by the test subgroup.
Test Resolutions
Output Documents W6513 Results of the visual assesment of the results of the CEs on Scalable Video Coding
Technology
169
AdHoc GroupsNo AdHoc Groups have been set up at this meeting. The video group has setup the AhG for the “SVC call for proposal”.
Resolutions The test subgroup would like to thank Charles Fenimore for his valuable help preparing the
SVC CE tests. The test subgroup would like to thank videatis for making available the HD sequence
“Soccer” for the SVC CE testing and further testing within MPEG.
170
Annex 13Report of ISG meeting
Source: ISG ChairEditor: Marco Mattavelli (EPFL)
OverviewThe main work items of the Implementation Studies Subgroup in Redmond are:
1. The advances in the development of the MPEG-4 “Part 9 Reference Hardware Description” Phase 2 concerning the integration of the MPEG-4 Optimized Reference software Part 7 and the Reference Hardware Part 9 so as to constitute a “mixed” software hardware description of MPEG-4 video using the concept of the virtual socket.
2. The planning and extensions of the integrated framework for the support to the development of MPEG-4 Part 9 with MPEG-7 Part 7 and AVC (MPEG-4 Part-9) software.
3. The contribution to the definition of the Video Coding Tools repository4. The approval of the FDAM of MPEG-7 reference software.
Input contributions w.r.t. the above items are summarized according to the following table:
Contributions
M10751 “Report of the AHG on MPEG-4 Part 9 "Reference Hardware Description"
Marco Mattavelli EPFL, Robert Turney Xilinx Research Lab.
M10808 2-D IDCT Hardware Accelerator Implementation for Virtex-II Devices
A. Navarro, A. Silva, O. Nunes, C. Aragao Telecommunications Institute-University of Aveiro-Portugal
M10821 Motion Estimation Hardware Accelerator Implementation for Virtex-II Devices
J.Dubois, L.Pierrefeu, M.Mattavelli Laboratoire Electronique Informatique et Image of Dijon University – France, LTS-3 EPFL
M10823 An Integrated Hardware-Accelerated Software Framework for MPEG-4 Hardware Reference Model
Tamer S. Mohamed and Wael Badawy University of Calgary, Calgary, AB, Canada.
M10824 An IP Block For MPEG-4 Part 10 Context-Based Adptive Variable Length Coding (CAVLC)
Ihab Amer, Wael Badawy, and Graham Jullien Advanced Technology Information Processing Systems (ATIPS), Calgary, Alberta, Canada.
M10825 A Hardware Block for 2x2 Hadamard Transform and Quantization with Application to MPEG–4 Part 10
Ihab Amer, Wael Badawy, and Graham Jullien Advanced Technology Information Processing Systems (ATIPS), Calgary, Alberta, Canada.
M10826 A SystemC model for 2x2 Hadamard Transform and Quantization with Application to MPEG–4 Part 10
Ihab Amer, Wael Badawy, and Graham Jullien Advanced Technology Information Processing Systems (ATIPS), Calgary, Alberta, Canada.
M10827 A Hardware Block for 4x4 Hadamard Transform and
Ihab Amer, Wael Badawy, and Graham Jullien Advanced Technology Information Processing
171
Quantization in MPEG-4 Part 10 Systems (ATIPS), Calgary, Alberta, Canada.M10828 A SystemC model for 4x4 Hadamard
Transform and Quantization with application to MPEG-4 Part 10
Ihab Amer, Wael Badawy, and Graham Jullien Advanced Technology Information Processing Systems (ATIPS), Calgary, Alberta, Canada.
M10829 A Hardware Block For The MPEG-4 Part 10 4x4 DCT-Like Transformation And Quantization
Ihab Amer, Wael Badawy, and Graham Jullien Advanced Technology Information Processing Systems (ATIPS), Calgary, Alberta, Canada.
M10830 A SystemC Model For The MPEG-4 Part 10 4x4 DCT-Like Transformation And Quantization
Ihab Amer, Wael Badawy, and Graham Jullien Advanced Technology Information Processing Systems (ATIPS), Calgary, Alberta, Canada.
M10849 Low-power hardware acceleration for motion estimation
Valentin Muresan, Noel O’Connor, Noel Murphy, Sean Marlow, Alan SmeatonCentre for Digital Video Processing, Dublin City University, Dublin 9, Ireland.
M10863 MPEG-4 Inverse Quantizer Hardware Accelerator Implementation in Virtex II
A. Navarro, A. Silva, O. Nunes, C. Aragao Telecommunications Institute-University of Aveiro-Portugal
M10883 Hardware Acceleration Module for Shape Adaptive Discrete Cosine Transform
Andrew Kinane, Valentin Muresan, Noel O’Connor, Noel Murphy, Seán Marlow, Alan Smeaton Centre for Digital Video Processing, Dublin City University, Dublin 9, Ireland
M10954 Multiple IP-Core Hardware-Accelerated Software System Framework for MPEG4-Part9
Tamer S. Mohamed and Wael Badawy University of Calgary, Calgary, AB, Canada.
M11092 Hardware Acceleration Module for MPEG-4 Binary Shape Coding Motion Estimation Tool
Daniel Larkin, Valentin Muresan, Noel O’Connor, Noel Murphy, Seán Marlow, Alan Smeaton Centre for Digital Video Processing, Dublin City University, Dublin 9, Ireland
M11104 Status of CDVP's contribution to MPEG-4 Part 9 - Implementation Study Group
Valentin Muresan, Daniel Larkin, Andrew Kinane, Noel O’ConnorCentre for Digital Video Processing, Dublin City University, Dublin 9, Ireland.
Detailed Report
Reference hardware description for MPEG-4
The ISG activity at the Redmond meeting has mainly been devoted to the review of the contribution and to the preparation of guideline documents:
the review of the contributions presenting new HDL module submissions the review of contributions on the proposed improvements to the API specification and
implementation improvements of the “Virtual Socket”,
172
the planning of the releases of the integrated framework based on the Wildcard II supporting the virtual socket,
on the drafting of new guidelines for module and documentation submissions, on the specification of the advanced version of the demonstration, on the update of MPEG-4 Part 2 and Part 10 module submission status.
The high number of HDL number received and the several new commitments made necessary several action points to coordinate the work and to uniform the documentation that will be included in the technical report. The first was to update the call for submissions so as to include and make available for current and new submitters all the information and developments made so far (output document N6506). The new call updates the status of the submissions the goals of each phase and provides references to documents providing detailed information on the integrated framework that support the virtual socket API, on the format for the documentation to be submitted together with the module HDL code and to the instruction on how to access the CVS server for HDL code submission and maintenance. With this purpose two output documents have been prepared, one provides the CVS access conditions and instructions (output document N6508), the other is a template for the preparation of the documentation of each HDL module (output document N6507).
The table of module submission commitment has been updated and reported in an specific output document (question marks indicate that the commitment is uncertain concerning the delivery date or that the module has not been selected for a submission commitment) (output document N6509) .
The ad-hoc group on the development of MPEG-4 Part 9 has been re-established with updated mandates, including a specific mandate for the specification and development of the demonstration platform. The ad-hoc schedule includes 4 telephone conferences before next meeting. Phone conferences are planned on the 19th August, 9th September, 30th September, 14th October at 3 p.m. GMT. Tel: (from US 1-877-582-3182, from outside US 1-706-679-1128, participant code 9202060193).
Contribution to the definition of a video tools repository.
Two joint meeting with the video group have been held to discuss the issue related to the development of a video tool repository. The implementation study group has contributed to put in evidence all formalism aspects that are essential for an efficient usage of the library so as to be able to define new module interconnections, new control signals and new modules. Such formalism definition should be further developed so as to be able to define new ways of using the standard blocks and define “new standards”.
The promotion to FDAM of the MPEG-7 reference software extensions.
The MPEG-7 reference software extension has been approved to FDAM answering to the US national body comments requiring for a correct abstract summaries for the audio descriptors. The document will be ready for ballot one week after the end of the meeting.
ResolutionsThe above activities have led to the following resolutions and output document
173
approval.
MPEG-4 part 9 related resolutions:
14.1.2 The Implementation Studies subgroup recommends to approve the following documents:
MPEG-4
No. Title TBP Available
14496-9 MPEG-4 Reference Hardware Description
6506 Updated Call for the Submission of Hardware Reference Code for MPEG-4 Part 9: Reference Hardware Description
Y Y
6507 Template for MPEG-4 Part 9 HDL module documentation N 7/27/04
6508 CVS server user manual and code format specification for MPEG-4 Part-9 submissions and maintenance Rev. 0
N 7/30/04
6509 Status of HDL submissions and commitments for MPEG-4 Part-9 N Y
MPEG-7
No. Title TBP Available
15938-6 MPEG-7 Reference Software
6511 ISO/IEC FDAM 15938-6 Information Technology -Multimedia Content Description Interface- part 6: Reference Software Extensions
N 7/30/04
6512 DoC of ISO/IEC PDAM 15938-6 Information Technology -Multimedia Content Description Interface- part 6: Reference Software Extensions
N Y
14.1.3 The Implementation Studies subgroup would like to thank all submitters of HDL code and contributors to the implementation of the virtual socket and encourages them to continue this fruitful effort and collaboration.
174
Annex 14Report of Liaisons meeting
Source: Jan Bormans
The Liaison Group received three requests to establish a class C relationship, all of which were granted after consideration at the Redmond meeting:
The Digital Media Project (DMP) is a non-for-profit organisation registered in Geneva in December 2003 with the mission to “promote continuing successful development, deployment and use of Digital Media that respect the rights of creators and rights holders to exploit their works, the wish of end users to fully enjoy the benefits of Digital Media and the interests of various value-chain players to provide products and services, according to the principles laid down in the Digital Media Manifesto”.
DMP has assessed the urgent need for Technical Specifications of devices that possess a subset of features of fully-fledged Interoperable End-user Devices, the ability to deal with governed content in an interoperable way being the most important. DMP has called such devices “Portable Audio and Video Devices” (PAV) and decided that it will develop the relevant Technical Specifications on a fast track, namely by April 2005. These DMP activities are complementary to WG 11’s work, especially within the field of MPEG-21.
The Digital Cinema Specification Development Committee (DCSDC) as Broadband Networks are now widely spreading throughout the world and high quality video distribution is getting easier and easier, new content business concepts based on the mental sense or culture base are considered becoming key to industry. Considering these trends - and in order to raise-up Japanese cinema industry to the international level on its quality and quantity - the Japanese National Project named Digital Cinema Common Specification Development Project (DCCSDP) has been started on July 1st 2004. To conduct DCCSDP, Digital Cinema Common Specification Development Committee (DCCSDC) was established. Object of this DCCSDP is to create the cinema technology up to and above the film based cinema industry which is mainly conducted by Hollywood, and furthermore, create value chain based on current digital technology and keep technology level consistency from scenario creation to cinema presentation and then, to standardize these established concepts and technologies.
This new liaison relationship will enable efficient information exchange and collaboration in the field of normative technology for Digital Cinema Contents. DCCSP will consequently have access to MPEG technology and will provide feedback on its usability for DCCSP’s application domain. Immediate topics of interaction are foreseen to include MPEG-4 AVC, MPEG-7 and MPEG-21 REL and RDD.
The Open Mobile Alliance (OMA) was formed in June 2002 by nearly 200 companies representing the world's leading mobile operators, device & network suppliers, information technology companies and content providers. The Open Mobile Alliance is designed to be the centre of mobile service enabler specification work, helping the creation of interoperable services across countries, operators and mobile terminals that will meet the needs of the user (http://www.openmobilealliance.org).
175
The Open Mobile Alliance (OMA) expresses it desire to explore these activities jointly. OMA proposes the exchange of technical working documents and specifications via designated liaison representatives of each organization. The Liaisons Group considered the following input documents:
Input Contrib No.
Title
M10843 Liaison Statement from the Digital Media ProjectM11105 Digital Cinema QOS and ConformanceM10877 Liaison Statement from JTC 1/SC 37 on ISO/IEC FCD 197945M10985 Liaison Statement from the Open Mobile Alliance (OMA)
M10775IEC CDV 60728-9/Amd.1: Cable networks for television signals, sound signals and interactive services -- Part 9: Interfaces for cabled distribution systems for digitally modulated signals, Amendment 1
M10778 ISO/IEC FCD 19794-6: Information technology -- Biometric data interchange formats -- Part 6: Iris image data
M10779 SC 37 NP on Vascular Biometric Image Interchange Format
M10781IEC CDV 62328-1: Multimedia home server systems -- Interchangeable volume/file structure adaptation for broadcasting receivers -- Part 1: General description and architecture
M10782 IEC CDV 62328-2: Multimedia home server systems -- Interchangeable volume/file structure adaptation for broadcasting receivers -- Part 2: General recording structure
M10783IEC CDV 62328-3: Multimedia home server systems -- Interchangeable volume/file structure adaptation for broadcasting receivers -- Part 3: Broadcasting system specific recording structure – ISDB
M10784 Liaison Statement from ITU-T SG 17M10785 Liaison Statement from ITU-T SG 12M10793 Liaison Statement from the TV-Anytime ForumM10794 IEC CDV 62298-1: Teleweb Application -- Part 1: General DescriptionM10795 IEC CDV 62298-2: Teleweb application -- Part 2: Delivery methodsM10798 Liaison Statement from ITU-R SG 6/WP 6MM10799 Liaison Statement from ITU-T SG 9M10803 W3C Comments on the MPEG Timed Text specificationM10840 Liaison Statement from ITU-R SG 6/WP 6QM10893 SMPTE Liaison to MPEG on OpenType® and ISO/IEC 14496-18M10897 Liaison Statement from the TV-Anytime ForumM10992 Liaison Statement from SC 37 BiometricsM11116 Liaison Statement from Blu Ray Disk FoundersM11147 Liaison Statement from IEEE LTSC
In addition to replying, when appropriate, to the incoming Liaison Statements, it was agreed to take the initiative to send outgoing Liaison Statements to: W3C - on drawing the attention of W3C’s Device Independence Working Group to existing
MPEG technology that addresses parts of the topics they intend to cover in their upcoming Workshop on Metadata for Content Adaptation;
VCEG - informing ITU-T SG 16 Q.6 on our progress in the field of Scalable Video Coding (SVC) and links with AVC;
JSR-239 – regarding the usage by MPEG-4 part 21 of low-level graphic operations and the use of JSR-239 for its Java bindings to OpenGL ES.
176
The JVT has sent out Liaison Statements to various organizations describing the general status and content of the ISO/IEC 14496-10 FRExt amendment work, expect for BDF and SMPTE, which were sent out by WG 11 as they answer a request by these bodies addressed to WG 11.
The responses for the non-technical National Body comments as well as an updated list
of organisations with which MPEG entertains liaisons were completed.
The following recommendations were issued:
The approval of the following documents (Liaison Statements):
No. Title TBP AvailableGeneral
N6551 Liaison Statement to the Digital Media Project No 2004/07/23
N6552 Liaison Statement to the DCSDC No 2004/07/23
N6553 Liaison Statement to the OMA No 2004/07/23
N6554 Liaison Statement to JTC 1/SC 37 No 2004/07/23
N6555 Liaison Statement to ITU-T SG 17 No 2004/07/23
N6556 Liaison Statement to ITU-R SG 6/WP 6M No 2004/07/23
N6557 Liaison Statement to W3C on MPEG Timed Text specification No 2004/07/23
N6558 Liaison Statement to Blu Ray Disk Founders No 2004/07/23
N6559 Liaison Statement to IEEE LTSC No 2004/07/23
N6560 Liaison Statement to SMPTE on OpenType® and ISO/IEC 14496-18
No 2004/07/23
N6561 Liaison Statement to W3C on Public Workshop on Metadata for Content Adaptation
No 2004/07/23
N6562 Liaison Statement to VCEG No 2004/07/23
N6563 Liaison Statement to TVAF No 2004/07/23
N6564 Liaison Statement to JSR-239 No 2004/07/23
N6565 Liaison Statement to IEC TC 100 No 2004/07/23
N6566 Liaison Statement to SMPTE on Alpha Channel and AVC/H.264 Frext
No 2004/07/23
The approval of the following documents (statement of benefits):
No. Title TBP Available
177
General
N6567 Statement of benefits from establishing a class C liaison with the DMP
No 2004/07/23
N6568 Statement of benefits from establishing a class C liaison with the DCSDC
No 2004/07/23
N6569 Statement of benefits from establishing a class C liaison with the OMA
No 2004/07/23
The approval of the following documents (other Liaison documents):
No. Title TBP AvailableGeneral
N6570 Responses to NB Comments
No 2004/07/23
N6571 List of WG11 Liaisons No 2004/07/23
The Liaison group recommends the approval of the new Class C Liaisons with the OMA, the DMP and the DCSDC.
Nomination of liaison representatives:o Pete Schirling to the OMAo Marc Gauvin to the DMPo Miroslaw Bober to JTC1/SC37o Jean-Claude Dufourd to W3C
178