INTERNATIONAL ORGANISATION FOR STANDARDISATIONORGANISATION INTERNATIONALE DE NORMALISATION

ISO/IEC JTC 1/SC 29/WG 11CODING OF MOVING PICTURES AND AUDIO

ISO/IEC JTC 1/SC 29/WG 11 N6872Hong Kong – January 2005

Source Leonardo Chiariglione, ConvenorTitle Report of the 71st meetingStatus

Report of the 71st meeting

1 Opening The 71st WG11 meeting was held at Hong Kong on 2005/01/17-21 at the kind invitation of the China National Body and hosted by Hong Kong University of Science and Technology.

2 Roll call of participants Annex 1 gives the attendance list.

3 Approval of agenda Annex 2 gives the agenda approved.

4 Allocation of contributionsAnnex 3 gives the list of input contributions

5 Communications from Convenor 6 Report of previous meetingThis was approved.

7 Processing of NB Position PapersNational Body papers were considered and answers provided where appropriate.

8 Work plan

8.1 Media coding

8.1.1 AVC Fidelity Range Extensions Conformance

The following documents were approved

6894 Disposition of comments on ISO/IEC 14496-4:2004/PDAM9 AVC Fidelity Range Extensions Conformance

6895 Text of ISO/IEC 14496-4:2004/FPDAM9 AVC Fidelity Range Extensions Conformance

1

8.1.2 Scalable Video Coding

The following documents were approved

6880 Scalable Video Coding Applications and Requirements6898 Description of Core Experiments for Scalable Video Coding (SVC)6899 Joint Scalable Video Model (JSVM) 16900 JSVM 1 Software (Corresponding to JSVM 1)6901 Working Draft 1 of 14496-10:200x/AMD1 Scalable Video Coding

8.1.3 Audio Lossless Coding

The following documents were approved

7015 DoC on 14496-3:2001/PDAM 4, ALS7016 Text of 14496-3:2001/FPDAM 4, ALS7024 Application Scenarios for ALS and SLS7025 Workplan for Audio Lossless Coding (ALS)

8.1.4 Audio Scalable Lossless Coding

The following documents were approved

7017 DoC on 14496-3:2001/PDAM 5, SLS7018 Text of 14496-3:2001/FPDAM 5, SLS7024 Application Scenarios for ALS and SLS7026 Workplan for Scalable Lossless Coding (SLS)

8.1.5 1-bit Audio Lossless Coding

The following documents were approved

7019 DoC on 14496-3:2001/FPDAM 6, Lossless coding of 1-bit oversampled signals7020 Text of 14496-3:2001/FDAM 6, Lossless coding of 1-bit oversampled signals

8.1.6 AFX Extensions

The following documents were approved

6985 DoC on ISO/IEC 14496-16/PDAM16986 Text of ISO/IEC 14496-16/FPDAM

8.1.7 Streaming Text Format

The following document was approved

6965 Text of ISO/IEC 14496-17/FCD Streaming Text Format

2

8.1.8 Video Coding Tool Repository

The following documents were approved

6911 Study of Video Coding Tools Repository V3.06912 VCTR Textual Description V2.0

8.1.9 3D AV Coding

The following document was approved

N6999 Report of the Subjective Quality Evaluation for Multi View Coding CfE

8.1.10 Generic inverse DCT specification

The following documents were approved

6889 Disposition of Comments on ISO/IEC 11172-6 CD

6890 Study Text of ISO/IEC 11172-6 CD: Specification for Implementation of Inverse Discrete Cosine Transform

8.1.11 Parametric Stereo Conformance

The following documents were approved

7029 Request for Parametric Stereo Conformance Amendment7030 Text of 14496-4:2004/PDAM 11, Parametric Stereo Conformance

8.1.12 Scalable audio and speech coding

The following document was approved

7040 Call for Information on Scalable Speech and Audio Coding

8.1.13 Wavelet Video Coding

The following document was approved

6914 Description of Exploration Experiments in Wavelet Video Coding

8.2 Composition coding

8.2.1 XMT extensions

The following document was approved

6959 Text of ISO/IEC 14496-11:200x/FDAM4

3

8.3 Description coding

8.3.1 Video Descriptor Extensions

The following document was approved

6903 Text of ISO/IEC 15938-3:2002/PDAM2

8.3.2 Audio Descriptor Extensions

The following documents were approved

7035 Request for Amendment on MPEG-7 Audio High-Level Description Extensions7036 Text of 15938-4:2002/PDAM 2, High-Level Description Extensions

8.4 Systems support

8.4.1 Text Profile Descriptors

The following document was approved

6958 Study Text of ISO/IEC 14496-1:2004/FPDAM1

8.5 Digital Item

8.5.1 Digital Item Declaration

The following documents were approved

6926 DoC of ISO/IEC 21000-2 FCD6927 Text of ISO/IEC 21000-2 2nd Edition FDIS6955 Request to make MPEG-21 DID Publicly Available

8.5.2 Digital Item Identification

The following documents were approved

6993 Request for amendment 1 of ISO/IEC 21000-36928 ISO/IEC 21000-3 PDAM/1 MPEG-21 DII

8.5.3 Digital Item Binarisation

The following documents were approved

6978 New Work Item Proposal on XML Binarization6979 Text of ISO/IEC 23001-1/CD

8.5.4 DIA Conversions and Permission Extensions

The following documents were approved

6936 DoC for ISO/IEC 21000-7 PDAM/1

4

6937 ISO/IEC 21000-7 FPDAM/1

8.5.5 Fragment Identification for MPEG Media Types

The following documents were approved

6948 ISO/IEC 21000-17 CD MPEG-21 Fragment ID6949 Workplan for Core Experiment on Logical Model Descriptions

8.6 Transport and File Format

8.6.1 AVC File Format extensions for FRExt

The following documents were approved

6963 Request for Amendment 1 of ISO/IEC 14496-156964 Text of ISO/IEC 14496-15/PDAM1 Support for

FREXT

8.6.2 MPEG-21 File Format

The following documents were approved

6974 DoC on ISO/IEC 21000-9/FCD6975 Text of ISO/IEC 21000-9/FDIS

8.7 Multimedia architecture

8.7.1 MPEG-J extension for rendering

The following document was approved

6990 Study text of ISO/IEC 14496-21/CD

8.7.2 MPEG Multimedia Middleware

The following documents were approved

6980 Report on Intentions to submit to M3W Call for Proposal6981 Call for Proposal on MPEG Multimedia Middleware (M3W)

8.8 Reference implementation

8.8.1 AVC Fidelity Range Extensions Reference Software

The following documents were approved

6896 Disposition of comments on ISO/IEC 14496-5:2001/PDAM8 AVC Fidelity Range Extensions Reference Software

6897 Text of ISO/IEC 14496-5:2001/FPDAM8 AVC Fidelity Range Extensions Reference

5

Software

9 Liaison matters

10 Organisation of this meeting

10.1 Tasks for subgroupsTasks were assigned to achieve the goals of the work plan.

10.2 Joint meetings The following joint meetings were held

Groups What Where Day TimeMDS, Req MPEG-21 Vision Req Mon 16:30-18:00MDS, Req MAF Req, REL Prof. Req Tue 09:00-10:30Vid, Sys SVC System issues Vid Tue 12:30-13:00MDS, Req, Sys Identifiers, DI Streaming Req Tue 14:00-15:00Vid, Req SVC Requirements Vid Tue 16:00-17:00JVT, Req, Vid Colour space Vid Tue 17:00-17:30Snh, Req 3D compression profiles Req Tue 17:30-18:00MDS, Sys Fragm. ID, Binarisation MDS Tue 10:30-11:30Snh, Vid 3D AV Snh Wed 11:00-12:00Req, Sys Laser Req Wed 14:00-14:30Aud, Mds, Req DRM in MPEG-A pt. 2 Aud Wed 15:30-16:00Aud, Mds, Req Perceptual music descriptors Aud Wed 16:00-16:30Vid, Isg VCTR ISG Wed 17:00-18:30Req, Sys, Snh 3D mobile profile Snh Thu 09:00-10:00Req, Sys, Mds DI transport & storage Req Thu 10:00-11:00Req, Mds MPEG-21 MAF Req Thu 11:00-12:00Aud, Req Scalable speech & audio reqs Aud Thu 14:00-14:30

10.3 Administrative matters

10.3.1 Schedule of future MPEG meetings

The following meeting schedule was approved

Hong Kong CN 05 01 17-21Busan KR 05 04 18-22Poznań PL 05 07 25-29Nice FR 05 10 17-21? TH 06 01 16-20Geneva CH 06 04 03-07Klegenfurt? AT? 06 07 17-21

10.3.2 Promotional activities

An ad hoc group with this mandate was re-established.

6

11 Planning of future activities The following ad hoc groups were established6984 AHG on MPEG File Formats

6983 AHG on Scene Representation

6982 AHG on XML Structure Binarization and Streaming

6921 AHG on 3DAV Coding

6991 AHG on AFX documents, CEs, and software

7044 AHG on Audio Coding Tool Repository

7043 AHG on Audio Standards Maintenance

6886 AHG on Color Spaces

6994 AHG on Communicating MPEG activities to the business community.

6920 AHG on Description Tools for MPEG-7 New Visual Extensions

6879 AHG on DI Streaming Requirements

6923 AHG on Exploration in Wavelet Video Coding

7049 AHG On Exploration of Scalable Audio and Speech Coding

6885 AHG on Font Format

6924 AHG on Image Player MAF

7050 AHG on JPEG Liaison

6878 AHG on MAFs

6918 AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance

6919 AHG on Maintenance of MPEG-7 Visual related Documents and Reference Software

6953 AHG on MPEG-21 DIA

6952 AHG on MPEG-21 DID and DIP

7047 AHG on MPEG-4 Lossless Audio Coding

6957 AHG on MPEG-4 Part 9: Reference Hardware Description Phase 1 and 2.

7045 AHG on MPEG-7 Audio

6992 AHG on MPEG-J extensions for rendering (GFX)

6925 AHG on Organization of a Workshop on Future Directions in Video Compression

7046 AHG on Spatial Audio Coding

7048 AHG on Symbolic Music Representation

6922 AHG on Video Coding Tools Repository

6917 AHG on Video IDCT Specification

7

12 Resolutions of this meetingThese were approved (N8970)

13 A.O.B There was no other business

14 Closing The meeting closed at 2005/01/22T21:05.

8

Annex 1Attendance list

Given Name/Last Name Company/OrganizationCharith Abhayaratne Queen Mary University of LondonNicola Adami University of BresciaJeong-Hwan Ahn Samsung AITAkio Ishikawa KDDI R&D Labs.Alexdndre Contarmanac'h France TelecomJose Roberto Alvarez Mobilygen CorporationMyriam Elisa Amielh CisraIsabella Amonou France Telecom R&DArild Fvldseth TandbergKohtaro Asai Mitsubishi Electric CorporationOlivier Avaro StreamezzoMarc Baillavoine France Telecom R&DYukihiro Bandoh NTT/Cyber Space Lab.Chris Barlas Riehtscom LimitedGero Bäse SiemensOliver Baum Franuhofer IISSeongllak Beak Media device lab.Jeroen Bekaert Ghent University- Los Alamos National LaboratoryUlrich Benzler Robert Bosch GmbHGisle Bjontegaard TandbergBruce Block Recording Industry Association of AmericaMiroslaw Bober Mitsubishi Electric ITE-VILJohannes Boehm ThomsonArnaud Bourge PhilipsMikael Bourges-Sevenier Mindego Inc.Ian Burnett University of WollongongByeongho Choi KETI/Digital Media Research CenterGary James Calder Oxford Semiconductor Ltd.Mark Callow HI CorporationJong Jin Chae Netntv Inc.Eun-Young Chang ETRICharles Scott Foshee ADOBEPeisong Chen Qualcomm IncorporatedSherman (Xuemin) Chen Broadcom CorporationLeonardo Chiariglione CEDEOYongju Cho ETRIWoong Il Choi Sungkyunkwan UniversityYong Soo Choi Kangwon National UniversityKok Seng Chong Panasonic Singapore LaboratioriesHa Joong Chung Korea Electronics Technology Institute/Digital Media

Research CenterLindsay Chung Hong Kong Cyberport Management Company LimitedLeszek Cieplinski Mitsubishi Electric ITE-VILCyril Concolato ENST

9

Gregory William Cook ThomsonGiovanni Cordara Telecom Italia LabSamuel Cruz-Lara Loria/Inria LorraineDaniele Giusto University of CagliariDavid Hench Air Force Ressearch LaboratoryDavid Taubman The University of NSWStephen Davis University of WollongongPhilippe de Cuetos ENSTFrederik De Keukelaere Ghent UniversitySaar De Zutter Ghent UniversityThomas DeMartini Content Guard, Inc.Sylvain Devillers France Telecom R&DThomas di Giacomo University of GenevaKlaus Diepold TUM-LDVMarek Domanski Poznan University of Technol.Gerrard Drury UOW/enikosJean-Claude Duford StreamezzoEunmi Oh Samsung AITUlrich Fecker University of Erlangen-NurembergBernhard Feiten T-Systems International GmbhMatthew Fellers Doby LaboratoriesFeng Wu Microsoft Research AsiaFons (W.H.A.) Bruls Philips ResearchEdward Francois Thomson R& DPer Fröjdh EricssonHarald Fuchs Franuhofer IISToshiaki Fujii Nagoya UniversityGandee Bradford Content GuardRalf Geiger Fraunhofer IISJean H.A.Gelissen Philip ResearchPatrick Gioia France Telecom R&DPetar Goulev Imperial CollegeKate Grant Nine TilesBernhard Grill Fraunhofer IISMarc Guez Vucher SCPPHaiwu Zhao SVA GroupKi-Hun Han Sejong UniversityMahnjin Han Samsung AITHsueh-Ming Hang National Chiao Tung UniversityMunsi A Haque Intel CorporationNoboru Harada NTT Advanced TechnologyHelge Drumm Technische Universitat Ilmenau Hendry Information and Communications University (ICU)Ik Beom Heo Ministry of Commerce, Industry & EngeryJuergen Heinrich Herre Fraunhofer IISMin-Cheol Hong Soongsil UniversityScott Houchin Eastman Kodak Company

10

Haibin Huang Institute for Info Comm Research I2RZhongYang Huang Panasonic Singapore Laboratories Pte Ltd (PSL)Hyun Mun Kim Samsung AITIk Hwan Cho INHA UniversitySatoshi Ito Toshiba CorporationTakashi Itoh Fujitsu Laboratories Ltd.James D. Johnston Microsoft CorpJan Bormans IMECJan Van der Meer Philips ElectronicsJan Lievens VUB - IBBTJani Olave Lainema NokiaOhm Jens-Rainer Rwth Aachen UniversityByeong-Moon Jeon LG ElectronicsKyong hee Jeon LG ElectronisSe Yoon Jeong ETRIPaul Jessop IFPIKebin Jia Beijing University of TechnologyJill Boyce ThomsonJizheng Xu Microsoft Research AsiaJoeri Barbarien VUB - IBBTYe Sun Joung ETRIItaru Kaneko Tokyo Polytechnic UniversityIsao Karube Hitachi, Ltd.Naoya Katoh Sony Corp. / IMNC.DICKimihiko Kazui Fujitsu Laboratories Ltd.Keoin Jia Neijing University of TechnologyDaehee Kim ETRIDong Soo Kim LG ElectronicsHae-Kwang Kim Sejong UniversityHyoung Joong Kim Kangwon National UniversityJong-Lak Kim NextreamingJong-Tae Kim KAISTKiseob Kim Kangwon National UniversityKyu Heon Kim ETRIRin-Chul Kim University of SeoulSang-Kyun Kim Samsung Advanced Institute of TechnologyWoo-Shik Kim Samsung AITYoungseop Kim Dankook UniversityHideaki Kimata NTT Advanced TechnologyTakahiro Kimoto NEC CorporationMustafa Serkan Kiranyaz Tampere University of Technology/Institute of Signal ProcMasaki Kitahara NTTKristofer Kjorling Coding Technologies ABMarc Klein Middelink PHIIPSTakyuyo Kogure U-Tokyo, JapanStefan Kraegeloh FRAUNHOFER IISThomas Kummer-Hardt AIO (Argos International Organization)

11

Kyunghee Ji Seoul Information Technology UniversityMohamed-Chaker Larabi SIC Laboratory-University of PoitiersMinh Tuan Le Sejong UniversityFabrice Anthony Piene-yves Le Leannec

Canon Research France

Chak Joo Lee Panasonic Singapore Laboratories Pte LtdGwo Giun Lee National Cheng Kung UniversityJeayoung Lee Samsung Electronics Co., Ltd.Kyohyuk Lee Samsung Electronics Co., Ltd.Men Huang Lee Panasonic Singapore Laboratories Pte Ltd (PSL)Yungi-Gi Lee Sejong UniversityYung-Lyul Lee Sejong UniversityShawmin Lei Sharp Labs of AmericaMun Kew Leong Institute for Infocomm Research Vladimir Levantovsky Monotype ImagingZhengguo Li Institute for Infocomm Research Chung-Jr Lian NTU/ITRITilman Liebchen Technical University of BerlinZvi Lifshitz Optibase Ltd.Chong Soon Lim Panasonic Singapore Laboratories Pte Ltd.Joo-Hwee Lim Institute for Infocomm ResearchKengpang Lim Institute for Infocomm Research Xiao Lin Institute for Infocomm ResearchYanbo Long Huawei Technologies Co., Ltd.Rodolfo Lopez Pintor TelefonicaHan Ging Lu Institute of Automatic, Chinese Academy of SciencesAjay Luthra MotorolaEtienne Lyard University of GenevaMarc Gauvin sDAEMarius Preda Institute National des TelecommunicationsDetlev Marpe Fraunhofer Institute HHIBart Masschelein IMECMayumi Koike U-TokyoThomas L. McMahon Del ReyAlan Melby Brigham Young UniversityMike Ksar Microsoft/USNBMohammed Zubair Visharam Sony ElectronicsFrancisco Moràn Burgos Universidad Politècnica de MadridTakehiro Moriya NTTMyoung Ho Lee Kwandong UniversityMyoung-Hwan Choi Korean Agency for Technology and Standards (KATS)Jeho Nam ETRISam Narasimhan MortorolaMike Nilsson BTTakashi Nishi OKI Electric Industry Co., Ltd,Toshiyuki Nomura NECTakeshi Norimatsu Matsushita Electric Industrial Co., Ltd.

12

Francois-Xavier Nuttall CISACRobert O'Callaghan Mitsubishi Electric ITE -VI-LabTobias Oelbaum Munich University of TechnologyYukiko Ogura IPSJ/ITSCJChinPhek Ong Panasonic Singapore Laboratories Pte Ltd.Nermin Osmanovic University of MiamiJoern Ostermann University HannoverHee-Suk Pang LG ElectronicsPankaj Topiwala Fast VDOJi-Ho Park LG Electronics Inc.Keun Soo Park KBS (Korean Broadcasting System)Seung-Wook Park LG ElectronicsSoo Jun Park ETRISunghee Park Pixtree Technologies, IncStephane Pateux FRANCE TELECOM DIVISON R&DWen-Hsiao Peng National Chiao-Tung UniversityPengzhou Zhang communication University of ChinaFernando Pereira ISTFlorian Pestoni MICROSFOTAmon Peter Siemens AGPeter Schirling IBM ResearchPierrick Philippe France TelecomRobert Prandolini DSTOHeiko Pwhhagen Coding Technologies ABQiang Wang Institute of computing Technology Chinese Academy of

ScienceQingming Huang Chinese Academy of SciencesSchuyler Quackenbush Audio Reserch LabsSusanto Raharadjia Institute for Infocomm Research (I2R)Jean-Bernard Rault France TelecomPatrick Rault FastVDOJulien Reichel VisiowaveRichard Cam PMC-SierraRichard Dong Feng SVA GroupJustin Ridge NokiaEva Rodriguez Universitat Pompeu Fabra (UPF)Niels Rump RIGHTSCOM LIMITEDPhoom Sagetong Qualcomm IncorporatedSatoru Sakazume Victor Company of Japan, LimitedIoan Alexandra Salomie Vrije Universiteit BrusselSang Wook Kim SamsungJuergen Schmidt ThomsonAndreas Schneider Coding Technologies GmbHHeiko Schwarz Fraunhofer Institute HHIJeongil Seo ETRISeong Won Ryu ETRIClaude Seyrat Expway

13

Shengmei Shen Panasonic Singapore LabsShiJun Sun Sharp Labs of AmericaYoshihide Shimpuku SONY CorporationDavid Singer Apple ComputerSiwee Ma Institute of computing Technology Chinese Academy of

ScienceAljoscha Smolic Fraunmofer HHISehoon Son Pixtree Technologies, IncJi Qiang Song Hong Kong Applied Science & Technology Research

Institute. Co., Ltd.Youngjoo Song ETRIKarl Ralph Sperechnelder Fraunhofer IISYoshinori Sugihara Japan Electronics & Information Industries AssociationGary J. Sullivan Microsoft CorpHuifang Sun Mitsubishi Electronic Research LabsHyang Sun Korean Agency for Technology & Standards MOCIELifeng Sun Dept of Computer Science & Technology, Tsinghua

UniversityQibin Sun Institute for Infocomm ResearchWoo-Cheol Sung Sejong UniversitySungwook Jung Korean Standards Association/ Korean Industrial Standards

InstituteTeruhiko Suzuki Sony Corp.Viswanathan Swaminathan Sun Mirosystems Inc., USASeishe Takamura NTT CorporationTakeshi Chujoh Toshiba CorporationAnisse Taleb Ericsson ABThiow Keng Tan NTT DoCoMo, Inc.Masayuki Tanimoto Nagoya UniversityTe Li Omstotite fpr Omfpcp,,pm ResearchChristophe Tellier ENSTTerumasa Aoki University of TokyoAndrew Tescher MicrosoftTruong Cong Thang Information amd Communications Univ. (ICU)Herbert Thoma Franuhofer IISThomas Wiegand Fraunhofer HHIJoseph Thomas-Kerr University of WollongongTian Tian Sun Institute of computing Technology Chinese Academy of

ScienceTie Jun Huang Chinese Academy of SciencesTi-hao Chiang NCTLChristian Timmerer Klagenfurt UniversityTouradj Ebrahmim EPFLChun-Jen Tsai Dept. fo CSIE, National Chiao Tung UniversityYi-Shin Tung National Taiwan UniversityTakafumi Ueno MATSUSHITA ELECTRIC INDUSTRIAL CO., LTDStephane Valente Philips Digital Systems Labs-ParisVasieios Mezaris Informatics and Telematics Institute/Centre for Research and

14

Technology HellasAnthony Vetro Mitsubishi ElectricFrederic Vexo INJ 130- Station 14Jècòme Vieron Thomson R&DWade Wan Broadcom CorporationJing Wang Huawei Technologies Co., Ltd.Xin Wang Content Guard, Inc.Thomas Wedi PanasonicWen Gao Institute of computing Technology Chinese Academy of

ScienceWeon Geun Oh ETRIWhoi-Yul Yura Kim Hanyang UniversityMathias Wien Aachen UniversityWilson Chung XilinxWo Chang NISTIngo Wolf T-Systems International GmbhYongdong Wu Institute for Infocomm ResearchXianglin Huang Communication University of ChinaLianhuan Xiong Huawei Technologies Co., Ltd.Akio Yamada NECYoshihisa Yamada Mitsubishi Electric CorporationYan Huo ASTRISeungji Yang Information amd Communications Univ. (ICU)Shiqian Yang Dept of Computer Science & Technology, Tsinghua

UniversityYanhua Zhang Beijing University of TechnologyWei Yao Institute for Infocomm ResearchYiliang Bao NokiaPeng Yin Thomson Inc.Yo Sung Ho GISTDoe Hyun Yoon LG Electronics / DM Research Lab.Kyoungro Yoon Konkuk UniversityHaoping Yu Corporate Research INH725Lu Yu Zhejiang UniversityRongshan Yu Institute for Infocomm Research Shuian Yu Huawei Technologies Co., Ltd.Yui-Lam Chan The Hong Kong Polytechnic UniversityYun He Tsinghua UniversityJiefu Zhai Thomson R&D BeijingYunhua Zhang Beijing University of TechnologyLi Zhao Dept of Computer Science & Technology, Tsinghua

UniversityZhibo Chen ThomsonMinhua Zhou Texas InstrumentsFrancesco Ziliani VisiowaveGiorgio Zoia EPFL - ITS

15

Annex 2Agenda

      Agenda item 1.     Opening 2.     Roll call of participants 3.     Approval of agenda 4.     Allocation of contributions 5.     Communications from Convenor 6.     Report of previous meeting 7.     Processing of NB Position Papers 8.     Work plan   8.1   Media coding     1.1. New levels for Simple Profile     1.2. New levels for Simple Profile Conformance     1.3. AVC Fidelity Range Extensions Conformance     1.4. Scalable Video Coding     1.5. Audio Lossless Coding     1.6. Audio Scalable Lossless Coding     1.7. 1-bit Audio Lossless Coding     1.8. Spatial Audio Coding     1.9. AFX Extensions     1.10. Streaming Text Format     1.11 Video Coding Tool Repository     1.12 3D AV Coding     1.13 Generic inverse DCT specification     1.14 Open Font Format     1.15 Scalable audio and speech coding     1.16. Wavelet Video Coding   8.2   Composition coding     2.1. XMT extensions     2.2. Lightweight Scene Representation     2.3. Symbolic Music Representation   8.3   Description coding     3.1. Video Descriptor Extensions     3.2. Audio Descriptor Extensions   8.4   Systems support     4.1 Text Profile Descriptors     4.2. Timestamps and Audio Codec Behavior   8.5   IPMP     5.1. MPEG-21 IPMP Components     5.2. Evaluation Tools for Persistent Association

16

  8.6   Digital Item     6.1. Digital Item Declaration     6.2. Digital Item Binarisation     6.3. DIA Conversions and Permission Extensions     6.4. Event Reporting     6.5. Fragment Identification for MPEG Media Types     6.6 MPEG-21 Conformance   8.7   Transport and File Format     7.1. AVC File Format extensions for FRExt     7.2. MPEG-21 File Format     7.3 Serialisation of Digital Items  8.8   Multimedia architecture     8.1. MPEG-J extension for scene control     8.2. MPEG-J extension for rendering     8.3. Digital Item Processing     8.4. MPEG Multimedia Middleware   8.9   Reference implementation     9.1. AVC Fidelity Range Extensions Reference Software     9.2. Reference Hardware Description – phase I MPEG-4 Visual     9.3. Reference Hardware Description – phase II MPEG-4 AVC     9.4. MPEG-21 Reference Software   8.10   Application formats     10.1. Application Format Framework     10.2. Music player Application Format     10.3 Photo Album Application Format     10.4 MPEG-21 Content Format   8.11   Maintenance     11.1 Systems coding standards     11.2 Video coding standards     11.3 Audio coding standards     11.4 Visual description coding standards     11.5 Audio description coding standards     11.6 MDS standards 9.     Liaison matters 10.     Organisation of this meeting   10.1   Tasks for subgroups   10.2   Joint meetings 11.     Administrative matters   11.1   Schedule of future MPEG meetings   11.2   Promotional activities 12.     Planning of future activities 13.     Resolutions of this meeting

17

14.     A.O.B 15.     Closing

18

Annex 3List of input documents

No. Authors Title

11473 Wo Chang Document Register for SC29/WG11 Meeting Hong Kong

11474 G. SullivanA. Luthra AHG on Video IDCT Specification

11475T. ChiangYi-Shin TungChung-Neng Wang

AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance

11476

A. YamadaL. CieplinskiSang-Kyun KimStephan Herrmann

AHG on Maintenance of MPEG-7 Visual related Documents and Reference Software

11477 Miroslaw BoberSang-Kyun Kim AHG on Description Tools for MPEG-7 New Visual Extensions

11478Justin RidgeMihaela van der SchaarUlrich Benzler

AHG on Core Experiments in Scalable Video Coding

11479Justin RidgeMathias WienHeiko Schwarz

AHG on Scalable Video Model and SVM Software

11480 Aljoscha Smolic AHG on 3DAV Coding

11481 Euee S. JangKohtaro Asai AHG on Video Coding Tools Repository

11482 Mihaela van der Schaar AHG on further Exploration in Wavelet Video Coding

11483 Touradj EbrahimiJorn Ostermann

AHG on Organization of a Workshop on Future Directions in Video Compression

11484 P. Schirling AHG on the Communicating MPEG Activities to the business Community

11485Marius PredaMahnjin HanPatrick Gioia

AHG on AFX documents, CEs, and software

11486Mike Bourges-SevenierVishy SwaminathanItaru Kaneko

AHG on MPEG-J extensions for rendering

11487 Robert TurneyMarco Mattavelli

AHG on MPEG-4 Part 9 Reference Hardware Description Phase 1 and 2

11488 Gerrard DruryFrederik De Keukaleare AHG on MPEG-21 DIP & DID 2nd Edition

11489 FX Nuttall Andrew Tokmakoff AHG on MPEG-21 Event Reporting

11490 Christian TimmererThomas DeMartini AHG on MPEG-21 DIA

11491Myriam AmielhGerrard DruryYongJu Cho

AHG on MPEG 21 URI Fragment IDs

19

11492Ralph Sperschneideron behalf of the AHG on Audio Standards Maintenance

AHG on Audio Standards Maintenance

11493 M. Gruhne AHG on MPEG-7 Audio

11494 S. Quackenbush AHG on Spatial Audio Coding

11495 Tilman Liebchen AHG on MPEG-4 Lossless Audio Coding

11496 Paolo NesiGiorgio Zoia AHG on Symbolic Music Representation

11497 Jim Johnston AHG On Exploration of Scalable Audio and Speech Coding

11498 Wo ChangAkio Yamada AHG on JPEG Liaison

11499 DiepoldWo Chang AHG on MAF Development

11500 Niels RumpHae-Kwang Kim AhG on Persistent Association

11501 Mike KsarVladimir Levantovsky AHG on Font Format Representation

11502 Chris Barlas Bruce Block AHG on MPEG-21 Vision Update Report

11503 Ian Burnett AHG on Digital Item Transport and Storage

11504 Claude SeyratAndreas Hutter AHG on XML Structure Binarization and Streaming

11505Jean-Claude DufourdAlexandre Cotarmanac.hYoung-Kwon Lim

AHG on Scene Representation

11506 David SingerVisharam Mohammed AHG on MPEG File Formats

11507 SC 29 Secretariat Liaison Statement from SC 29/WG 1 [SC 29 N 6387]

11508 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 13818-1:2000/FDAM 5 [SC 29 N 6368]

11509

J. RidgeY. BaoM. KarczewiczX. Wang

Cyclical block coding for FGS

11510 Jeroen Bekaerton behalf of the BNB BNB comments on ISO/IEC 21000-2 FCD 2nd edition

11511 Zhengguo LI New Coding Modes for Scalable Video Coding

11512 Melanie Dulong de Rosnay MPEG-21 IPMP requirements for movie and music delivery

11513 Melanie Dulong de Rosnay Use cases examples for movie and music delivery

11514 Kate Grant Overview of some EU research projects which involve MPEG-21 technology

11515Jeroen BekaertRik Van de WalleHerbert Van de Sompel

Using MPEG-21 technology in the Digital Archiving and Preservation domain

11516 SC 24 via SC 29 Secretariat ISO/IEC 19775-1/PDAM 1

20

11517 SC 24 via SC 29 Secretariat ISO/IEC CD 19775-3

11518 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 15938-1:2002/FDAM 1

11519 3GPP via SC 29 Secretariat Liaison Statement from 3GPP TSG SA WG4

11520 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-3:2001/PDAM 4

11521 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-3:2001/PDAM 5

11522 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 21000-2 [2nd Edition]

11523 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-3:2001/FPDAM 6

11524 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 21000-9

11525 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-5:2001/PDAM 8

11526 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-11/FPDAM 4

11527 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:2004/PDAM 9

11528 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 21000-8

11529 SC 29 Secretariat Summary of Voting on ISO/IEC CD 11172-6

11530 IEC TC 100 via SC 29 Secretariat IEC CDV 62298-4 [SC 29 N 6438]

11531 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-3:2002/Amd.1:2004/DCOR 1

11532 Chiariglione Use of MPEG-21 technologies in Digital Media Project specifications

11533 Jean-Claude Dufourd Reference Software for the LASeR/SAF FCD

11534Christian TimmererHermann Hellwagneron behalf of the Austrian NB

Austrian NB comments on 21000-2 FCD 2nd Edition

11535Ihab AmerWael BadawyGraham Jullien

An Updated SystemC model for 2x2 Hadamard Transform and Quantization with Application to MPEG–4 Part 10 (with Conformance Test)

11536Ihab AmerWael BadawyGraham Jullien

An Updated SystemC model for 4x4 Hadamard Transform and Quantization with application to MPEG-4 Part 10 (with Conformance Test)

11537Ihab AmerWael BadawyGraham Jullien

An Updated SystemC Model for the MPEG-4 Part 10 4x4 DCT-Like Transformation and Quantization with Conformance Test

11538 ITU-T SG 16 via SC 29 Secretariat Liaison Statement from ITU-T SG 16 [SC 29 N 6418]

11539 TVA via SC 29 Secretariat Liaison Statement from TVA [SC 29 N 6420]

11540 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-12:2004/FDAM 1 [SC 29 N 6414]

11541Christian TimmererHermann Hellwagneron behalf of the Austrian NB

Austrian NB comments on 21000-7 PDAM/1

11542David Crombie Roger LenoirNeil McKenzie

Proposed Technology for accessible SMR decoders

11543 IEC TC 100 via SC 29 Secretariat Liaison Statement from IEC TC 100 [SC 29 N 6429]

11544 Zhengguo Li Customer Oriented Low Delay Scalable Video Coding

11545 JTC 1 Secretariat via SC 29 Summary of Voting on ISO/IEC DTR 21000-12

21

Secretariat

11546 Ulrich FeckerAndre Kaup

Statistical Analysis of Temporal and Spatial Block Matching for Multi-View Sequences

11547

Ik-Hwan ChoA-Young ChoJong-Tae KimWeon-Geun OhHae-Kwang KimDong-Seok Jeong

Investigation of The Usefulness of a Criteria for the Selection of Test Stimuli

11548 OMA via SC 29 Secretariat Liaison Statement from OMA [SC 29 N 6442]

11549 Christian TimmererHermann Hellwagner Preliminary comments on 21000-4 CD

11550 Christian TimmererHermann Hellwagner Preliminary comments on 21000-15 CD

11551

Thomas Di Giacomo Etienne LyardNadia Magnenat-ThalmannMarius PredaFrancoise Preteux

CE Report for Physically-Based Animation Part 1: Survey of Physics Models and Applications

11552

Etienne LyardThomas Di GiacomoNadia Magnenat-ThalmannMarius PredaFrancoise Preteux

CE Report for Physically-Based Animation Part 3: PhysicsShapeProperty

11553

Thomas Di GiacomoEtienne LyardNadia Magnenat-ThalmannMarius PredaFrancoise Preteux

CE Report for Physically-Based Animation Part 4: PhysicsBoneProperty

11554 Maurizio Campanai;Pierfrancesco Bellini; WEDELMUSIC as SMR proposal

11555 TIRAMISU consortiumEd: Zvi Lifshitz A scenario for Digital Item MAF usage in DRM context

11556Marc GauvinEva RodriguezJaime Delgado

RDD versus 21000-1 (2nd edition) terms and definitions

11557 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 15938-5:2003/FDAM 2 [SC 29 N 6446]

11558 Schuyler Quackenbush Proposed conformance working draft for MPEG-1/2 Audio in MPEG-4

11559 Schuyler Quackenbush Proposed reference software working draft for MPEG-1/2 Audio in MPEG-4

11560 G. Bertoni Proposal for Braille Music Symbolic Representation

11561 Andy Tescher for the USNB USNB Contribution: Audio lossless coding

11562 Andy Tescher for the USNB USNB Contribution: Scalable Audio

11563 Gwang Hoon ParkMin Woo ParkSeyoon JeongJihun Cha

Adaptive GOP Structure for SVC

22

Kyuheon KimJinwoo Hong

11564 Jean-Claude Dufourd Proposal to add remote streams to SAF

11565 Jean-Claude Dufourd LASeR/SAF software with SVGT1.1 compatibility

11566 Jean-Claude Dufourd Report of the CE on LASeR Harmonization with SVG

11567 Jean-Claude Dufourd Report of the CE on LASeR Binarization

11568Gaëlle Martin-CocherJean-Claude DufourdOlivier Avaro

Report on LASeR evangelization

11569 Wo Chang (On behalf for Tampere U. of Technology) JPSearch Proposals from Tampere University of Technology

11570 Hideaki KimataMasaki Kitahara

Multi-view video coding using shared reference picture memory and shared motion vector memory (Response to Call for Evidence on MVC)

11571 Hideaki KimataMasaki Kitahara

Multi-view video coding based on scalable video coding for free-viewpoint video

11572 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 13818-4:2004/FDAM 1

11573Teruhiko SuzukiNaoya KatohYoshihide Shimpuku

Proposal to support new colour space in IEC TC100

11574 Yongdong WU On ISO/IEC 14496-13:2004

11575

Jiang ZhangLi ZhaoBin LiShiQiang Yang

A Flexible License Management Scheme for Digital Rights Management

11576 Ray Taylor WD 1.0 ISO/IEC 15938-1/Amd.2 compliant software

11577 none none

11578

Cheng XiaoyuLi FangSun LifengYang Shiqiang

Register for SC29/WG 11 Hong Kong

11579

Andrea Kofler-VogtJörg HeuerHarald KoschAndreas Hutter

CE Report on Fast Random Access (Siemens Index System)

11580Jaime DelgadoJose PradosEva Rodríguez

Interoperability between MPEG-21 REL and OMA DRM: A Profile?

11581

Jeroen BekaertHerbert Van de SompelNiels RumpChris BarlasRik Van de Walle

Typing Identifiers

11582Yo-Sung HoSeung-Uk YoonSung-Yeol Kim

A Framework for Multi-view Video Coding using Layered Depth Image

11583 Yoshihisa YamadaKazuo Sugimoto

Coding performances of intra-only MPEG coding and still picture coding

23

Kohtaro AsaiTokumichi Murakami

11584Ralph Sperschneideron behalf of the German National Body

GNB Comment on MPEG-4 lossless audio coding

11585Woo-Jin HanSang-Chang ChaHo-Jin Ha

Responses of SVC CE-3: Inter-layer prediction

11586 Wo Chang Joint Meeting Agenda between WG11 and WG1 on JPSearch Project

11587

HendryJeongyeon LimQonita ShahabMunchurl KimKeunsoo Park

A Generic Descriptor for Resource Protection with Extension to IPMP Info Schema

11588

Yung-Lyul LeeWoo-Chul SungYung-Ki LeeDae-Yeon KimJae-Ho Hur

Multi-view video coding using illumination change-adaptive motion estimation/motion compensation and 2D direct mode

11589 Takahiro Kimoto Verification of CE3 results for Samsung Technology in SVC

11590 Takuyo KogureHiroshi Yasuda Activity Report of DCCSDP&DCCSDC in Japan Part-3

11591 Noboru HaradaTakehiro Moriya

Proposal of CE for improved floating-point compression using Masked-LZ (Lempel-Ziv compression with masked bit comparison) in ALS (Audio Lossless Coding)

11592 Anisse TalebContribution to the CfI on Scalable Audio and Speech Coding: Additional Use Cases and Applications and the Corresponding Requirements

11593 Bernhard Feiten Use cases for scalable audio coding

11594

J.J. ChaeJeho NamKwanyong KimTae-hee KimJae-Gon KimJin-Woo Hong

Proposal of Additional MPEG-21 IPMP ToolDescription

11595Kyo-Hyuk LeeWoo-Jin HanSang-Chang Cha

Virtual base-layer motion for scalable video coding

11596

Kimihiko KazuiTakashi ItohKohji YamadaKiichi Matsuda

Response to Call for Evidence on Multi-View Video Coding

11597Whoi-Yul KimHyoung-Joon KimKyeongsoo Kim

Need for yet another face descriptor for video catalog

11598Whoi-Yul KimHyung-Joon KimKyeongsoo Kim

Query by sketch: query by modified example

11599 Whoi-Yul Kim A Proposal for Retrieving Moving Objects in Sequence

24

Gwang-Gook LeeMin-Seok Choi

11600 Choudhury A. Rahman A HW BLOCK FOR H.264/AVC QUARTER PEL FULL SEARCH VARIABLE BLOCK MOTION ESTIMATION

11601 Tillman Weyde Hartmut Ring Proposal for Symbolic Music Representation Format

11602Gerrard DruryIan BurnettRik Van de Walle

Editor's Input on ISO/IEC FCD 21000-2

11603 Akio YamadaSang Kyun Kim MPEG-7 Visual XM 22.1

11604 Akio YamadaSang Kyun Kim WD 3.0 of MPEG-7 New Visual Extensions

11605 Akio Yamada Cross-check results of VCE-5

11606 Akio YamadaEiji Kasutani A Web-based photo library management system

11607 Zhang Hu, Sun Lifeng, Yang Shiqiang,Chen

Object based Rate Allocation Results for EE3 on evaluation of MAC for stereoscopic video coding

11608 Singapore NB SgNB Comment on MPEG-4 Audio Scalable Lossless Coding Work Item

11609Itaru Kaneko (Tokyo Polytechnic University)Mark Callow (HI Corporation)

HI Corp's comment on the ISO/IEC 14496-21 CD (MPEG-J extension for rendering)

11610

Itaru Kaneko (Tokyo Polytechnic University)Nobuyuki Kinoshita(mmg)Spencer Cheng (Morphbius Technologies)

Further study on Application Specific Binary Coding (ASBC) of MPEG-21 descriptors

11611 Joseph Thomas-Kerr Ian Burnett

Bitstream Binding Language – a grammar for Digital Item Transport

11612 Stephen DavisIan Burnett Proposed extra components for 15938-1 amd/2 and/or 21000-16

11613 S. Jang Efficient texture coordinates compression for 3D mesh in MPEG-4

11614Mayumi KoikeTakuyo KogureNoboru Sonehara

MPEG-2 IPMP - Implementation Report and Issues of Feasibility

11615Qonita ShahabHendryMunchurl Kim

Analysis of MPEG-4 LASeR Reference Software

11616

MenHuang LeeChinPhek OngShengMei ShenYoshimasa Honda

Proposal for SVC CE1 - Low Delay

11617 Daiyong, Kim The future of 3D mesh compression in MPEG-4

11618 Euee S. JangDaiyong KimMija Kim

Efficient texture coordinates compression for 3D mesh in MPEG-4

25

Sunyoung Lee

11619Minh Tuan LeHae-Kwang KimCong Du Nguyen

Proposal for 3D building representation

11620

Euee S. JangSunyoung LeeJongwoo WonYong Ho ChoDaiyong KimYung-Lyul Lee

First SW Implementation based on Textual Description Ver 1.0

11621

YeSun JoungJihun ChaWon-Sik CheongKyuheon KimYoung-kwon Lim

Results of the LASeR Binary Representation CE

11622

Euee S. JangSunyoung LeeJongwoo WonYong Ho ChoDaiyong KimYung-Lyul Lee

Proposed Update of Textual Description

11623

Euee S. JangDaiyong KimSunyoung LeeEunyoung ChangChunghyun Ahn

Technical Issues in 3D mesh compression

11624 Yongju ChoRakadian Transmission order of bitstreams of H.264 based scalable coding

11625

Byeong-Moon JeonDoe Hyun YoonSeung-Wook ParkJi-Ho Park

Inter-layer prediction of temporally enhanced pictures

11626

Mahnjin HanTae-Joon Parkon behalf of Mobile 3D Standardization Forum in Korea

Proposal for Mobile 3D Compression Profile

11627Hyoung-Joong KimYong-Soo ChoiYong-Ju Cho

SMR On the Korean Symbolic Music Representation

11628Seyoon Tak Jeong-Hwan Ahn James D. K. Kim

Survey and proposal on existing physics model

11629 Hyoung-Joong Choi Yong-Soo Cho Yong-Ju SMR On the Korean Symbolic Music Representation

11630Hyoung-Joong KimYong-Soo ChoiYong-Ju Cho

SMR On the Korean Symbolic Music Representation

11631 Ray Taylor Proposed Corrections to 15938-1 Amd/2 WD 1.0

11632Rongshan YuXiao LinSusanto Rahardja

Proposed bit-stream syntax revision for MPEG-4 SLS

26

11633

Rongshan YuRalf GeigerSusanto RahardjaXiao Lin

Updates on Status of Performance and Complexity of Lossless Audio Coding Architectures

11634

Haibin HuangDong-Yan HuangRongshan YuXiao LinSusanto Rahardja

Additional Information on Lossless Audio Coding

11635 Robert O'CallaghanMiroslaw Bober Update of Results in Situation/View-Based Clustering (VCE-1)

11636 Robert O'CallaghanMiroslaw Bober Preliminary Results on Image Categorization (VCE-2)

11637

Sunghee ParkSang-Wook KimY.B. Thomas KimMiyoung Kim

Proposed Corrigenda for MPEG-4 BSAC

11638

Sylvain DevillersAlexandre Cotarmanac'hMichael RansburgChristian TimmererHermann Hellwagner

Metadata streaming use case and requirements

11639 Kyunghee JiYoungjoo Song

Editor's Comments on MPEG-21 Event Reporting Committee Draft

11640 Sylvain Devillers Alexandre Cotarmanac'h Draft definitions for an MPEG-21 Systems Processing Model

11641Soo-Jun ParkMin-Sung RyuChee Sun Won

CE Report for Photo Retrieval based on Region-of-Interest(ROI), VCE-5

11642 Sylvain Devillers Alexandre Cotarmanac'h Proposed modifications for gBS Schema

11643Soo-Jun ParkMin-Sung RyuChee Sun Won

Query and GT set proposed for Photo Retrieval based on Region-of-Interest(ROI), VCE-5

11644 Sylvain Devillers Alexandre Cotarmanac'h ISO Base Media File format addressing scheme

11645Soo-Jun ParkMin-Sung RyuChee Sun Won

Dataset for Photo Retrieval based on Region-of-Interest(ROI), VCE-5

11646

Sang-Kyun KimSeungji YangYong Man RoJi-Yeun Kim

CE Report for Situation/View based Photo Clustering Experiment (VCE-1)

11647

Soo-Jun ParkSeon Hee ParkSung Min KimChee Sun Won

Image Descriptions for Bio-image retrieval

11648 Sang-Kyun KimSeungji YangYong Man Ro

GT set updated for situation/view based photo clustering experiment (VCE-1)

27

Ji-Yeun Kim

11649 Soo-Jun Park CE Report for Situation/View-based Photo Clustering Experiment (VCE-1, Cross Check)

11650

Sang-Kyun KimSeungji YangYong Man RoJiyeun Kim

CE Report for Category based Photo Clustering Experiment (VCE-2)

11651 Soo-Jun Park Dataset for VCE-1 and VCE-2

11652

Sang-Kyun KimSeungji YangYong Man RoJi-Yeun Kim

GT set and model set updated for category based photo clustering experiment (VCE-2)

11653

Sang-Kyun KimSeungji YangYong Man RoJi-Yeun Kim

CE Report for Person Identity-based Photo Clustering Experiment (VCE-3)

11654Kristofer KjörlingWerner OomenJuergen Herre

Status report on Spatial audio coding RM0 development

11655

Sang-Kyun KimSeungji YangYong Man RoJi-Yeun Kim

GT set updated for Person Identity-based Photo Clustering Experiment (VCE-3)

11656 Sang-Kyun Kim Cross-check for Photo Retrieval based on Region-of-Interest(ROI) (VCE-5)

11657

Ralph Sperschneideron behalf of Philips FhG Samsung Coding Technologies NEC France Telecom I2R

Performance and functionality of existing MPEG-4 technology in the context of CfI on Scalable Speech and Audio Coding

11658 Tilman Liebchen Proposed Text of ISO/IEC 14496-3:2001/FPDAM 4, Audio Lossless Coding (ALS), new audio profiles and BSAC extensions

11659 Patrick RungeTilman Liebchen Report on MPEG-4 ALS Core Experiment 9 (ACFC)

11660 Tilman Liebchen Proposed Core Experiment on Block Switching for MPEG-4 ALS

11661 Alexander GroeschelAndreas Schneider Proposed Clarification of StreamMuxConfig definition

11662 Alexander GroeschelAndreas Schneider

Proposed clarification of usage of ProgramConfigElement in AudioSpecificConfig

11663 Andreas Schneider Status report of Parametric Stereo Conformance

11664Gang BaiXiaoyan SunFeng Wu

The proposed extension of the ISO Base Media File Format for supporting SVC content

11665 Karol WnukowiczWladyslaw Skarbek

Comparison of Dominant Color Temperatures descriptor and Dominant Color descriptor

11666 Karol WnukowiczWladyslaw Skarbek

New algorithm for extraction of Dominant Color Temperatures not referring to dominant colors

11667 Woong Il ChoiInchoon Choi

The efficient coding technique using inter-layer prediction

28

Byeungwoo Jeon

11668

E.FrançoisG.Marquant N.Burdin J.ViéronI.AmonouS.Pateux

Requirement for Extended Spatial Scalability for SVC

11669

E. FrançoisG.Marquant N.Burdin J.Viéron

Extended spatial scalability

11670

Cyril ConcolatoPhilippe de CuetosMariam KimiaeiBenoit Pellan

Improvement of DIA Amd1: ConversionLink

11671Philippe de CuetosJean-Claude Dufourd (ENST)Cyril Concolato

Using BIFS Updates for real-time visual enhancements in the MELISA Sports Broadcasting System

11672 Zhiping HuMihaela van der Schaar Cross check of Thomson proposal for SVC CE4

11673

J. ViéronG. BoissonE. FrancoisG. PauB. Pesquet-Popescu

Proposal for SVC CE1 : Time and Level adaptive MCTF architectures for low delay video coding

11674 Frederik De KeukelaereRik Van de Walle Contribution to DIP reference software

11675

Philippe de Cuetos on behalf ofManos Papaioannou (Intracom)Kostas KarpouzisGiorgos AndreouNikolaos IoannidisKostas Pardalis

Possible usages of MPEG-21 to improve the MELISA Sports Broadcasting System

11676 Frans de BontWerner Oomen Study on Working draft for SSC conformance

11677

Jeroen BekaertFrederik De KeukelaereSaar De ZutterRik Van de Walle

Preliminary comments on ISO/IEC FCD 21000-10

11678

J. ViéronE. FrancoisG. PauB. Pesquet-Popescu

Cross Verification of Panasonic Proposal for SVC CE1

11679

Liu Yongliang Liu shaohuiYao HongxunHuang TiejunGao Wen

some suggestions about IPMP

11680 Ruiqin XiongJizheng XuFeng Wu

Studies on Spatial Scalable Frameworks for Motion Aligned 3D Wavelet Video Coding

29

Dongdong Zhang

11681

Dongdong ZhangJizheng XuHongkai XiongFeng Wu

Improvement for In-band Video Coding with Spatial Scalability

11682Peng YinJill BoycePurvin Pandit

Technical description of the Thomson proposal for SVC CE4

11683

J. ViéronE. FrancoisI. AmonouS. Pateux

Broadband Video Distribution Requirements for Scalable Video Coding

11684

Vasileios MezarisHaralambos Doulaverakis Ioannis Kompatsiaris Michael G. Strintzis

On the use of MPEG-7 XM-based SCHEMA Reference System for segmentation algorithm evaluation

11685 Krzysztof KucharskiWladyslaw Skarbek

Cross Verification of Update of Results in Situation/View-Based Clustering (VCE-1)

11686 Krzysztof KucharskiWladyslaw Skarbek

Cross Verification of Preliminary Results on Image Categorization (VCE-2)

11687

J. ViéronE. FrancoisI. AmonouS. Pateux

Wireless Video Home Network Requirements for Scalable Video Coding

11688 J. ViéronE. Francois Professional Video Requirements for Scalable Video Coding

11689 Juergen SchmidtOliver Baum Corrigendum to W6591 (AudioBIFS V3)

11690Juergen SchmidtOliver BaumKlaus Eilts-Grimm

Proposed WD 0.2 of AudioBIFS v.3 Conformance

11691 Gaëlle Martin-CocherJean-Claude Dufourd Contribution on the Binary format for LASeR

11692 Gaëlle Martin-CocherJean-Claude Dufourd Update of LASeR requirements

11693 Chris Barlas Godfrey Rust RDD editors' response to M11556

11694David Crombie Roger Lenoir Neil McKenzie

Accessible Information Processing within MPEG(Updated)

11695 Zvi Lifshitz Requirements for Digital Item MAF

11696 Leszek Cieplinski Cross-verification of Comparison of Dominant Color Temperatures descriptor and Dominant Color descriptor

11697 Leszek Cieplinski Cross verification of new algorithm for extraction of Dominant Color Temperatures

11698 Truong Cong ThangYong Ju JungYong Man RoJeho Nam

Modeling Modality Conversion for QoS Management

30

Jae-Gon KimJin-Woo Hong

11699

Aljoscha SmolicKarsten MuellerMatthias KautznerThomas Wiegand

Results on Core Experiment E1, Mesh Compression Framework

11700 Jens-Rainer Ohm Responses received to CfE on Multi-view Video Coding

11701 Patrick GioiaJérôme Royan

Result for the CE on Multiresolution Footprint-based Representations - IM1 implementation

11702 Patrick Gioia Multiresolution Geometry demonstration on the AFX website

11703

Isabelle Amonou Nathalie Cammas Sylvain Kervadec Stephane Pateux

Coding rate coverage extension with dead substreams in the SVM

11704

Isabelle Amonou Nathalie Cammas Sylvain Kervadec Stephane Pateux

Layered quality optimization for SVM

11705 Mikael Bourges-Sevenier Considerations and updates to GFX APIs

11706

Christian TimmererJörg HeuerAndreas HutterGabriel Panis

CE Report on Bit-stream Adaptation in Constrained and Streaming Environments

11707Julien ReichelDiego Santa CruzFrancesco Ziliani

Contribution to SVC: Laplacian Pyramid with Update

11708Thomas RathgenPeter AmonAndreas Hutter

Requirements and Proposal for an ISO/MP4 File Format for Storage of Scalable Video

11709 Cyril Concolato Tentative annotated SVG Tiny 1.2/LASeR

11710 Marius PredaFrançoise Preteux Editorial issues for AFX COR1

11711 Marius PredaFrancoise Preteux

VertexImage: Encoding Animated Geometry as Rectangular Video

11712 Heiko PurnhagenWerner Oomen

Proposed Study on 14496-3:2001/AMD 2:2004/DCOR 1 (SSC+PS)

11713 Markus BeermannMathias Wien

Application of the Bilateral Filter for Quality-Adaptive Reconstruction

11714 Heiko Purnhagen Considerations on amendments for MPEG-2/4 audio reference software

11715Eddie CookeAljoscha SmolicNoel O'Connor

Results on Exploration Experiment: Multi-View Synthesis Reconstruction using DIBR Nodes

11716Eddie CookeNoel O'ConnorAljoscha Smolic

Proposal for Specification of 3D Camera Parameters

11717 AmonouGirault

Requirement for Medium Grain Scalability in a mobile environment

31

Pateux

11718 Stefan KraegelohHarald Fuchs

DRM Amendment for MPEG-A Part-2 (Music Player Application Format)

11719

Nicola AdamiMichele BrescianiniRiccaAlberto

Report of UNIBS SVC CE3 Inter-layer prediction: STool scheme on HHI software

11720 Ralf GeigerJürgen Herre Approximation Accuracy of IntMDCT

11721 Ralf Geiger Proposed Stereo IntMDCT Signaling in SLS

11722

Alexandru SalomieAneta MarkovaRudi DeklerckAdrian MunteanuPeter Schelkens

Encoding of Dynamic Meshes with MeshGrid (Part 1)

11723 Matthias Gruhne Proposed descriptor for Enhanced Audio Identification

11724 Matthias Gruhne Proposed Core Experiments on MPEG-7 Deskriptors

11725

Alexandru SalomieDan CerneaAdrian MunteanuPeter Schelkens

MeshGrid implementation into AFX encoder: Donation to ISO

11726 Andreas HutterJoerg Heuer CE Report on MPEG-7 BiM

11727 Andreas HutterJoerg Heuer Evaluation of MPEG-7 BiM for Compound Documents

11728Konstantin HankeThomas RusertMathias Wien

Comment on Adaptation of Quantizer Settings in the SVM

11729

Mario GutierrezFrederic VexoKhaled Mamou Marius Preda Francoise Preteux

3D CGI Films Coding

11730Andreas HutterJoerg HeuerBernhard Reiterer

CE Report on LaSeR

11731 George Chen Response to Call for Evidence on Multi-View Video Coding

11732 Christophe TillierBeatrice Pesquet-Popescu CBR 3-band MCTF

11733 Lukasz Blaszak Verification of the CE results of Nokia in SVC

11734 Lukasz BlaszakMarek Domanski Results of CE5 in scalable video coding

11735 Lukasz Blaszak Implementation of SNR scalability using spiral scan

11736 Pesquet-Popescu Requirements on scalable video coding for mobile video streaming

11737 Charles FenimoreStefan Leigh Statistical Design of Multimedia Subjective Quality Tests

32

11738 Gregoire Pau Beatrice Pesquet-Popescu

Optimized Prediction of Uncovered Areas in Wavelet Video Coding

11739 Gregoire Pau Beatrice Pesquet-Popescu

Four-Band Linear-Phase Orthogonal Spatial Filter Bank in Wavelet Video Coding

11740 Heiko Schwarz Proposed SVM 3.0 Software Update

11741Gregoire Pau Jerome VieronBeatrice Pesquet-Popescu

Wavelet Video Coding with Flexible 5/3 MCTF Structures for Low End-to-end Delay

11742 Klaus LeopoldChristian Timmerer CE Report on Conversions

11743 Gregoire Pau Claude Seyrat Results of the Core Experiment on Laser Binarization

11744 Christian TimmererRobbie De Sutter CE report on MPEG-21 Binarization

11745Cedric Thienot Gregoire Pau Claude Seyrat

MPEG-21 binarisation status with MPEG-7 BiM reference software

11746Mayumi KoikeTakuyo KogureNoboru Sonehara

MPEG-21 IPMP Requirement from DCCSDP&DCCSDC in Japan

11747Takehiro MoriyaNoboru HaradaYutaka Kamamoto

Proposal of CE on Long Term Prediction for ALS (Audio Lossless Coding)

11748 G.C.K. AbhayaratneEbroul Izquierdo

Wavelets based residual frame coding in t+2D wavelet video coding

11749 G.C.K. AbhayaratneEbroul Izquierdo

Spatially adaptive low pass filter approach for imroving wavelets based spatial resolution scalability

11750

Marta MrakNikola SprljanG.C.K. AbhayaratneEbroul Izquierdo

Scalable motion vectors vs unlimited precision based motion compensation at the decoder in t+2D wavelet video coding

11751

BaoWangKarczewiczRidge

A Low-Complexity AVC-based Scalable Video Codec

11752 S.R. Quackenbush Cross-Check of Proposed ALS Core Experiment

11753

Eunmi OhJung-Hoe KimKiHyun ChooChangYong Son

The functionality of FGS in audio scalable lossless coding (SLS)

11754 Justin Ridge Verification of CE5 results for Poznan Univ. Technology

11755 Mohammed ZubairDave Singer Comment on the WD1.0 of 14496-15, Support for FRExt

11756 Justin Ridge Proposed requirement modifications for SVC

11757 Woo-Jin HanKyohyuk Lee Comments on wavelet-based scalable video coding technology

11758 Ostermann Touradj Ebrahimi AHG Report Future Video Coding

33

11759 Seyrat study of ISO/IEC 21000-16 FCD

11760Thomas SulzerBenjamin DornElion Chin

Proposed New Descriptors For Perceptual Music Attributes

11761 ISMA via SC 29 Secretariat Liaison Statement from ISMA [SC 29 N 6453]

11762 Masayuki TanimotoToshiaki Fujii Response to Call for Evidence on Multi-View Video Coding

11763Ralph Sperschneider on behalf of the German National Body

Renewed GNB Comment on the proposed new Software Copyright Licensing Disclaimer for MPEG Standards

34

Annex 4List of output documents

No. Source Title

6869 Convener List of Documents from the Hong Kong, China Meeting6870 Convener Resolutions of the Hong Kong, China6871 Convener List of AHGs Established at the 72nd Meeting in Hong Kong, China6872 Convener Report of the 71st Meeting in Hong Kong, China6873 Convener Guidelines for Electronic Distribution of MPEG and WG 11 Documents6874 Convener Press Release of the 71st Meeting in Hong Kong, China6875 Convener Meeting Notice of the 72nd Meeting in Busan, Korea6876 HoD Guide for WG 11 Meeting Hosts6877 HoD MPEG 1016878 Convener AHG on MAFs6879 Convener AHG on DI Streaming Requirements6880 Requirements Scalable Video Coding Applications and Requirements6881 Requirements MPEG-7 Requirements6882 Requirements MPEG-21 Requirements6883 Requirements DI Streaming Requirements6884 Requirements MAF Application Scenarios and Requirements6885 Convener AHG on Font Format6886 Convener AHG on Color Spaces6887 Requirements Request for Subdivision ISO/IEC 15938-11 MPEG-7 Profile Schemas6888 Requirements Final Text of ISO/IEC 15938-11 MPEG-7 Profile Schemas6889 Video Disposition of Comments on ISO/IEC 11172-6 CD6890 Video Study Text of ISO/IEC 11172-6 CD: Specification for Implementation of Inverse

Discrete Cosine Transform6891 Video Study Text of ISO/IEC 14496-4:2004 DCOR1 Visual Bitstreams Conformance

Corrigendum6892 Video Study Text of ISO/IEC 14496-4:2004/Amd.1 DCOR1 Visual Bitstreams

Conformance Corrigendum6893 Video Table of erroneous or missing bitstreams in MPEG-4 Visual Conformance6894 Video Disposition of comments on ISO/IEC 14496-4:2004/PDAM9 AVC Fidelity

Range Extensions Conformance6895 Video Text of ISO/IEC 14496-4:2004/FPDAM9 AVC Fidelity Range Extensions

Conformance6896 Video Disposition of comments on ISO/IEC 14496-5:2001/PDAM8 AVC Fidelity

Range Extensions Reference Software

35

6897 Video Text of ISO/IEC 14496-5:2001/FPDAM8 AVC Fidelity Range Extensions Reference Software

6898 Video Description of Core Experiments for Scalable Video Coding (SVC)6899 Video Joint Scalable Video Model (JSVM) 1.0 Reference Encoding Algorithm

Description6900 Video JSVM 1.0 Software6901 Video Working Draft 1.0 of 14496-10:200x/AMD1 Scalable Video Coding6902 Video Study Text of ISO/IEC 15938-3:2002/Amd.1/DCOR16903 Video Text of ISO/IEC 15938-3:2002/PDAM26904 Video MPEG-7 Visual XM Document version 23.06905 Video Description of Core Experiments for MPEG-7 New Visual Extensions6906 Video MPEG-7 TR: List of Problems Reported version 1.06907 Video Request for new amendment to ISO/IEC TR 15938-86908 Video WD 1.0 of ISO/IEC TR 15938-8:2003/Amd.26909 Video Survey of Algorithms used for Multi-view Video Coding (MVC)6910 Video Draft Call for Proposals on Multi-View Video Coding6911 Video Study of Video Coding Tools Repository V3.06912 Video VCTR Textual Description V2.06913 Video VCTR Software V1.06914 Video Description of Exploration Experiments in Wavelet Video Coding6915 Video Draft Call for Proposals on Fixed-point 8x8 IDCT and DCT6916 Video Workshop on Future Directions in Video Compression – Call for Contributions6917 Convener AHG on Video IDCT Specification 6918 Convener AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software

and Conformance6919 Convener AHG on Maintenance of MPEG-7 Visual related Documents and Reference

Software6920 Convener AHG on Description Tools for MPEG-7 New Visual Extensions6921 Convener AHG on 3DAV Coding6922 Convener AHG on Video Coding Tools Repository6923 Convener AHG on Exploration in Wavelet Video Coding6924 Convener AHG on Image Player MAF6925 Convener AHG on Organization of a Workshop on Future Directions in Video Compression6926 MDS DoC of ISO/IEC 21000-2 FCD6927 MDS Text of ISO/IEC 21000-2 2nd Edition FDIS6928 MDS ISO/IEC 21000-3 PDAM/1 MPEG-21 DII6929 MDS Study of ISO/IEC 21000-4 CD IPMP Components

36

6930 MDS Preliminary DoC for ISO/IEC 21000-4 CD IPMP Components 6931 MDS MPEG-21 IPMP Components Reference Software Workplan6932 MDS Workplan for CE on Update Description of IPMPTools6933 MDS Workplan for CE on Fragment-level Protection Description6934 MDS ISO/IEC 21000-4 TuC 2.0 6935 MDS Text of ISO/IEC 21000-6 COR/16936 MDS DoC for ISO/IEC 21000-7 PDAM/16937 MDS ISO/IEC 21000-7 FPDAM/16938 MDS TuC for Potential 21000-7 MPEG-21 DIA Amendment(s)6939 MDS Workplan for CE on the use of Adaptation QoS for Conversions6940 MDS Study of ISO/IEC 21000-8 FCD6941 MDS Draft of DoC on ISO/IEC 21000-8 FCD6942 MDS Preliminary DoC for ISO/IEC 21000-10 FCD MPEG-21 DIP6943 MDS Study text of ISO/IEC 21000-10 FCD DIP6944 MDS MPEG-21 DIP Software Implementation Plan v.56945 MDS WD5.0 of ISO/IEC 21000-14 MPEG-21 Conformance6946 MDS Preliminary DoC for ISO/IEC 21000-15 CD MPEG-21 ER6947 MDS Study of ISO/IEC 21000-15 MPEG-21 ER6948 MDS ISO/IEC 21000-17 CD MPEG-21 FID6949 MDS Workplan for Core Experiment on Logical Model Descriptions6950 MDS Request for subdivision of ISO/IEC 21000 Part 18 MPEG-21 Schema Files6951 MDS Request to make ISO/IEC 21000-18 Publicly Available6952 Convener AHG on MPEG-21 DID and DIP6953 Convener AHG on MPEG-21 DIA6954 Requirements Request to Make MPEG-7 Profile Schemas Publicly Available6955 Requirements Request to Make MPEG-21 DID Publicly Available6956 ISG Status of HDL submissions and commitments for MPEG-4 Part-96957 Convener AHG on MPEG-4 Part 9: Reference Hardware Description Phase 1 and 2.

6958 Systems Study Text of ISO/IEC 14496-1:2004/FPDAM16959 Systems Text of ISO/IEC 14496-11:2003/FDAM46960 Systems Text of ISO/IEC 14496-11:20056961 Systems Text of ISO/IEC 14496-11:2005:DCOR16962 Systems Items for consideration for corrigendum on ISO/IEC 14496-136963 Systems Request for Amendment 1 of ISO/IEC 14496-156964 Systems Text of ISO/IEC 14496-15/FDAM1 Support for FREXT

37

6965 Systems Text of ISO/IEC 14496-17/FDIS Streaming Text Format6966 Systems Study Text of ISO/IEC 14496-20/FCD6967 Systems Core Experiment on Open Issues on the LASeR Specification6968 Systems WD3.0 of ISO/IEC 14496-20 Reference Software6969 Systems Presentation material on LASeR6970 Systems Request of ISO/IEC 15938-1/Amd.26971 Systems Text of ISO/IEC 15938-1/PDAM26972 Systems Core Experiments for Systems Extensions6973 Systems MPEG-7 Systems reference software workplan6974 Systems DoC on ISO/IEC 21000-9/FCD6975 Systems Text of ISO/IEC 21000-9/FDIS6976 Systems Study Text of ISO/IEC 21000-16/FCD6977 Systems Core Experiments on MPEG-21 Binary Format6978 Systems New Work Item Proposal on XML Binarization6979 Systems Text of ISO/IEC XXXX-1/CD 6980 Systems Report on Intentions to submit to M3W Call for Proposal6981 Systems Call for Proposal on MPEG Multimedia Middleware (M3W)6982 Convener Ad Hoc Group on XML Structure Binarization and Streaming

6983 Convener Ad Hoc Group on Scene Representation

6984 Convener Ad Hoc Group on MPEG File Formats

6985 SNHC DoC on ISO/IEC 14496-16/PDAM16986 SNHC Text of ISO/IEC 14496-16/FPDAM6987 SNHC Text of ISO/IEC 14496-16/COR16988 SNHC AFX Core Experiments Description6989 SNHC SNHC FAQ 13.06990 SNHC Study text of ISO/IEC 14496-21/CD6991 Convener AHG on AFX documents, CEs, and software6992 Convener AHG on MPEG-J extensions for rendering (GFX)6993 MDS Request for amendment 1 of ISO/IEC 21000-36994 Convener AHG on Communicating MPEG activities to the business community. 6995 Integration DoC on ISO/IEC 14496-4/PDAM9 AVC FRext Conformance6996 Integration Text of ISO/IEC 14496-4/FPDAM9 AVC FRext Conformance6997 DELETED DoC on ISO/IEC 14496-5/PDAM9 AVC FRext Reference Software 6998 DELETED Text of ISO/IEC 14496-5/FPDAM9 AVC FRext Reference Software6999 Testing Report of the Subjective Quality Evaluation for Multi View Coding CfE7000 Convenor Terms of Reference

38

7001 Convenor MPEG Standards7002 Convenor Table of unpublished standards at FDIS level7003 Convenor Work plan and time line7004 Convenor Work item assignment7005 Convenor List of patent statements received7006 Liaison Liaison Statement to ITU-R WP6A7007 Liaison Liaison Statement to ITU-T SG 167008 Liaison Liaison Statement to IEC TC 1007009 Liaison Liaison Statement to CCSDS Panel 27010 Liaison Liaison Statement to ISMA7011 Liaison Liaison Statement to WG 1 on JPSearch7012 Liaison Responses to National Body Comments7013 Liaison List of Organisations with which MPEG entertains liaisons 7014 Audio Proposed Fourth Edition of MPEG-2 AAC7015 Audio DoC on 14496-3:2001/PDAM 4, ALS7016 Audio Text of 14496-3:2001/FPDAM 4, ALS7017 Audio DoC on 14496-3:2001/PDAM 5, SLS7018 Audio Text of 14496-3:2001/FPDAM 5, SLS7019 Audio DoC on 14496-3:2001/FPDAM 6, Lossless coding of 1-bit oversampled signals7020 Audio Text of 14496-3:2001/FDAM 6, Lossless coding of 1-bit oversampled signals7021 Audio Study on 14496-3:2001/AMD 2:2004/DCOR 1:200x7022 Audio Proposed DCOR on MPEG-4 Audio7023 Audio Status of Performance and Complexity of MPEG Lossless Audio Coding

Architectures7024 Audio Application Scenarios for ALS and SLS7025 Audio Workplan for Audio Lossless Coding (ALS)7026 Audio Workplan for Scalable Lossless Coding (SLS)7027 Audio Proposed MPEG-4 Audio Third Edition7028 Audio Working Draft of High Quality Parametric Audio Conformance7029 Audio Request for Parametric Stereo Conformance Amendment7030 Audio Text of 14496-4:2004/PDAM 11, Parametric Stereo Conformance7031 Audio Working Draft of Conformance for MPEG-1/2 Audio in MPEG-47032 Audio Working Draft of Audio BIFS Version 3 Conformance7033 Audio Status of MPEG-4 Audio Conformance7034 Audio Working Draft of Reference Software for MPEG-1/2 Audio in MPEG-47035 Audio Request for Amendment on MPEG-7 Audio High-Level Description Extensions

39

7036 Audio Text of 15938-4:2002/PDAM 2, High-Level Description Extensions7037 Audio Workplan for MPEG-7 Audio7038 Audio Workplan for the Evaluation of Responses to the CfP on SMR7039 Audio Workplan for MPEG-4 Spatial Audio Coding7040 Audio Call for Information on Scalable Speech and Audio Coding7041 Audio MPEG Audio Codecs History and Tools7042 Audio Request for opinion on possible MPEG work on Protected Music based on

MPEG-A part 27043 Convener AHG on Audio Standards Maintenance7044 Convener AHG on Audio Coding Tool Repository7045 Convener AHG on MPEG-7 Audio7046 Convener AHG on Spatial Audio Coding7047 Convener AHG on MPEG-4 Lossless Audio Coding7048 Convener AHG on Symbolic Music Representation7049 Convener AHG On Exploration of Scalable Audio and Speech Coding7050 Convener AHG on JPEG Liaison

40

Annex 5Requirements report

Source: Fernando Pereira, IST; Rob Koenen, Intertrust Technologies

Report Requirements Group – 71th (Hong Kong) MPEG Meeting

Source: Fernando Pereira, IST; Rob Koenen, Intertrust Technologies

NB: this report does not duplicate the resolutions, but rather complements them. This implies that not all output documents and not all Ad Hoc Groups are explicitly listed in the report below.

Monday  9:00-13:00 Opening plenary meeting  13:00-14:00 Lunch (ends one hour after plenary ends)  

14:30-16:30

JPSearch (joint with Video)11498 AHG on JPEG Liaison – Wo Chang, Akio Yamada11586 Joint Meeting Agenda between WG11 and WG1 on JPSearch Project – Wo

Chang

2303

16:30-18:00

MPEG-21 Vision Update (joint with MDS)11502 AHG on MPEG-21 Vision Update Report – Chris Barlas , Bruce Block11514 Overview of some EU research projects which involve MPEG-21 technology –

Grant11515 Using MPEG-21 in the Digital Archiving and Preservation domain –Bekaert, et.al.11532 Use of MPEG-21 technologies in DMP specifications – Chiariglione11512 MPEG-21 IPMP requirements for movie and music delivery –Dulong de Rosnay11513 Use cases examples for movie and music delivery – Melanie Dulong de Rosnay

Reqs

18:00-20:00 HoDs Meeting

Tuesday

9:00-10:30

MPEG-A (joint with MDS)11499 AHG on MAF Development – Diepold, Wo Chang11555 A scenario for Digital Item MAF usage in DRM context – TIRAMISU, Ed: Zvi

Lifshitz11695 Requirements for Digital Item MAF – Zvi Lifshitz

MPEG-21 Profiles (joint with MDS)11580 Interoperability between MPEG-21 REL and OMA DRM: A Profile? –Delgado

et.al.

Reqs

12:00-12:30 Mobile 3D (Joint with SNHC)11626 Proposal for Mobile 3D Compression Profile – Mahnjin Han, Tae-Joon Park, on

behalf of Mobile 3D Standardization Forum in Korea

SNHC

13:00-14:00 Lunch

14:00-16:00

Miscellaneous MPEG-21 Requirements (joint with MDS, Systems)11581 Typing Identifiers – Jeroen Bekaert, et.al. 11611 Bitstream Binding Language – a grammar for D Transport –Thomas-Kerr ,

Burnett11638 Metadata streaming use case and requirements – Sylvain Devillers et.al.11746 MPEG-21 IPMP Req. from DCCSDP&DCCSDC, Japan – Mayumi Koike et.al. 11503 AHG on Digital Item Transport and Storage – Ian Burnett

Reqs

41

16:00-17:00

SVC Requirements (joint with Video)11668 Requirement for Extended Spatial Scalability for SVC – E.François, et.al.11688 Professional Video Requirements for Scalable Video Coding – J. Viéron, E.

Francois11717 Requirement for Medium Grain Scalability in a mobile environment – Amonou,

et.al.11736 Requirements on SVC for mobile video streaming – Pesquet-Popescu11756 Proposed requirement modifications for SVC – Justin Ridge11708 Requirements, Proposal for ISO/MP4 File Format for Storage of SVC –Rathgen

et.al.

Video

17:00-17:30 New Color spaces in MPEG standards (joint with Video, JVT)11573 Proposal to support new colour space in IEC TC100 – Teruhiko Suzuki, e.al. Video

17:30-18:00MPEG-21 PAT

11500 AhG on Persistent Association – Niels Rump, Hae-Kwang Kim11547 Investigation of Use of Criteria for Selection of Test Stimuli, Ik-Hwan Cho et.al.

Video

18:00 Liaison19:00 Chairs meeting

Wednesday  09:00-11:00 Plenary meeting

BOGs on MPEG-21 MAFs and DI Transport and Storage Requirements will be running in parallel during the day

(for room assignment check the relevant reflectors)13:00-14:00 Lunch

14:00-15:00

LASeR (joint with Systems)11692 Update of LASeR requirements – Gaëlle Martin-Cocher, Jean-Claude Dufourd

MPEG-4 Font Format Representation (joint with Systems)11501 AHG on Font Format Representation – Mike Ksar, Vladimir Levantovsky

Accessible Information Processing (joint with Systems)11694 Accessible Information Processing within MPEG - McKenzie, Crombie & Lenoir

Systems

15:30-16:30

MPEG-A (joint with Audio, MDS)11718 DRM Amendment for MPEG-A Part-2 (Music Player MAF) – Kraegeloh, Fuchs

Music Descriptors (joint with Audio, MDS)11760 Proposed New Descriptors For Perceptual Music Attributes - Sulzer, Dorn, Chin

Audio

Social event

Thursday09:00-10:00 3D Mobile Profile (Joint with SNHC & Systems) SNHC

10:00-11:00 Feedback from BOG on DI Transport and Storage Requirements (Joint with MDS & Systems)

Requirements

11:00-12:00Feedback from BOG on MPEG-21 MAFs (Joint with MDS)

11610 Further study on Application Specific Binary Coding (ASBC) of MPEG-21 descriptors - Itaru Kaneko, Nobuyuki Kinoshita, Spencer Cheng)

Requirements

12:00-13:00

RDD Requirements (Joint with MDS)11556 RDD versus 21000-1 (2nd edition) terms and definitions - Marc Gauvin, Eva

Rodríguez, Jaime Delgado11693 RDD Editors’ Response to M11556 - Chris Barlas and Godfrey Rust

Requirements

13:00-14:00 Lunch

14:00-16:00

Requirements Issues (Joint with Audio)11561 USNB Contribution: Audio lossless coding – Andy Tescher for the USNB11593 Use cases for scalable audio coding – Bernhard Feiten11658 Proposed Text of ISO/IEC 14496-3:2001/FPDAM 4,– Tilman Liebchen11592 Contribution to the CfI on Scalable Audio and Speech Coding: Additional Use

Cases and Applications and the Corresponding Requirements – Anisse Taleb

Audio

-17:00-18:00 Laser Requirements Systems

18:00 Chairs Meeting

Friday

9:00-9:30Concluding MPEG-4

Scalable Video Coding Applications and Requirements – UlrichAHG on Font Format Representation – Vladimir

Requirements

42

9:30-09:45

Concluding MPEG-7MPEG-7 Requirements Part 11 – Profile schemasRequest for MPEG-7 Part 11Resolution on Part 11

9:45-10:30

Concluding MPEG-21MPEG-21 RequirementsDI Streaming Requirements AHG on DI Streaming

Requirements

10:30-11:00Concluding MPEG-AMPEG-21 MAF Application Scenarios and RequirementsAHG on MAFs

Requirements

11:00-11:30ExplorationsLiaison letter TC100 AHG on Color Spaces Study

Requirements

-12:30-14:00 Lunch14:00-20:30 Plenary meeting

MPEG-4

Part 3: New Audio Profile?11626 Proposal for Mobile 3D Compression Profile – Mahnjin Han, Tae-Joon Park, on behalf of Mobile 3D

Standardization Forum in Korea

This contribution is a request for a Mobile 3D profile including SNHC tools related to 3D compression and also AFX tools. The document comprised an interesting industry proposal for usage of SNHC tools.To allow this to go forward, we MPEG would need to create:

- New profiling dimension, maybe called AFX- A new object type- A new profile- New levels- A solution for integration in the MPEG-4 architecture

Part 18 (?): Font Format Representation11501 AHG on Font Format Representation – Mike Ksar, Vladimir Levantovsky

The progress on this issue was minimal. The AHG was recreated with the same mandate as before.

Part 20 – LASeR11692 Update of LASeR requirements – Gaëlle Martin-Cocher, Jean-Claude Dufourd

The proposed update to the LASeR requirements was not in such a state that it could be discussed and approved in the group. While the author promised to improve the document that would allow such a discussion, such update did not materialize and no changes to the requirements were approved. Consequently, the group published no new version of the Laser Requirements doc either.

43

Scalable Video Coding11668 Requirement for Extended Spatial Scalability for SVC – E.François, G.Marquant , N.Burdin , J.Viéron, I.Amonou,

S.Pateux11688 Professional Video Requirements for Scalable Video Coding – J. Viéron, E. Francois11717 Requirement for Medium Grain Scalability in a mobile environment – Amonou, Girault, Pateux11736 Requirements on scalable video coding for mobile video streaming – Pesquet-Popescu11756 Proposed requirement modifications for SVC – Justin Ridge11708 Requirements and Proposal for an ISO/MP4 File Format for Storage of Scalable Video – Thomas Rathgen, Peter

Amon, Andreas Hutter

Contribution M11708 was been presented in the joint meeting; the other documents were summarized by the editor of the SVC Applications and Requirements after being discussed in break-out group. Having heard the presentations, the group moved on to update the list of SVC Applications, notably by including digital video surveillance and professional video manipulation to the list. Also , the group improved the existing SVC requirements. Some requirements were removed, as they were not currently supported and informed by application examples. Requirements on SVC file format and SVC transport were added. A new version of the SVC Applications and Requirements document was published at this meeting (N6880)

Other issues11694 Accessible Information Processing within MPEG - McKenzie, Crombie & Lenoir

There was nobody available to present the contribution.

MPEG-7

General & Requirements 11760 Proposed New Descriptors For Perceptual Music Attributes - Thomas Sulzer, Benjamin Dorn, Elion Chin

After presentation of this document and a discussion, the group approved a new requirement on perceptual descriptors, not specific for audio but across media. An audio-related technical proposal was on the table as well, but it needs to be seen how much of the requirements are already supported by existing tools.A new version of the MPEG-7 Requirements document was approved that includes this new requirement. (N6881)

JPsearch Liaison11498 AHG on JPEG Liaison – Wo Chang, Akio Yamada11586 Joint Meeting Agenda between WG11 and WG1 on JPSearch Project – Wo Chang

In joint meetings with WG1, MPEG presented and demonstrated MPEG-7 tools to JPEG. WG11 confirmed its availability to collaborate with JPEG to address JPSearch requirements, which was confirmed in a liaison statement to WG1 (N7012)

MPEG-21

General Requirements 11581 Typing Identifiers – Jeroen Bekaert, Herbert Van de Sompel, Niels Rump, Chris Barlas, Rik Van de Walle

After a discussion, it was decided to update the requirements on Digital Item Identification, and a new version of the MPEG-21 Requirements document was issued.

11610 Further study on Application Specific Binary Coding (ASBC) of MPEG-21 descriptors - Itaru Kaneko, Nobuyuki Kinoshita, Spencer Cheng)

44

This presentation was mostly for information purposes, and did not require any action on MPEG’s part. Further contributions will be made in the future. Development of this technology may lead to a proposal for new requirements.

Vision Update AHG; MPEG-21 Outreach11502 AHG on MPEG-21 Vision Update Report – Chris Barlas , Bruce Block11514 Overview of some EU research projects which involve MPEG-21 technology – Kate Grant11515 Using MPEG-21 technology in the Digital Archiving and Preservation domain – Jeroen Bekaert, Rik Van de

Walle, Herbert Van de Sompel11532 Use of MPEG-21 technologies in Digital Media Project specifications – Chiariglione11512 MPEG-21 IPMP requirements for movie and music delivery – Melanie Dulong de Rosnay11513 Use cases examples for movie and music delivery – Melanie Dulong de Rosnay

The results of the ‘Vision AHG’ were extensively debated. A number of conclusions were drawn as follows:

There is a need for easier access to MPEG-21 standards. The group decided to ask ISO to make DID specification publicly available (Resolution 6.2.5)

A separate part 18 (by MDS (Schema files) was created by MDS. There is a need for better documentation on the usage of MPEG-21 technologies, and for

updating the MPEG-21 description on the MPEG Web page. A request was issued for use cases that would explain MPEG-21 usage. A resolution was adopted asking for helpful input that may contribute to the creation of such MPEG documentation. (Resolution 6.1.2)

There was agreement that:o Current MPEG-21 tools make the core of MPEG-21

Coding tools are better placed in MPEG-4, or new MPEG standardso It is now important to work towards the deployment of what we have alreadyo Definition of adequate MAFs is considered the next major step

MPEG-21 Profiles11580 Interoperability between MPEG-21 REL and OMA DRM: A Profile? – Jaime Delgado, Jose Prados, Eva

Rodríguez

M11580 presented ongoing work targeting the possible definition of a MPEG-21 REL profile matching OMA DRM v.2 specification. The authors target easy conversion between two REL specifications. More results were announced, and it was mentioned that this could lead to a REL profile.

MPEG-21 RDD (part 6)11556 RDD versus 21000-1 (2nd edition) terms and definitions - Marc Gauvin, Eva Rodríguez, Jaime Delgado11693 RDD Editors’ Response to M11556 - Chris Barlas and Godfrey Rust

M11556 seems to argue that the RDD and REL specifications are very difficult to read for the people that did not participate in the specification process. The group agrees that it is important to have documentation explaining the usage of these standards for some relavant application cases. A resolution was adopted acknowledging this, and asking for relevant input documents. (This was Resolution 6.1.2, also see above)

MPEG-21 PAT11500 AhG on Persistent Association – Niels Rump, Hae-Kwang Kim

Considering the input to the Hong Kong meeting, and after some discussion, it was clear that, while the group had seen interesting contributions over the last few meetings, the support for this activity was not broad enough to guarantee a successful outcome, and to warrant starting a new edition of the Technical Report. This was captured in resolution 6.10.1.

45

MAF (MPEG-A)

General; Requirements 11718 DRM Amendment for MPEG-A Part-2 (Music Player Application Format) – Stefan Kraegeloh, Harald Fuchs

After a long discussion, no conclusion was reached in the joint Audio/Requirements meeting. The Audio group did approve a document containing an application scenario, but is was altered during the final plenary. The Audio group also adopted a resolution asking NBs and MPEG members, comments on this document.

Vision Update AHG11499 AHG on MAF Development – Diepold, Wo Chang11555 A scenario for Digital Item MAF usage in DRM context – TIRAMISU consortium, Ed: Zvi Lifshitz11695 Requirements for Digital Item MAF – Zvi Lifshitz

It was agreed that development of MAFs is crucial for the deployment of MPEG-21 technology. MAFs provide integrated MPEG solutions for certain application scenarios; they are normative to guarantee interoperability. MAFs do not include new technology but use tools from existing MPEG standards – any of them. It is important that industry get involved in this activity to define meaningful MAFs, and to and develop the required supporting software. A new version of the MAF Application Scenarios and Requirements was released. It also encompasses non-MPEG technology required for creation of successful MAFs

Explorations & Others

Color Spaces in MPEG Video Coding StandardsNew Color spaces in MPEG standards (joint with Video, JVT)

11573 Proposal to support new colour space in IEC TC100 – Teruhiko Suzuki, Naoya Katoh, Yoshihide Shimpuku

M11573 proposes an additional color space MPEG-2, MPEG-4 Visual, MPEG-4 AVC, and SVC. This concerns a color space that is defined in IEC TC100 (IEC 61966-2-4.) After a discussion, the group decided to create AHG on Color Spaces. (N6886)

Scalable Audio Coding11561 USNB Contribution: Audio lossless coding – Andy Tescher for the USNB11593 Use cases for scalable audio coding – Bernhard Feiten11658 Proposed Text of ISO/IEC 14496-3:2001/FPDAM 4, Audio Lossless Coding (ALS), new audio profiles and BSAC

extensions – Tilman Liebchen11592 Contribution to the CfI on Scalable Audio and Speech Coding: Additional Use Cases and Applications and the

Corresponding Requirements – Anisse Taleb

Requirements related to the Call for information were reviewed in a joint meeting with the Audio Group, but not finally approved in a Requirements Group meeting.

46

Annex 6Systems report

Source: Systems Chair and Break-out group ChairsTitle: Systems Meeting ReportStatus: DraftEditor: Olivier Avaro (Streamezzo)

Contributors: David Singer (Apple), Claude Seyrat (Expway), Jean-Claude Dufourd (Streamezzo),

OverviewThe main outputs of the meeting from the Systems Sub-group perspective are:

No. Title TBPX 14496-1 :2004/Amd.1 Text Profile Descriptor6958 Study Text of ISO/IEC 14496-1:2004/FPDAM1 NoX 14496-11 :200x/Amd.4 XMT and MPEG-J Extensions6959 Text of ISO/IEC 14496-11:200x/FDAM4 No6960 Text of ISO/IEC 14496-11:200x No6961 Text of ISO/IEC 14496-11:200x:DCOR3 NoX 14496-13 IPMP6962 Items for consideration for corrigendum on ISO/IEC 14496-13 NoX 14496-15 AVC File Format6963 Request for Amendment 1 of ISO/IEC 14496-15 No6964 Text of ISO/IEC 14496-15/PDAM1 Support for FREXT NoX 14496-17 Streaming Text Format6965 Text of ISO/IEC 14496-17/FCD Streaming Text Format NoX 14496-20 LASeR6966 Study Text of ISO/IEC 14496-20/FCD No6967 Core Experiment on Open Issues on the LASeR Specification No6968 WD3.0 of ISO/IEC 14496-20 Reference Software No6969 Presentation material on LASeR YesX 15938-1 Systems6970 Request of ISO/IEC 15938-1/Amd.2 No6971 Text of ISO/IEC 15938-1/PDAM2 No6972 Core Experiments for Systems Extensions No6973 MPEG-7 Systems reference software workplan NoX 21000-9 MPEG-21 File Format6974 DoC on ISO/IEC 21000-9/FCD No6975 Text of ISO/IEC 21000-9/FDIS NoX 21000-16 MPEG-21 Binary Format6976 Study Text of ISO/IEC 21000-16/FCD No6977 Core Experiments on MPEG-21 Binary Format NoX XXXX Binary MPEG format for XML MPEG-B6978 New Work Item Proposal on XML Binarization No6979 Text of ISO/IEC XXXX-1/CD NoX Exploration

47

6980 Report on Intentions to submit to M3W Call for Proposal No6981 Call for Proposal on MPEG Multimedia Middleware (M3W) Yes

General issues

GeneralThe meeting report from Redmond has been approved.

Discussion on the documentation of BiM across MPEG standards:- Option 1 : Separate MPEG Standard- Option 2 : Part of Generic Technology Standard with IDCT- Option 3 : Part of MPEG-21- Current : Part of MPEG-7 Systems

The decision is to:- Create a new standard under (ISO/IEC 23001-1)- Reference this standard from ISO/IEC 15938-1 (MPEG-7 Systems)- Reference this standard from ISO/IEC 21000-16 (MPEG-21 Binarization)- Rename Part 16 of MPEG-21 as MPEG-21 Systems;- Integrate specification on the transport of DI, TeM, … within that part.

M11574: On ISO/IEC 14496-13:2004. Items for consideration for corrigendum on ISO/IEC 14496-13. Noted. Output document produced gathering the items for broader exposure before action.

List of standards under development

Pr Pt Edit. Project Description CfP WD CD FCD FDIS4 1 2004 Amd.1 Text Profile Descriptors 04/07 04/10 05/044 11 200x Cor.3 AudioBIFS Corrections 05/01 05/044 12 2004 Cor.1 Correction on File-type Box 04/10 05/044 15 2004 Amd.1 Support for FREXT 04/10 05/01 05/07 06/014 17 2003 1st Ed. Streaming Text Format 03/03 03/07 03/12 05/074 20 2004 1st Ed. Lightweight Application

Scene04/03 04/07 04/10 05/04

7 1 2004 Amd.2 BiM Extension 04/10 05/01 05/07 06/0121 16 200x 1st Ed. Binary Format 04/03 04/07 04/10 05/04B 1 200x 1st Ed. Binary Format 05/01 05/04 05/07

Standing Documents

Pr Pt Documents No. Meeting4 13 MPEG IPMP Extensions Overview N6338 04/03 München4 20 Presentation Material on LASER N6969 05/01 Hong-

Kong21 xx MPEG Multimedia Middleware Context and

ObjectivesN6335 04/03 München

48

Mailing Lists Reminder

Topic Information Kindly Managed by

General Systems

List

Liste Reflector : gen-sys@lists.uni-klu.ac.atList-Subscribe:

http://lists.uni-klu.ac.at/mailman/listinfo/gen-sysmailto:gen-sys-request@lists.uni-klu.ac.at?subject=subscribe

List-Archive: http://lists.uni-klu.ac.at/pipermail/gen-sysList-Help: mailto:gen-sys-request@lists.uni-klu.ac.at?subject=help

University of Klagenfurt

BinXML

Liste Reflector : mpeg7-sys@lists.uni-klu.ac.atList-Subscribe:

http://lists.uni-klu.ac.at/mailman/listinfo/mpeg7-sysmailto:mpeg7-sys-request@lists.uni-klu.ac.at?subject=subscribe

List-Archive: http://lists.uni-klu.ac.at/pipermail/mpeg7-sysList-Help: mailto:mpeg7-sys-request@lists.uni-klu.ac.at?subject=help

University of Klagenfurt

File Format

Liste Reflector : mp4-sys@lists.uni-klu.ac.atList-Subscribe:

http://lists.uni-klu.ac.at/mailman/listinfo/mp4-sysmailto:mp4-sys-request@lists.uni-klu.ac.at?subject=subscribe

List-Archive: http://lists.uni-klu.ac.at/pipermail/mp4-sysList-Help: mailto:mp4-sys-request@lists.uni-klu.ac.at?subject=help

University of Klagenfurt

LASeR

Liste Reflector : mpeg-laser@lists.uni-klu.ac.atList-Subscribe:

http://lists.uni-klu.ac.at/mailman/listinfo/mpeg-lasermailto:mpeg-laser-request@lists.uni-klu.ac.at?subject=subscribe

List-Archive: http://lists.uni-klu.ac.at/pipermail/mpeg-laserList-Help: mailto:mpeg-laser-request@lists.uni-klu.ac.at?subject=help

University of Klagenfurt

DemonstrationsThe following demonstrations were made:

- M11671: Using BIFS Updates for real-time visual enhancements in the MELISA Sports Broadcasting System.

- Patrick Gioia (France Telecom) : 3D Scalable 3D content.- Mark Callow : OpenGL support on mobile phones.

FAQThe FAQ were updated as needed.

49

AOBNone.

MPEG-2 Systems (13818-1)

MPEG-2 Exploratory Activities

TopicsNone.

MPEG-4 Systems (14496-1)

14496-1:2003 Amd.1None.

Technical Work in Progress.

MPEG-4 Scene Description (14496-11)

14496-11:2003 Amd.4

Topics1. XMT Extensions;2. MPEG-J Extensions.

ContributionsNone.

Technical Work Completed.

14496-11:2005 Cor.1

Topics1. Items for Correction on AudioBIFS

ContributionsM11689: Corrigendum to W6591 (AudioBIFS V3). Various edits on the AudioBIFS extension specification. Editorial comments and example have been fixed in the 2005 edition. Technical comments are part of a draft corrigendum issued during the meeting.

Technical Work in Progress.

50

MPEG-4 AVC File Format (14496-15)

14496-15:2004 Amd.1

Topics1. Support for FREXT

Contributions

M11755: We accepted the suggestion from M11755 for equality in the chroma_format etc., and the editor was instructed to prepare the amendment

Joint with VideoM11664: Proposed extension of the ISO Base Media File Format for supporting SVC content. Proposed layer dependency model based on Direct Acyclic Graph. Investigates how this relates with the layer dependency already in place in AVC (absolute positioning + rules to assess dependencies).

M11708: Requirements and Proposal for an ISO/MP4 File Format for Storage of Scalable Video. Technical work will continue on the File Format AHG.

M11624: Withdrawn.

SVC file format targets to be WD at the next meeting as an amendment to part 15 (AVC file format).

Exploratory Activities

Joint with AudioM11718 : DRM MAF document was deferred to the audio discussion. Cf. Audio report.

Technical Work in Progress.

Streaming Text (14496-17) Topics

1. Coded Representation of Text Stream.

Contributions. Systems subgroup recommends reissuing FCD ballot on ISO/IEC 14496-17 since significant changes have been made since the last ballot. The systems subgroup recommends promoting this specification to FDIS under the condition that the ballot of ISO/IEC 14496-17/FCD passes without comments.

Technical Work in Progress.

51

Font Compression and Streaming (14496-18)

Exploratory Activities

Topics1. OpenType Standardization

ContributionsNone. The Systems subgroup recommends the work on this subject to be carried on within the AdHoc Group on Font Format.

Technical Work in Progress.

LASeR (14496-20) Topics

1. Lightweight Application Scene Representation

Contributions

M11568: Report on LASeR evangelization. Promotional materials will be made available as an output contribution from the MPEG meeting. More help needed for the Web site. Supporting companies and rights for phone pictures are requested.

M11567, M11691: Streamezzo work on CE on binarisation and contribution on Binary Format. Review reports on CE. ETRI Type Codec cross-checked, discussed and proposed for adoption. No objection.

Binary Encoding : BiM versus AHE (Ad-Hoc Encoding) :o Two solutions are proposed:

BiM; AHE.

o The two solutions are technically equivalent in terms of: Complexity; Coding performance; Footprint.

o BiM offers genericity (Any XML can be encoded if a schema is provided) and dynamic extensibility (Any encoding can be extended by providing additional schema). Both features, as agreed in Palma, are “nice-to-have” feature as opposed as “requested” feature for LASeR.

o The following options where discussed: Option 1:

Only AHE. No mentioning of BiM. Option 2:

BiM not normative AHE syntax normative Informative annex showing compatibility of the AHE syntax with a generic

BiM constrained by a schema + a specific configuration.This would allow:

Company willing to use the AHE syntax to just implement this syntax and ignore the BiM specification.

Company willing to use BiM features in their product to implement the LASeR syntax using the BiM specification.

Option 3: BiM Normative 1 LASeR Profile with Generic BiM with a Schema.

52

1 LASeR Profile with Generic BiM constrained by a certain schema + specific configuration.

Option 4: BiM Normative 1 LASeR Profile with Generic BiM with a Schema

Option 5 : Define code points in the stream indicating encoding Profile. Define 2 Profiles (or more)

o Profile 1 : Option 1

Supporting companies: Nokia, Ericsson, Streamezzo, ETRI, Apple, Monotype Imaging.

Option 2 Supporting companies : Expway, Siemens.

o Profile 2 : Option 4

Supporting companies : Expway, Siemens, Apple.DECISION:

Progress the standard with Option 5: Design the technology so that you can signal the profile of the binary encoding.

Documentation of the Study:o Documentation of Option 1o Documentation of Option 4

Option 2 may be documented as a subset of Option 4. Ask National Body to take the study into consideration when preparing their ballot comments. Request input contributions on profile definition for the next meeting.

M11621: ETRI Type codec. Presented. This is an evolution of the contribution to Palma. One change is to re-express the SDL for decoding rather than encoding. Cyril computed figures to validate the CE criteria: 5% improvement on 90% of test set. Which test set = files which contain point sequences. 5% means 71% coverage. 3% means 90%. Average of 5.9% on all test set with point sequences. Strictly, the CE criterion is not met, but the improvement is significant. ETRI proposes adoption, and there is no opposition, so the technology is adopted into LASeR. Related point: do we want to leave room for future type codecs ? Decision: add a switch in the header.

M11615: Contribution about the comparison of CD and FCD software, and the fact that the FCD may not allow “lightweight” J2ME implementations. Discussed. Hint that the current spec is not compatible with the requirement of implementability with Java MIDP. Further work will be done on the topic for the AHG.

M11743: Expway work on CE binarisation. Presentation of changes since last time:- “compiled” (schema-specific) decoder implementation on J2SE less than 3Kb additional (Expway

software, compliant with BiM);- decoder implementation on J2ME possible by replacing BiM float codec with LASeR float codec- software will be uploaded for cross-check;- does not address SAF nor LASeR Updates.

M11730: Siemens work on CE binarisation. Presented:- Decision to adopt vluimsbfX for length and id fields;- Improvment of regularity of Java classes: Siemens has two persons until end of February who may help.- Delay promotion and additional SoFCD. Cf. Discussion on roadmap.

M11564: External streams in SAF. Presented. The discussion validated the approach of the contribution. The stream reference in LASeR should be an opaque streamID and the connection of the streamID to a muxed stream or an external stream should indeed be in SAF, or in the layer used in its place. Accepted.

M11533: Reference software for FCD. Presented. Updated in M11565.

53

M11565: LASeR/SAF software with SVGT1.1 compatibility. Study Software after CE work. Need to fix the paragraph on remaining differences (font-style is fixed, but not colors or font-family). Presented. Will constitute the main part of the WD3.0 of LASeR and SAF software.

M11566: Report of the CE on LASeR Harmonization with SVG Review report on CE (M11566). Decision to adapt LASeR roadmap according to the delays in the SVGT 1.2 specification.

o LASER V1: Fully aligned with SVGT1.1 + Additional features stable in SMIL to support Audio and Video + Additional features from SVG1.1 requested by the industry (FDIS April 2005).

o LASER V2: Target full alignment with SVGT1.2 (Target FDIS October 2005, when SVGT1.2 will reach PR).

Study (SVGT1.1+AV) IS (SVG1.1+AV) AMD1 (SVGT1.2)a, animate,

animateColor, animateMotion,

animateTransform, audio, circle, defs, desc, ellipse, foreignObject,

g, image, line, metadata, mpath, path, polygon, polyline, rect, script, set, svg, switch, text, title, tspan, use,

video

a, animate, animateColor, animateMotion,

animateTransform, audio, circle, defs, desc, ellipse, foreignObject, g, image,

line, linearGradient, metadata, mpath, path,

polygon, polyline, radialGradient, rect, script, set, stop, svg, switch, text,

title, tspan, use, video

a, animate, animateColor, animateMotion, animateTransform,

audio, circle, defs, desc, ellipse, foreignObject, g, image, line,

linearGradient, metadata, mpath, path, polygon, polyline,

radialGradient, rect, script, set, stop, svg, switch, text, title, tspan, use, video, animation, handler,

page, pageSet, prefetch, solidColor, flowPara,

flowRegion, flowRoot, flowSpan

Excluded because of the use of OpenType: font, font-face, font-face-name, font-face-src, font-face-uri, glyph, hkern, missing-glyph.

Implement these decisions within Study of FCD in Hong-Kong (2 weeks editing period). Implement these decisions within reference software. CE completed as planned.

Discussion on LASeR ProfilingThe following areas have been identified as sources of performance bottleneck:

Rendering with transparency and antialiasing is slowing down the frame-rate; Dom tree and shadow tree, together with the increased number of attributes, increase the memory

footprint by a factor of 2: can we profile out the need for a shadow tree ?

Axes for profiling: interactivity, animation (whole or just shadow tree), time lines, embedding media, scripting, transparency, not(anti-aliasing), binarisation.

Axes of levelling: update rate, number of elements in the scene tree, pixel change rate, achievable frame rate, bit rate of LASeR stream.

Joint with RequirementsM11692: Update of LASeR requirements. Presented. Comments were made on organisaion of the document. Noted. Revision has been uploaded and will be discussed at the next MPEG meeting.

Technical Work in Progress.

54

MPEG-7 Systems (15938-1)

General

Contributions

11579 - CE Report on Fast Random Access (Siemens Index System)The core experiment shows that the proposed WD is the best solution in terms of data organization. Proposed improvements are welcome in future input contributions. The proposed indexing software for FPDAM is adopted as the reference software for indexing.

11726 - CE Report on MPEG-7 BiMThe contribution evaluates the differences between the version of BiM adopted by DVB and the reasons of these differences with the official MPEG-7 BiM. It appears that DVB slightly adapted the BiM specification in order to efficiently deal with a fixed fragmentation (significant gain in bitstream size and decoder filtering speed which is very important in a broadcast environment). A solution is proposed to satisfy DVB needs while keeping the generality and extensibility of BiM. Recommendation to adopt the solution for the amd2.

M11759 - Study of ISO/IEC 21000-16 FCDThe contribution is accepted and will serve as the basis of a new Study document.

M11727 - Evaluation of MPEG-7 BiM for Compound DocumentsFurther precise use case description and requirements and their relationship with fragment references will be studied on a Core Experiment.

M11612 - extra components for 15938-1 amd/2 and/or 21000-16The contribution showed a "protocol" level of pulling MPEG-21 DID fragments. While this activity is recognized as high value, the current schedule of the MPEG-21 Binary format specification is too tight. This contribution as others leads to the start of a new activity about DI transport and storage.

Technical Work in Progress.

MPEG-21 File Format (21000-9)

21000-9

Topics1. MPEG-21 File Format

Contributions

M11524: The MPEG-21 file format (21000-9) summary of voting in m11524.htm was reviewed. The only comments were from the USNB and they were accepted.

Technical Work Completed.

55

MPEG-21 Binary Format (21000-16)

21000-16

Topics1. Binarization of MPEG-21 Data

Contributions

M11744 - CE report on MPEG-21 BinarizationThis core experiments addressed DID, DII, RDD, DIA, DIP specifications. As a conclusion: no further requirements and technical solutions have been identified for MPEG-21 binarization at that stage. However the notion of "validity" (syntactically, semantically) should be reviewed in accordance to streaming of DID & REL.

The group decided: to continue the CE, focus on REL, IPMP & Event Reporting (reference bitstreams and

experts are needed), to evaluate updated reference software.

M11579 - CE Report on Fast Random Access (Siemens Index System)The core experiment shows that the proposed WD is the best solution in terms of data organization. Proposed improvements are welcome in future input contributions.The group decided:

to adopt the proposed indexing software for FPDAM. To welcome any improvement of the current solution in the future

M11745 - MPEG-21 binarisation status with MPEG-7 BiM reference softwareInformative contribution about the reference software improvements. Reference software has been upgraded to cope with all the MPEG-21 data available. Some few errors are remaining. An AHG mandates will states to continue to improve the ref soft.

M11576 - WD 1.0 ISO/IEC 15938-1/Amd.2 compliant softwareContribution describing the indexing reference software and examples. This document should be included in the cvs as a starter. The group decided to adopt the described software as the MPEG-7 indexing reference software.

M11631 - Proposed Corrections to 15938-1 Amd/2 WD 1.0The proposed changes have been accepted. The document will serve as the basis for the PDAM.

Technical Work in Progress.

Joint Meetings

MDSM11644, M11260: ISO Base Media File format addressing scheme. Will be considered to 21-000 Part 17.

M11260: Draft definitions for an MPEG-21 Systems Processing Model.

56

M11610: Further study on Application Specific Binary Coding (ASBC) of MPEG-21 descriptors. Cf; MDS report.

Requirements

M11638: Metadata streaming use case and requirements. Requirements have been refined and documented. Cf; Requirements report.

M11694: Accessible Information Processing within MPEG (Updated). No body was here to present the contribution. Noted.

Discussion on 3DMC Mobile Profile : cf. requirements report.

Multimedia Middleware

Topics1. Use cases;2. Middleware Architecture;3. Multimedia APIs.

Contributions

Three letters of intent where submit to MPEG and reviewed during the meeting covering the full set of M3W requirements.

The following companies showed intention to contribute to the activity: ACCESS Co., Ltd. CSEM Digital TV Industry Alliance of China Eindhoven University of Technology Hewlett-Packard Corporation IKERLAN, FAGOR, Nokia Royal Philips Electronics, SAIA - Burgess Electronics Technical University of Madrid, University of Florence Visual Tools, Samsung Electronics Co., Ltd.

The letters of intent will be made public in an output document. No modification on the Call for Proposal was request therefore the call will be issued as such.

Technical Work in Progress.

Other Activities

57

Latest References and Publication Status

Pr Pt Standard No. Issue Status Doc. with Purpose2 1 ISO/IEC 13818-1/Amd.7 Published 2000/122 1 ISO/IEC 13818-1:2000 (MPEG-2 Systems 2nd

Edition)00/12 Published 2000/12

2 1 ISO/IEC 13818-1:2000/COR1 (FlexMux Descr.) N3844 01/01 Pisa Published 2002/032 1 ISO/IEC 13818-1:2000/Amd.1 (Metadata on 2) + COR2 N5867 03/07

TrondheimPublished 2003/12

2 1 ISO/IEC 13818-1:2000/Amd.2 (Support for IPMP on 2) N5604 03/03 Pattaya Published 2004/032 1 ISO/IEC 13818-1:2000/Amd.3 (AVC Carriage on MPEG-2) N5771 03/07

TrondheimAMD ITTF to be published

2 1 ISO/IEC 13818-1:2000/Amd.4 (Metadata Application CP) N6847 04/10 Palma FDAM ITTF Prepare for FDAM2 1 ISO/IEC 13818-1:2000/Amd.5 (New Audio P&L Sig.) N6585 04/07

RedmondFDAM ITTF FDAM by 04/11/02

2 1 ISO/IEC 13818-1:2000/COR3 (Correction for Field Picture) N6845 04/10 Palma COR ITTF to be published2 11 ISO/IEC 13818-1:2003 (IPMP on 2) N5607 03/03 Pattaya Published 2003/124 1 ISO/IEC 14496-1 (MPEG-4 Systems 1st Ed.) Published 1999/124 1 ISO/IEC 14496-1/Amd.1 (MP4, MPEG-J) Published 2001/114 1 ISO/IEC 14496-1/Cor.1 Published 2001/114 1 ISO/IEC 14496-1:2001 (MPEG-4 Systems 2nd Ed.) Published 2001/114 1 ISO/IEC 14496-1:2001/Amd.1 (Flextime) Published 2002/104 1 ISO/IEC 14496-1:2001/Cor.1 01/07/20 COR ITTF4 1 ISO/IEC 14496-1:2001/Cor.2 02/10/26 COR ITTF4 1 ISO/IEC 14496-1:2001/Cor.3 N6587 04/07

RedmondCOR ITTF

4 1 ISO/IEC 14496-1:2001/Amd.2 (Textual Format) 02/03 AMD ITTF4 1 ISO/IEC 14496-1:2001/Amd.3 (IPMP Extensions) Published 2004-054 1 ISO/IEC 14496-1:2001/Amd.4 (SL Extension) Published 2003/12

58

4 1 ISO/IEC 14496-1:2001/Amd.7 (AVC on 4) N5976 03/10 Brisbanne

Published 2004-08

4 1 ISO/IEC 14496-1:2001/Amd.8 (ObjectType Code Points) N6202 03/12 Hawaii AMD ITTF to be published4 1 ISO/IEC 14496-1 (MPEG-4 Systems 3rd Ed.) N5277 02/10

ShanghaiIS ITTF to be published

4 6 ISO/IEC 14496-6:2000 Published 2000/124 8 ISO/IEC 14496-8 (MPEG-4 on IP Framework) N4712 02/03 Jeju Published 2004-054 11 ISO/IEC 14496-11/Cor.1 (Integrated in 3rd Edition) N6203 03/12 Hawaii COR SC294 11 ISO/IEC 14496-11 (MPEG-4 Scene

Description) N5279 02/10

ShanghaiFDIS SC29 Final Text Editing

4 11 ISO/IEC 14496-11/Amd.1 (AFX) N5480 02/10 Awaji FDAM Editor Integration in 1st Ed.4 11 ISO/IEC 14496-11/Amd.2 (Advanced Text and Graphics) N6205 03/12 Hawaii FDAM Editor Integration in 1st Ed.4 11 ISO/IEC 14496-11/Cor.3 Valuator/AFX related

correctionN6594 04/07

RedmondCOR Editor Integration in 1st Ed.

4 11 ISO/IEC 14496-11/Amd.3 Audio BIFS Extensions N6591 04/07 Redmond

FDAM Editor Integration in 1st Ed.

4 11 ISO/IEC 14496-11/Amd.4 XMT and MPEG-J Extensions

N6959 05/01 HongKong

FDAM Editor Integration in 1st Ed.

4 12 ISO/IEC 14496-12 (ISO Base Media File Format)

N5295 02/10 Shanghai

Published 2004-02

4 12 ISO/IEC 14496-12/Amd.1 ISO FF Extension N6596 04/07 Redmond

FDAM ITTF FDAM 04/11/30

4 13 ISO/IEC 14496-13 (IPMP-X) N5284 02/10 Shanghai

IS ITTF to be published

4 14 ISO/IEC 14496-14 (MP4 File Format) N5298 02/10 Shanghai

Published 2003-11

4 15 ISO/IEC 14496-15 (AVC File Format) N5780 03/07 Trondheim

Published 2004-04

4 18 ISO/IEC 14496-18 (Font Compression and Streaming)

N6215 03/12 Hawaii Published 2004-07

4 19 ISO/IEC 14496-19 (Synthesized Texture Stream)

N6217 03/12 Hawaii Published 2004-07

59

7 1 ISO/IEC 15938-1 (MPEG-7 Systems) N4285 01/07 Sydney Published 2002/077 1 ISO/IEC 15938-1/Amd.1 (MPEG-7 Systems Extensions) N6326 04/03 Munich FDAM ITTF FDAM 04/11/287 1 ISO/IEC 15938-1/Cor.1 (MPEG-7 Systems Corrigedum) N6328 04/03 Munich COR Editor7 2 ISO/IEC 15938-2 (MPEG-7 DDL) N4288 01/07 Sydney Published 2002/0221 9 ISO/IEC 21000-9 (MPEG-21 File Format) N6975 05/01

HongKongFDIS ITTF FDIS 05/01/21

60

Resolutions of SystemsCf. WG11 resolution.

List of reviewed contribution

N° Title Authors11519 Liaison Statement from 3GPP TSG SA WG4 3GPP via SC 29 Secretariat11524 Summary of Voting on ISO/IEC FCD 21000-9 SC 29 Secretariat11526 Summary of Voting on ISO/IEC 14496-11/FPDAM 4 SC 29 Secretariat11533 Reference Software for the LASeR/SAF FCD Jean-Claude Dufourd11548 Liaison Statement from OMA [SC 29 N 6442] OMA via SC 29 Secretariat11564 Proposal to add remote streams to SAF Jean-Claude Dufourd11565 LASeR/SAF software with SVGT1.1 compatibility Jean-Claude Dufourd11566 Report of the CE on LASeR Harmonization with SVG Jean-Claude Dufourd11567 Report of the CE on LASeR Binarization Jean-Claude Dufourd11568 Report on LASeR evangelization Gaëlle Martin-Cocher et al.11574 On ISO/IEC 14496-13:2004 Yongdong WU11574 On ISO/IEC 14496-13:2004 Yongdong WU11576 WD 1.0 ISO/IEC 15938-1/Amd.2 compliant software Ray Taylor11579 CE Report on Fast Random Access (Siemens Index System) Andrea Kofler-Vogt et al.11610 Further study on Application Specific Binary Coding (ASBC)

of MPEG-21 descriptorsItaru Kaneko et al.

11610 Further study on Application Specific Binary Coding (ASBC) of MPEG-21 descriptors

Itaru Kaneko et al.

11612 Proposed extra components for 15938-1 amd/2 and/or 21000-16

Stephen Davis et al.

11614 MPEG-2 IPMP Impletation report and Issues of feasability Mayu Mi Koike11615 Analysis of MPEG-4 LASeR Reference Software Qonita Shahab et al.11621 Results of the LASeR Binary Representation CE YeSun Joung et al.11631 Proposed Corrections to 15938-1 Amd/2 WD 1.0 Ray Taylor11638 Metadata streaming use case and requirements Sylvain Devillers et al.11640 Draft definitions for an MPEG-21 Systems Processing Model Sylvain Devillers et al.11640 Draft definitions for an MPEG-21 Systems Processing Model Sylvain Devillers et al.11644 ISO Base Media File format addressing scheme Sylvain Devillers et al.11664 The proposed extension of the ISO Base Media File Format

for supporting SVC contentGang Bai et al.

11671 Using BIFS Updates for real-time visual enhancements in the MELISA Sports Broadcasting System

Philippe de Cuetos et al.

11689 Corrigendum to W6591 (AudioBIFS V3) Juergen Schmidt et al.11690 Proposed WD 0.2 of AudioBIFS v.3 Conformance Juergen Schmidt et al.11691 Contribution on the Binary format for LASeR Gaëlle Martin-Cocher et al.11692 Update of LASeR requirements Gaëlle Martin-Cocher et al.11692 Update of LASeR requirements Gaëlle Martin-Cocher et al.11694 Accessible Information Processing within MPEG(Updated) David Crombie et al.11694 Accessible Information Processing within MPEG(Updated) David Crombie et al.11708 Requirements and Proposal for an ISO/MP4 File Format for

Storage of Scalable VideoThomas Rathgen et al.

11726 CE Report on MPEG-7 BiM Andreas Hutter et al.11727 Evaluation of MPEG-7 BiM for Compound Documents Andreas Hutter et al.11730 CE Report on LaSeR Andreas Hutter et al.11743 Results of the Core Experiment on Laser Binarization Gregoire Pau et al.

61

11744 CE report on MPEG-21 Binarization Christian Timmerer et al.11745 MPEG-21 binarisation status with MPEG-7 BiM reference

softwareCedric Thienot et al.

11755 Comment on the WD1.0 of 14496-15, Support for FRExt Mohammed Zubair et al.11759 study of ISO/IEC 21000-16 FCD Seyrat

62

Annex 7MDS report

Source: Ian S Burnett, PhD, Chair MDS Subgroup

The MDS subgroup commenced with the following summary, kick-off:

Overview of MDS Activities

MPEG-21 Timeline

WDPDAM

Study of PDAM

FPDAM

Study of

FPDAM

FDAM

Current

Status

Std

Pt

Edit.

Project

Description

CfP WD CD Study of CD

FCD Study of FCD

FDIS

21 2 2002

1st Ed.

Digital Item Declaration

        01/12   02/05 FDIS

21 2 200x

2nd Ed.

Digital Item Declaration

  03/10

04/03

  04/07   05/01

FCD ---> FDIS

21 3 2002

1st Ed.

Digital Item Identification

  01/07

01/12

  02/03   02/07

FDIS21 4 200

x1st Ed.

IPMP Components

    04/10

  05/04   05/07

CD --->

Study of CD

21 5 200x

1st Ed.

Rights Expression Language

  01/12

02/07

  02/12   03/07

FDIS21 6 200

x1st Ed.

Rights Data Dictionary

  01/12

02/07

  02/12   03/07 FDIS

21 7 200x

1st Ed.

Digital Item Adaptation

02/03

02/05

02/12

  03/07 03/10 03/12 FDIS

21 7 200x

Amd.1

MPEG-21 DIA AMD/1 WD: DIA Conversions and Permissions

  03/12

04/07

  05/01   05/07

Study of

PDAM ---

>FPDAM

21 8 200x

1st Ed.

Reference SW

  03/03

04/03

  04/07   05/04

CD --> FCD

21 10

200x

1st Ed.

Digital Item Processing

02/12

03/03

03/12

04/03

04/10   05/04

FCD--->Study of FCD

21 14

200x

1st Ed.

Conformance

  03/10

05/04   05/10  

06/04

WD --> CD

21 15

200x

1st Ed.

Event Reporting

  04/03

04/10

  05/04   05/07

CD --->

Study of CD

21 17

200x

1st Ed.

Fragment IDs for MPEG Media Types  

04/10

05/01   05/07  

06/01

WD --> CD

63

Overview of Activities 71st MPEG meeting – Organization of work:

• Main MDS track (MPEG-21) – Room 1504• Break-out groups (Room 4480):

– MPEG-21 DID, REL(?), RDD(?), DIA, DIP, Event Reporting, IPMP• Joint meetings with other groups on MPEG-7 & MPEG-21• MDS plenary meetings (Mon, Wed (2.30pm-3.30pm), Thurs)• Single wrap-up meeting on Friday

Major MPEG-7 goals of the week No significant work – just liaison presentation with JPSearch

Major MPEG-21 goals of the week MPEG-21 Digital Item Declaration (Part 2):

• Review NB Comments, • Output: MPEG-21 DID 2nd Ed à FDIS, DoC

MPEG-21 IPMP Components (Part 4):• Review Preliminary NB Comments, Contribs, • Output: MPEG-21 IPMP Components à Study of CD, Draft DoC

MPEG-21 Rights Data Dictionary• Output: MPEG-21 RDD COR/1 à COR

MPEG-21 Digital Item Adaptation (Part 7):• Review NB comments/inputs, CE results• Output: MPEG-21 DIA AMD/1 à FPDAM, DoC, Adapt Model (?)

MPEG-21 Reference SW (Part 8):• Review SW contributions, NB Comments• Output: MPEG-21 Ref. SW à at FCD (Study?)

MPEG-21 Digital Item Processing (Part 10):• Review AHG report, Ref s/w, NB Comments• Output: MPEG-21 DIP à Study of FCD, Draft DoC, Updated Ref s/w

MPEG-21 Conformance (Part 14):• DIP Conformance?• Output: MPEG-21 Conformance à WD (current parts > FCD only?)

MPEG-21 Event Reporting (Part 15):

64

• Review AHG results & Inputs• Output: MPEG-21 Event Reporting à Study of CD, Draft DoC

MPEG-21 Fragment IDs for MPEG Media Types• Review AHG results & Inputs• Output: MPEG-21 Event Reporting à CD

A further activity was undertaken on MPEG-21 Schema Files, the new Part 18 of MPEG-21 and two output documents were generated:

Notes on discussions on Input Documents

Six Break Out Groups were formed during the week for the purposes of:

DIA Ammendment and Core Experiment discussions DID 2nd edition editing and DoC work DIP Study of FCD – continuing work on DoC of NB comments and completing the FCD IPMP Components – Editing CD and reviewing inputs. Fragment Identifiers – preparation of the CD. Event Reporting - Editing CD

These met ina pre-assigned break-out room and informally.

The MDS group considered all input documents, or summaries (agreed with the contributors) of the contributions and their treatment from the Break out groups.

11515

Jeroen BekaertRik Van de WalleHerbert Van de Sompel

Using MPEG-21 technology in the Digital Archiving and Preservation domain

Input:This input was originally discussed in the AHG. It described the LANL usage of Digital Item Declarations. It highlights issues that have been found with Digital Library usage of DIDL. Problems are other ISO activities (XFDU), lack of open DIDL info, patents etc.

Actions:Liaisons to other ISO bodies, IEEE LTSCRequest DID be freely available on ISO site – ResolutionWWW site improvements – business and technical community outreach are needed but MPEG will take 2 separate courses of actionMDS to discuss technical WWW site improvements

11532 Chiariglione

Use of MPEG-21 technologies in Digital Media Project specifications

Input:

65

This slot allowed an overview of the DMP DCF to be given to the group. This illustrated the use of several MPEG-21 tools by DMP.

Actions:A MAF will be proposed based on the Open Distribution model advocated.

Tuesday am

MPEG-A With Reqts

11499 DiepoldWo Chang AHG on MAF Development

Input:Report on MAF AHG. Two activities of AHG – Media Content Format and Jon4. For the former, take application scenario and move forward in terms of Reqts. Reflectors were quite quiet and AHG discussions at the pre-meeting were quiet.

Actions:Jon4 to continue and solicit Industry supportMCF – important in the role of combining the MPEG-21 tools. MCF MAF will be normative if there is sufficient support.

11555 TIRAMISU consortiumEd: Zvi LifshitzA scenario for Digital Item MAF usage in DRM context

11695 Zvi LifshitzRequirements for Digital Item MAF

Input:A scenario that uses MPEG-21 DIDs for DRM and licence exchange. All information on the item is in the DID and then all information for the DRM is exchanged using DIDs. Idea is that the DI goes through phases – with information,licensing and keys changing as the DI progresses down the delivery chain. In particularly the scenario is focussed on the home domain.

This scenario requires dynamic DIs with state information – not a concept that is currently present in the DI.

11695 gives 3 groups of suggested Requirements: Self Containment, End-to-End Protection and State Control.

Actions:There are some requirements here that mya need to be considered as ne MPEG-21 Requirements – others will be discussed directly in the MAF activity.

11770 Leonardo Chiariglione Open Release MAF

Input:This is a proposal based on the discussion on Monday of the DMP work. The aim is to allow Open Release of content such that other users can freely access content but do not want the content to be Public Domain. The proposal is lightweight governance combined with MPEG-21 package.

66

Actions:This is more of a publication/creation application scenario.This is for ‘Bloggers’ who wish to have some lightweight control of there material.This will be discussed further in the MAF BoG

11580 Jaime DelgadoJose PradosEva Rodríguez

Interoperability between MPEG-21 REL and OMA DRM: A Profile?

Input:This is a discussion of interoperability beween DRM languages – OMA: REL and looks at a possible mobile extension for MPEG-21 REL. Proposes that any REL profile should conform with OMA DRM REL v2.

Actions:Action required at this stage is limited. The next MPEG meeting can start considering a profile.

Joint with Systems

11644 Sylvain Devillers Alexandre Cotarmanac'hISO Base Media File format addressing scheme

Input:This is a discussion of a pointer scheme for the ISO File Format and how it will fit with Part 17 Fragment ID. The proposal is an ffp() pointer, offset() scheme that would work with the mp() scheme in the WD of part 17. Open issues are the need for physical addressing?, mp4 specific addressing, and qualification of scheme names, resolution of relative URIs when there are embedded resources.

Actions:The mechanism for deling with references to other ‘media files’ in the same container needs further discussion.

11260

Yongju Cho,Youngkwon Lim,Moonsup Song,Hyoung-Joong Kim,Jaegon Kim,Jin-Woo Hong,

Proposed URI scheme for mp4 file format

Input:This points out a need for a scheme in an MP4 file to be able to address elements withing an MP4 file and within an MDAT. There is need for a requirement to address part of e.g. a video resource in an MDAT.

Actions:To be discussed with the previous proposal in BoG

11612 Stephen DavisIan BurnettProposed extra components for 15938-1 amd/2 and/or 21000-16

Input:This proposes new requirements for XML access relevant to TEM/BiM which allows fragments to be requested and those fragments to be specified according to level/depth.. Proposes FRUs –

67

Fragment Request Units which would complement FUUs to allow navigation of XML documents using a protocol.

Actions:Seems to be a Systems tool. Consider current technologies and assess where there is a need to standardise new technology.

11674 Frederik De KeukelaereRik Van de WalleContribution to DIP reference software

Input:This input describes reference software for MPEG-21 DIP.

Actions:To be used as the new reference software.

11550 Christian TimmererHermann HellwagnerPreliminary comments on 21000-15 CD

Input:Preliminary comments on the Event Reporting CD from the Austrian NB.

Actions:These were discussed at the 71st meeting and a preliminary DoC of these comments was prepared.

11581Jeroen BekaertHerbert Van de SompelNiels RumpChris BarlasRik Van de Walle Typing Identifiers

Input:This proposes that there should be a specified set of relationships for RelatedIdentifier in DII (MPEG-21 Part 3).

Actions:The terminoloy of the Requirement was improved during discussions. It seems that the RDD verbs (IsExtractionOf) can be used as the Related Identifier relationships.

11611 Joseph Thomas-Kerr Ian Burnett

Bitstream Binding Language – a grammar for Digital Item Transport

Input:Proposes a language BBL that would allow a DI to be mapped (or bound) to a transport stream. Defines Access Unit DIs that contain fragments of DID and/or fragments of Resources. BBL provides instructions for binding DI into AUDIs.

Actions:The approach was well received and the demonstrations were received with interest. However, key requirements need to be established first. The action was to work on the Requirements for Streaming DIs.

11742 Klaus LeopoldChristian Timmerer CE Report on Conversions

68

Input:CE Report on Conversions. Talks about how WSDL could be used to bind conversion descrtiptions to Java implementation. OWL-S was considered in terms of the ‘grounding’. It is used the describe the capabilities of a Conversion.

Actions:Update OWL-S description in FPDAM and include grounding mechanism.Requirements on a possible full, normative WSDL, OWL-S approach will be considered.

11706Christian TimmererJörg HeuerAndreas HutterGabriel Panis

CE Report on Bit-stream Adaptation in Constrained and Streaming Environments

Input:CE Report on Bitstream Adaptation.

Output:Guidelines on using BSD efficiently and guidelines for designers on use of XSLT in the framework may be placed as ‘white papers’ on the updated MPEG-21 WWW site.

11670Cyril ConcolatoPhilippe de CuetosMariam KimiaeiBenoit Pellan

Improvement of DIA Amd1: ConversionLink

Input:Considers adaptation of a non BSD based resource. Examines linkage of conversion description and resource – an identified problem in current DIA Amendment. Proposes ConversionLink based on BSDLink – obtains conversion parameter descriptions in an interoperable way.

Output:Guidelines

11698Truong Cong ThangYong Ju JungYong Man RoJeho NamJae-Gon KimJin-Woo Hong

Modeling Modality Conversion for QoS Management

Input:

Considers how to decide when to convert modalities in terms of QoS. Looks at how to build a realistic model for the modality conversion point.

Output:

It was noted that this should be linked with the previous presentation so that a single modality/cross modality conversion framework is possible. Hence, this was referred to the DIA BoG so that the proposals might be harmonised and then built into Requirements for a new amendment of DIA. It was agreed that this amendment would be different to the Amedndment 1 in process.

11556 Marc GauvinEva RodriguezJaime DelgadoRDD versus 21000-1 (2nd edition) terms and definitions

Input:

69

This input expresses concern that the RDD terms are incompatible and do not match with those in the sescond edition of the Technical Report (21000-1).

Actions:

Marc Gauvin will talk to Requirements about a possible missing Requirement related to abstraction and underlying work.

While a full technical solution to a MPEG-21 term dictionary/taxonomy is possible, MDS does not currently have technical volunteers. Rather, MDS will endeavour to ensure consistent terms and translations are included as Definitions in each MPEG-A (MAF) standard.

11587HendryJeongyeon LimQonita ShahabMunchurl KimKeunsoo Park

A Generic Descriptor for Resource Protection with Extension to IPMP Info Schema

Input:This input expresses concern that in IPMPInfo there is a limitation on the ability to protect a part of a Resource. The input considers the use of Fragment ID and DID solutions to the problem identified.

Actions:Question as to whether this is necessary given that ipmp:Fragment is available. It was suggested by several parties that this may be possible using the ipmp:didl structures already available in the CD. A CE will be performed on this question.

11594J.J. ChaeJeho NamKwanyong KimTae-hee KimJae-Gon KimJin-Woo Hong

Proposal of Additional MPEG-21 IPMP ToolDescription

Input:This input investigates the IPMP ToolDEscription and whether it meets all the requirements. The input presented several scenarios – a sleeping DI, Pay-Per-View. In th ecurrent spec there is IPMP Configuration and the input suggests several improvements to that structure.

Actions:Question as to whether this is something that should be in the media resource layer – e.g. MPEG-2. Also, it was questioned whether this is more of a communications issue.

11679Liu Yongliang Liu shaohuiYao HongxunHuang TiejunGao Wen some suggestions about IPMP

Input:This input makes suggestions for MPEG-21 IPMP Components on the basis of MPEG-2/MPEG-4 IPMP work.

Actions:Question as to whether the first suggestion is implementation and related to the MPEG-2 IPMP architecture. It was felt that this first suggestion is at the Systems level and below the IPMP Components level. The second suggestion was viewed as a high level Requirement and MDS would like to see a solution and clear Requirements for the Requirements group. Also the addition of

70

watermarks would appear to be related to the REL. Watermarking and related issues is seen as a user/implementation issue.

MPEG-21 RDD (17h00- 18h00)DIA Conformance Issues (13h30-14h30)

1504 (MDS Room) MPEG-21  

MDS experts discussed the w6867 MPEG-21 Conformance Document. There are several issues with missing conformance for a number of the parts. There was a suggestion to move the DID examples to an Annex of the DID 2nd edition. For BSD/Resource Adaptation bitstreams will be provided by the next meeting. Section on BSD will be edited to give full references to the DIA standard.

11766 Myriam AmielhProposed grammar for Logical Models

Input:Considers the description of a Logical Model which is semantically meaningful to a user. The principle is that publishers would publish the logical model of a CD. The aim is to define a grammar/language for defining logical models. Typically they will be independent of the physical content and need to be easily extensible.

Actions:General consensus that this is a good idea and should be part of the Fragment ID work. MDS will host a CE on this work (with multiple participants). It was also noted that some extra Requirements may be needed for this work. The relationship to access masking for Digital Items was also considered.

11575Jiang ZhangLi ZhaoBin LiShiQiang Yang

A Flexible License Management Scheme for Digital Rights Management

Input:This input describes a DRM License Management system which has 3 flexible modes.

Actions:None necessary – For Information only

WWW site and Schema Issues (15h00-15h30)

Actions:

Request MPEG-21 Part 2 be made publicly accessible by ISO.Request All schemas be publicly avaialble as XSDs at a URI and be distributable.WWW site updates agreed but we will have a Resolution soliciting external users/communities MPEG-21 information AHG on WWW site and a FAQ

Joint meetings with Requirements were held on the Thursday morning. Please refer to the Requirements report for details of documents examined in those meetings. Full details of the inputs and meeting topics are given in the MDS schedule. Thursday afternoon wrapped up Break Out Group activities at MDS – see reports on the next section.

71

A Summary of Break-Out Activities – DIP, DID, DIA & FID

BoG on DID71st MPEG meeting, Hong Kong, CN

17-21 January 2005v4.0

Room: 4480When: Tuesday 0900-1130

Wednesday 1130-1330Thursday 0900-1000

Mandates: Dispose of comments on FCD DID.

Text of FDIS DID

Discuss and recommend regarding XInclude

Summary of Recommendations

Approve disposition of comments on FCD DID and complete the FDIS text.

Adopt XInclude as detailed in .

Encoding???

Disposition of comments on FCD and text of FDIS

Refer to NXXXX for DoC

Refer to NXXXX for Text of FDIS – to be completed during editing period with in-progress revisions made available during the editing period

XInclude

Discussion notes

2005-01-17Reference for XInclude: http://www.w3.org/TR/xinclude/

Possible that Reference was included in DIDL because XInclude was not a W3C Recommendation when DID first edition went to FDIS.

If XInclude is allowed there are two general approaches that could be followed

1. Add XInclude as a normative reference and allow it to be used in DIDs, but do not modify the schema. Hence a DID before XInclude-processing might not be valid to the DIDL

72

schema. However, it is a requirement that post XInclude-processing must result in a DID instance valid to the DIDL schema. Effectively the validation process becomes

1. Do XInclude –processing

2. Do validation against DIDL schema

3. Do DIDL validation rules validation

2. Add XInclude as a normative reference and modify the DIDL schema to allow xi:Include elements at appropriate places. In this case DIDs using XInclude can then still be validated against the DIDL schema.

It was pointed out that even if the DID instance document can be validated against the DIDL schema, the DID resulting from the xinclude processing still needs to be validated to ensure it (the resulting DID) is valid. However this is also true for Reference as it is now.

It was noted that there has already been some confusion in regards to Reference that has required clarifying text and also some difficulties in implementing Reference

It was noted that Reference is not part of the DID model. However since it was in edition 1, removing might cause problems for existing applications of DID that already use it.

A possibility is to delete Reference element, add XInclude as a normative reference, and provide some informative examples in the Declarations clause on using XInclude to reference elements in the Declarations.

A possibility is to retain the Reference element for backwards compatibility, and then add in XInclude. Where Reference currently exists in the schema would be replaced by a choice between either Reference or an xi:include element.

Allowing both would allow the DI author to choose whatever suited their needs

Note that the merging of content and copying of attribute values functionality of Reference element is not possible in XInclude

EXAMPLE 1 Functionality of Reference element

foo.xml

<Anchor id="myAnchor"> <Condition true="a_selection"/> <Descriptor><Statement mimeType="text/plain">Foo</Statement></Descriptor> <Reference target="http://some.where.com/bar.xml#an_anchor"/></Anchor>

bar.xml

<Anchor id="an_anchor" precedence="100"> <Condition true="b_selection"/> <Descriptor><Statement mimeType="text/plain">Bar</Statement></Descriptor> <Reference target="http://some.where.com/foo.xml#bar"/></Anchor>

73

foo.xml' (post Reference resolving)

<Anchor id="myAnchor" precedence="100"> <Condition true="a_selection"/> <Condition true="b_selection"/> <Descriptor><Statement mimeType="text/plain">Foo</Statement></Descriptor> <Descriptor><Statement mimeType="text/plain">Bar</Statement></Descriptor></Anchor>

Notes:

1. The original value of the id attribute of the referencing Anchor is retained.

2. The value of the precedence attribute is copied to the referencing element since it was not specified for the referencing element.

3. The content of the referenced Anchor is merged with the existing content of the referring Anchor such that the valid content model of the Anchor is maintained.

A single xi:Include would not achieve the same functionality as it is a complete copy and replace of the xi:include element by the included element.EXAMPLE 2 Not quite equivalent XInclude example (not complete)

foo.xml

<Anchor id="myAnchor"> <Condition true="a_selection"/> <xi:include ref="http://some.where.com/bar.xml" xpointer="element(an_anchor/2)"/> <Descriptor><Statement mimeType="text/plain">Foo</Statement></Descriptor> <xi:include ref="http://some.where.com/bar.xml" xpointer="element(an_anchor/4)"/></Anchor>

bar.xml

<Anchor id="an_anchor" precedence="100"> <Condition true="b_selection"/> <Descriptor><Statement mimeType="text/plain">Bar</Statement></Descriptor> <Reference target="http://some.where.com/foo.xml#bar"/></Anchor>

foo.xml' (post Reference resolving)

<Anchor id="myAnchor"> <Condition true="a_selection"/> <Condition true="b_selection"/> <Descriptor><Statement mimeType="text/plain">Foo</Statement></Descriptor> <Descriptor><Statement mimeType="text/plain">Bar</Statement></Descriptor></Anchor>

Notes:

1. The attributes of the Anchor element are not processed (thus, the referencing Anchor does not "inherit" the precedence attribute value).

74

2. Using XInclude, it is a "copy and replace" acting at the point where the xi:include element is located (hence to xi:includes are required, one to include the referenced Condition and one to include the referenced Descriptor), whereas with Reference it actually "acts" upon the parent element of the Reference (i.e. the Reference actually references the target Anchor).3. The above example is indicative only, the XInclude recommendation includes in its processing other actions such as setting the xml:base if required, etc..

One possible action is that if consensus on adopting XInclude and a feasible technical solution can be reached this week, we could include it in the FDIS with sufficient support from national bodies.

Otherwise the feasibility and consequences should be studied in an AhG and/or CE. The results can then recommend adoption or not of XInclude along with the recommended technical solution. This would added to DID as an Ammendment.

2005-01-18With the new DID model abstract schema it could be modified to allow an xi:include child element

of the DIDBaseType. This would allow xi:include elements

2005-01-19If both Reference and XInclude address the same requirement, then why have both – we should

choose one or the other to better support interoperability

Note that Reference is not part of the DID model. It also appears on examination of the requirements that no specific requirement exists for this functionality and it is primarily intended as a feature of the XML representation to allow DIDs to be built up from multiple source document. This is exactly the purpose of XInclude.

However the difference in functionality is noted. But this difference in functionality might be an artefact of the Reference element being a child element of the "acted upon" element.

The number of comments and modifications and difficulties in implementing Reference indicates that not all consequences of Reference may have been taken in to account. Whereas W3C has extensive expertise and a development and review process for developing the XInclude recommendation. It is noted that what DIDL attempts to define in 3 paragraphs, is defined in ~25 pages of W3C recommendation.

XInclude is already supported in a number available off-the-shelf packages (e.g. Cocoon)

XInclude has a comprehensive resolution of such issues as what to do with attributes of type ID, etc.

One decision is whether to adopt XInclude (and then an issue would be how it could be adopted – i.e. in FDIS or an Amendment)

Another decision is if XInclude is adopted the details of how this will be technically done

Another decision if XInclude is adopted is whether to retain Reference or remove it (if we cannot adopt XInclude in FDIS, then we should consider adding text to indicate Reference is deprecated and will be replaced in future)

It was noted that DID 2nd edition is already not backwards compatible, thus the argument to retain Reference for backwards compatibility is weakened.

75

2005-01-20Consensus on XInclude is desirable to be allowed in DIDL.

Options:

1. Deprecate Reference. Add XInclude as a normative Reference. Technical modification to DIDL schema to allow XInclude elements such that DID can be validated against DIDL schema prior to XInclude processing.

2. Deprecate Reference. Add informative text providing example of how to use XInclude instead of Reference. No changes to schema as yet. Possible amendment later to provide schema mods.

3. Remove Reference and include XInclude somehow.

Recommendation

Provide for the usage of XInclude in a DIDL document.It should replace Reference in second edition provided an informative Annex is added illustrating how the desirable features of Reference are capable of being implemented using XInclude.The technical solution recommended isAdd XInclude as a normative reference

Modify the DIDL schema to remove Reference, but do not provide for XInclude elements in this schema. This schema will be available for validation of the DIDL infoset after XInclude processing.

An additional schema allowing validation of a DIDL document prior to XInclude processing will be added.

Both schemas will be informative.

We have support from the following NBs: Australia, Belgium, France

Issue on encoding of resource and statement

Discussion notes

2005-01-19Refer to: m11515 for information on the issue and m11502 for recommendation of the Vision

Update AhG for this to be discussed in MDS.

An example of where this issue is encountered is for example a gzip encoded PDF file.

If this Resource is done by Reference:

<Resource mimeType="application/pdf" encoding="gzip" ref="blah"/>

If this is transported inline, then it has to be base64 encoded:

<Resource mimeType="application/pdf" encoding="base64"> ab7y8hlhgoierhyeh…</Resource>

76

But after decoding the base64, we no longer know that our resource is gzip encoded.

Proposed solution to allow the sequence of encodings in the encoding attribute:

<Resource mimeType="application/pdf" encoding="base64 gzip"> ab7y8hlhgoierhyeh…</Resource>

Note that these encoding values are registered and defined (by means of RFCs) with IANA/IETF, as MIME types are also. Thus the allowable values for the encoding attribute would thus be allowed only from these values, as it is currently with the mimeType attribute of Resource and Statement.

2005-01-20It was questioned as to why the transfer encoding needs to be signalled in the DID, shouldn’t the

transfer mechanism itself indicate this?

This is true if the transfer protocol is indicated by the resource reference, however it is not the case for a resource on a file system or included in-line in the DID.

BoG on DIP71st MPEG meeting, Hong Kong, CN

17-21 January 2005v2.0

Room: 4480When: Tuesday1300-1730Mandates: Study preliminary comments on FCD DIP

Produce Study text of FCD DIP

Update DIP Reference Software plan.

Discuss and recommend regarding E4X.

Summary of Recommendations

Produce the study of preliminary comments and study text of FCD.

Continue study of preliminary comments in AhG

For now, do not adopt E4X but to be considered after ECMAScript Edition 4 (which is planned to included E4X) is finalised.

Preliminary comments on FCD DIP and study text of FCD

For study of preliminary comments refer to NXXXX

77

Study text of FCD will be completed during editing period and prior to due date of FCD ballot

DIP Reference Software plan.

Refer to NXXXX.

E4X

Discussion notes

2005-01-18E4X includes conversion to and from DOM types, hence support for DOM API would be required

in any case

Currently there is only one early implementation of E4X whereas DOM is well-supported with many implementations for many platforms

There are some functionalities available in DOM which are not available in E4X – loading and saving

E4X will be included in ECMAScript Edition 4. After this is standardized (due Q3 2005), DIP might be amended to utilize this in future. In this case E4X will become available then.

It is noted that for those familiar with only ECMAScript, E4X would be more natural and easier to pick-up.

Recommendation

For now it is recommended that we retain only the DOM API. However E4X should remain under consideration when it is more widely supported, possibly after ECMAScript Edition 4 has been standardised.

Additional issues mentioned

Subclause 5.5.4 – RunDIM should be DIP.RunDIM – in general check that in all examples the correct calling mechanisms are used.

Note: An NB comment on the FCD relating to this will be required.

All examples should be validated, and run through the DIP reference software.

Additional info on E4X

A.1 Links

http://www.ecma-international.org/publications/standards/Ecma-357.htm

http://www.iso.org/iso/en/CatalogueDetailPage.CatalogueDetail?CSNUMBER=41002&scopelist=PROGRAMME

http://xml.coverpages.org/ni2004-07-20-a.html

http://www.mozilla.org/rhino/download.html

78

http://www.agiledelta.com/products.htm#Native%20XML%20Scripting

http://www.xmlconference.org/xmlusa/2004/slides/schneider/ECMAScript%20for%20XML%20(with%20Examples).ppt

http://www.oreillynet.com/pub/wlg/2997

http://dev2dev.bea.com/products/wlworkshop/articles/JSchneider_XML.jsp

A.2 Feature Matrix DOM versus E4X

Feature DOM E4XCan be used in ECMAScript (DIML) Yes YesCan be used in Java (for DIXOs) Yes NoCan be used in other possible DIXO languages Yes1 NoUtilizes native features of ECMAScript (DIML) No YesUtilizes native features of Java (for DIXOs) Yes N/AEase of use for ECMAScript (DIML) programmers No YesEase of use for Java (for DIXOs) programmers Yes YesImplementations available for ECMAScript (DIML) Yes YesImplementations available for Java (for DIXOs) Yes N/AStandardized Yes YesISO Standard No YesSupport for namespaces Yes YesGet attributes of element Yes YesSet attributes of element Yes YesGet child of element Yes YesAdd child of element Yes Yes

A.3 SaveTrack DIM from Annex F of DIP FCD – DOM API

function SaveTrack(){ // This DIM saves a single User selected Track to a new DID.

// Prompt the User to select the Track to be saved. var objTypes = new Array( "urn:acmeCorp:m21:dip:types:Track" ); var msg = new Array( "Select Track" ); var tracks = GetObjects( objTypes, msg ); if( tracks != null && tracks.length == 1 ) { // Grab the value of the id of the Item describing the Track object. var trackId = tracks[0].getAttribute( "id" );

// Request User to provide a description for the new DID var dataTypes = new Array( “String” ); msg[0] = “Enter description”; var userDesc = GetData( dataTypes, msg );

// Retrieve ArtistInfo Item so we can copy it to new DID var info = didDocument.objectMap.getObjects( "urn:acmeCorp:m21:dip:types:ArtistInfo" );

1 Provided an appropriate binding can be specified.

79

// Check the audio Components (the first two Components) of // the Track and just copy the first one that is available // according to state of any Conditions it may have. var compToCopy = null; var comp = didDocument.getElementById(trackId + "_audio_192"); if(comp != null && DID.AreConditionsSatisfied(comp)) { compToCopy = comp; } else { comp = didDocument.getElementById(trackId + "_audio_64"); if(comp != null && DID.AreConditionsSatisfied(comp)) { compToCopy = comp; } }

// Create the document with a DIDL document element var domImpl = DOMImplementationRegistry.getDomImplementation(""); var doc =.domImpl.createDocument( "urn:mpeg:mpeg21:2002:02-DIDL-NS", "DIDL", null );

// Create the top-level Item element var topItem = doc.createElementNS("urn:mpeg:mpeg21:2002:02-DIDL-NS", "Item"); doc.appendChild( topItem );

// Create a Descriptor for the top-level Item from input User data var desc = doc.createElementNS("urn:mpeg:mpeg21:2002:02-DIDL-NS", "Descriptor"); topItem.appendChild( desc ); var stmt = doc.createElementNS("urn:mpeg:mpeg21:2002:02-DIDL-NS", "Statement"); desc.appendChild( stmt ); stmt.setAttribute( "mimeType", "text/plain" ); var txt = doc.createTextNode( userDesc[0] ); stmt.appendChild( txt );

// Create a copy of the ArtistInfo and append to top-level Item var infoCopy = doc.importNode( info, true ); topItem.appendChild( infoCopy );

// Create a sub-Item of new DID for the Track var track = doc.createElementNS("urn:mpeg:mpeg21:2002:02-DIDL-NS", "Item"); topItem.appendChild( track ); if( compToCopy != null ) { var compCopy = doc.importNode( compToCopy, true ); track.appendChild( compCopy ); }

// And now store the new DID. dataTypes = new Array( “String” ); msg[0] = “Enter URI to save Track DI”; var dest = GetData( dataTypes, msg ); if( dest.length > 0 ) { var serializer = domImpl.createLSSerializer(); serializer.writeToURI( doc, dest[0] ); } }}

80

A.4 Modified SaveTrack DIM from Annex F of DIP FCD – E4X

Highlighted lines are either not available in E4X or not currently known whether or not such support is available in E4X.function SaveTrack(){ // This DIM saves a single User selected Track to a new DID.

// Prompt the User to select the Track to be saved. var objTypes = new Array( "urn:acmeCorp:m21:dip:types:Track" ); var msg = new Array( "Select Track" ); var tracks = GetObjects( objTypes, msg ); if( tracks != null && tracks.length == 1 ) { // Grab the value of the id of the Item describing the Track object. var trackId = tracks[0].@id;

// Request User to provide a description for the new DID var dataTypes = new Array( “String” ); msg[0] = “Enter description”; var userDesc = GetData( dataTypes, msg );

// Retrieve ArtistInfo Item so we can copy it to new DID var info = didDocument.objectMap.getObjects( "urn:acmeCorp:m21:dip:types:ArtistInfo" );

// Check the audio Components (the first two Components) of // the Track and just copy the first one that is available // according to state of any Conditions it may have. var compToCopy = null; var comp = didDocument.getElementById(trackId + "_audio_192"); if(comp != null && DID.AreConditionsSatisfied(comp)) { compToCopy = comp; } else { comp = didDocument.getElementById(trackId + "_audio_64"); if(comp != null && DID.AreConditionsSatisfied(comp)) { compToCopy = comp; } }

// Create the document with a DIDL document element var track = <Item/>; if( compToCopy != null ) { track.1 = compToCopy; } var doc = <DIDL xmlns="urn:mpeg:mpeg21:2002:02-DIDL-NS"> <Item> <Descriptor> <Statement mimeType="text/plain">{userDesc[0]}</Statement> </Descriptor> {info} </Item> {track} </DIDL>;

doc.Item.Descriptor =

// And now store the new DID. dataTypes = new Array( “String” ); msg[0] = “Enter URI to save Track DI”;

81

var dest = GetData( dataTypes, msg ); if( dest.length > 0 ) { var serializer = domImpl.createLSSerializer(); serializer.writeToURI( doc, dest[0] ); } }}

82

MPEG-21 Fragment Identifiers for MPEG Media Types ISO 21000-17 BoG Report

The FID Break Out Group worked on the following areas:

1) Introduce following elements in 21000-17:

- Reference to 14496-12 URL forms - Hierarchical pointer parts at the Framework level - ffp() fragment identifier as proposed in m11644 - offset() fragment identifier as proposed in m11644 - Informative annex for Resolution of relative URIs

2) Remove mpns() scheme and reference W3D xmlns()

3) Set up a core experiment for evaluating a grammar for Logical Model descriptions

A Summary of Outcomes on Part basis

The following outcomes were generated at the meeting:

83

MPEG-21 Digital Item Declaration (Part 2): Reviewed Comments on FCD Adopted XInclude to replace Reference Minor editing and technical changes

Output: MPEG-21 DID FDIS, DoC

MPEG-21 Digital Item Identification (Part 3): Amendment on RelatedIdentifier – terms to be taken from RDD

Output: MPEG-21 DII PDAM/1

MPEG-21 IPMP Components (Part 4): Reviewed Initial Comments on CD Reviewed new proposals – CE to evaluate

Output: MPEG-21 IPMP Components Study of CD, Prelim DoC, TuC, CEs

MPEG-21 Rights Data Dictionary (Part 5):Output: MPEG-21 RDD COR 1

MPEG-21 Rights Expression Language (Part 6): No activity – 2 inputs relevant

Output: No Output

MPEG-21 Digital Item Adaptation (Part 7): DIA AMD/1 “Conversions and Permissions” FPDAM completed Discussions on Modality conversion future Amendment – CE on these

Output: MPEG-21 DIA FPDAM/1

MPEG-21 Reference SW (Part 8): Significant DIP Reference software – OK since FDIS next meeting

Output: MPEG-21 Ref. SW Study on FCD

MPEG-21 Digital Item Processing (Part 10): One issue – DOM vs E4X – stick with DOM Preliminary NB comments examined Several other edits/technical matters

Output: MPEG-21 Study of FCD, Prelim. DoC

MPEG-21 Event Reporting (Part 15): Significant progress on text by editors Preliminary treatment of early NB Comments

Output: MPEG-21 Study of CD, Prelim. DoC

MPEG-21 Fragment Identifiers for MPEG Media Types (Part 17): 1) Introduced following elements in 21000-17: - Reference to 14496-12 URL forms - Hierarchical pointer parts at the Framework level - ffp() fragment identifier as proposed in m11644 - offset() fragment identifier as proposed in m11644 - Informative annex for Resolution of relative URIs

84

2) Remove mpns() scheme and reference W3D xmlns() 3) Set up a core experiment for evaluating a grammar for Logical Model descriptions

Output: MPEG-21 FID CD, CE Workplan

MPEG-21 Schema Files (Part 18): New Part of MPEG-21 that will contain the schema files for all parts Request made to SC29/JTC1 that the Part be made publicly available

Output: Request for Part, Request for availability to ISO

Output Documents and Resolutions from the MDS Subgroup

Multimedia Description Schemes group

The Multimedia Description Schemes subgroup recommends approval of the following documents:

MDS Output Documents and Resolutions – HK 71st Meeting

MPEG-21

1.0 The MDS subgroup reminds editors of its MPEG-21 standard parts, and those under development, of the undertaking to generate WWW pages summarising their parts. These will be used to enhance the MPEG-21 web site.

No. Title TBP Available21000-2 MPEG-21 Digital Item Declaration

6926 DoC of ISO/IEC 21000-2 FCD No 05/01/216927 Text of ISO/IEC 21000-2 2nd Edition FDIS No 05/04/18

1.1 The MDS subgroup nominates Gerrard Drury, Rik Van de Walle and Ian S Burnett as the editors of ISO/IEC 21000-2 2nd Edition.

1.2 The MDS subgroup thanks the National Bodies of Australia, Austria, Belgium, UK and USA for their detailed and useful NB comments on ISO/IEC 21000-2 FCD.

No. Title TBP Available21000-3 MPEG-21 Digital Item Identification

6928 ISO/IEC 21000-3 PDAM/1 MPEG-21 DII No 05/01/21

1.3 The MDS subgroup nominates Mr Niels Rump and Mr Jeroen Bekaert as the editor of the ISO/IEC 21000-3 Related Identifier Types amendment.

85

No. Title TBP Available21000-4 MPEG-21 IPMP Components

6929 Study of ISO/IEC 21000-4 CD IPMP Components No 05/02/146930 Preliminary DoC for ISO/IEC 21000-4 CD IPMP Components No 05/01/216931 MPEG-21 IPMP Components Reference Software Workplan No 05/01/216932 Workplan for CE on Update Description of IPMPTools No 05/01/216933 Workplan for CE on Fragment-level Protection Description No 05/01/216934 ISO/IEC 21000-4 TuC 2.0 No 05/01/21

1.4 The MDS subgroup requests that Simon Watt, Shane Lauf, Zhongyang Huang, and Eva Rodriguez be appointed as editors of ISO/IEC 21000-4.

1.5 The MDS subgroup thanks the Austrian National Body for making early NB comments available on ISO/IEC 21000-4 CD and reminds other NBs of the forthcoming deadline (05/03/06) for NB comments on the ISO/IEC 21000-4 CD.

1.6 The MDS subgroup reminds proponents of technology included in the IPMP Components CD of the requirement to submit reference software and requests submissions for the 72nd meeting.

No. Title TBP Available21000-6 MPEG-21 Rights Data Dictionary

6935 Text of ISO/IEC 21000-6 COR/1 No 05/01/21

No. Title TBP Available21000-7 MPEG-21 Digital Item Adaptation

6936 DoC for ISO/IEC 21000-7 PDAM/1 No 05/01/216937 ISO/IEC 21000-7 FPDAM/1 No 05/01/216938 TuC for Potential 21000-7 MPEG-21 DIA Amendment(s) No 05/01/216939 Workplan for CE on the use of Adaptation QoS for Conversions No 05/01/21

1.7 The MDS subgroup thanks the National Bodies of Austria, Japan and USA for their NB comments on ISO/IEC 21000-7 PDAM/1.

No. Title TBP Available21000-8 MPEG-21 Reference Software

6940 Study of ISO/IEC 21000-8 FCD No 05/01/216941 Draft of DoC on ISO/IEC 21000-8 FCD No 05/01/21

1.8 The MDS subgroup reminds proponents of new technologies added to ISO/IEC 21000-8 Study of FCD (identified by notes in the text) that they should ensure National Body comments are input to the 72nd meeting in support of the changes.

No. Title TBP Available21000-10 MPEG-21 Digital Item Processing

6942 Preliminary DoC for ISO/IEC 21000-10 FCD MPEG-21 DIP No 05/01/21

86

6943 Study text of ISO/IEC 21000-10 FCD DIP No 05/02/216944 MPEG-21 DIP Software Implementation Plan v.5 No 05/01/21

1.9 The MDS subgroup thanks the Belgian NB for their early NB comments and reminds NBs of the deadline (05/04/14) for NB comments on ISO/IEC 21000-10 FCD.

No. Title TBP Available21000-14 MPEG-21 Conformance

6945 WD5.0 of ISO/IEC 21000-14 MPEG-21 Conformance No 05/01/21

No. Title TBP Available21000-15 MPEG-21 Event reporting

6946 Preliminary DoC for ISO/IEC 21000-15 CD MPEG-21 ER No 05/01/216947 Study of ISO/IEC 21000-15 MPEG-21 ER No 05/02/25

1.10 The MDS subgroup thanks the Austrian NB for their early NB comments and reminds NBs of the deadline for NB comments (05/03/06) on ISO/IEC 21000-15 CD.

1.11 The MDS subgroup requests that Mr. Thomas Kummer-Hardt be appointed as an additional editor to ISO/IEC 21000-15 and that the new list of editors be: Mr. Francois-Xavier Nuttall, Ms. Kyunghee Ji, Mr. Niels Rump, Ms. Youngjoo Song, Mr. Andrew Tokmakoff, Mr. Thomas Kummer-Hardt.

No. Title TBP Available21000-17 MPEG-21 Fragment Identification for MPEG Media Types

6948 ISO/IEC 21000-17 CD MPEG-21 FID No 05/02/116949 Workplan for Core Experiment on Logical Model Descriptions No 05/01/21

1,12 The MDS subgroup requests that Sylvain Devillers be appointed as an additional editor of ISO/IEC 21000-17 and that the new list of editors be: Ms Myriam Amielh, Mr Sylvain Devillers.

1.13 The MDS subgroup notes that NB comments on the ISO/IEC 21000-17 CD will be due shortly after the 72nd (Busan) meeting. Hence, MDS would welcome comments from those NBs able to submit preliminary comments prior to the 72nd meeting.

No. Title TBP Available21000-18 MPEG-21 Schema Files

6950 Request for subdivision of ISO/IEC 21000 Part 18 MPEG-21 Schema Files

No 05/01/21

6951 Request to make ISO/IEC 21000-18 Publicly Available No 05/01/21

87

1.14 WG11 requests that SC29 recommend to JTC1 that ISO/IEC 21000-18 MPEG-21 Schema Files be made publicly available on the ISO WWW site as soon as the Final Ballot has closed and the specification has been promoted to an International Standard.

Ad-Hoc Groups From MDS at the 70th MPEG meeting

N6952 14.1.1 AHG on MPEG-21 DID and DIPMandate: 1. Complete editing of text of DID FDIS according to disposition of NB

comments on FCD.2. Produce Study text of DIP FCD.3. Carry out further study of preliminary comments and encourage further

comments on DIP FCD.4. Monitor implementation of the DIP software implementation plan.5. Prepare and follow-up registration of MIME type for Digital Item Methods.

Chairs: Gerrard Drury (gerrardx@xenikos.com)Frederik De Keukaleare (Frederik.DeKeukelaerex@xugent.be)

Duration: Until the 72nd MeetingMeetings: AhG Meeting to be held on the Sunday prior to 72nd meeting.

Other business to be conducted by email or phone.Reflector: mpeg-21-dipx@xuow.edu.auSubscribe: Follow procedure at http://mailinglists.uow.edu.au/mailman/listinfo/mpeg-21-dip

N6953 14.1.2 AHG on MPEG-21 DIAMandate: 1. Carry out Core Experiment on DIA and provide recommendations to

the MDS subgroup.2. Produce an editors' input on ISO/IEC 21000 FPDAM/13. Maintain the MPEG-21 DIA TuC document.4. Follow and keep track of the proposed deliveries of software to the

Reference Software Web site.Chairs: Christian Timmerer (christian.timmerer_at_itec.uni-klu.ac.at)

Thomas DeMartini (Thomas.DeMartini_at_contentguard.com)Duration: Until the 72nd Meeting.Meetings: AHG Meeting to be held on the weekend prior to 72nd meeting. Other business will be

conducted by e-mail or telephone conference.Reflector: mpeg21-uma_at_merl.comSubscribe: To subscribe send email to avetro_at_merl.com (Anthony Vetro).

MDS Schedule for the 71st MPEG meeting in Hong Kong, CN

MDS Sub-Group 88

ScheduleMPEG MDS Chair: Ian S Burnett

MPEG-7 and MPEG-21 v.8.0

Number Source Title 

Monday Morning (9h00-13h00)MPEG Plenary Plenary room

Monday Afternoon (14h00-20h00)  

Break Outs: 4480Kick-off of MPEG MDS activities (14h00-14h30) 1504 (MDS Room)

Agenda, Goals and Issues for the Week for MDS Group Ian S Burnett 

Review of AHG resolutions, CE results and action points (14h30-15h30) 1504 (MDS Room)

11488 Gerrard DruryFrederik De Keukaleare AHG on MPEG-21 DIP & DID 2nd Edition

11489 FX Nuttall Andrew Tokmakoff AHG on MPEG-21 Event Reporting

11490 Christian TimmererThomas DeMartini AHG on MPEG-21 DIA

11491 Myriam AmielhGerrard DruryYongJu Cho AHG on MPEG 21 URI Fragment IDs

Define BoGs and Mandates (15h30-16h00)   1504 (MDS Room)

REL, RDD, DID, DIA, DIP, ER, IPMP,FID BOG Room = 4480

89

MPEG-21 DID (16h00 - 16h30) 1504 (MDS Room)

11510 Jeroen Bekaerton behalf of the BNB BNB comments on ISO/IEC 21000-2 FCD 2nd edition

11534Christian TimmererHermann Hellwagneron behalf of the Austrian NB Austrian NB comments on 21000-2 FCD 2nd Edition

11522 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 21000-2 [2nd Edition]

11602 Gerrard Drury Ian Burnett Rik Van de Walle Editor's Input on ISO/IEC FCD 21000-2

MPEG-21 with Reqts (16h30 - 18h00) 2465 (Reqts Room)

11502 Chris Barlas Bruce Block AHG on MPEG-21 Vision Update Report

11512 Melanie Dulong de Rosnay MPEG-21 IPMP requirements for movie and music delivery

11513 Melanie Dulong de Rosnay Use cases examples for movie and music delivery

11514 Kate Grant Overview of some EU research projects which involve MPEG-21 technology

11515Jeroen BekaertRik Van de WalleHerbert Van de Sompel Using MPEG-21 technology in the Digital Archiving and Preservation domain

11532 Chiariglione Use of MPEG-21 technologies in Digital Media Project specifications

Tuesday Morning (09h00-12h30)  

Break Out: DID Tuesday amBreak Out 2: ER (room TBD) 

MPEG-21 with Reqts (9h00 - 10h30) 2465 (Reqts Room)

11499 DiepoldWo Chang AHG on MAF Development

11555 TIRAMISU consortiumEd: Zvi Lifshitz A scenario for Digital Item MAF usage in DRM context

11695 Zvi Lifshitz Requirements for Digital Item MAF

11580 Jaime DelgadoJose PradosEva Rodríguez Interoperability between MPEG-21 REL and OMA DRM: A Profile?

Leonardo Chiariglione Open Release MAF11770

MPEG-21

with Systems Fragment IDs/Binary/Streaming(10h30 - 11h30) 1504 (MDS Room)

11644 Sylvain Devillers Alexandre Cotarmanac'h ISO Base Media File format addressing scheme

11260

Yongju Cho,Youngkwon Lim,Moonsup Song,Hyoung-Joong Kim,Jaegon Kim,Jin-Woo Hong, Proposed URI scheme for mp4 file format

11610

Itaru Kaneko (Tokyo Polytechnic University)Nobuyuki Kinoshita(mmg)Spencer Cheng (Morphbius Technologies)

Further study on Application Specific Binary Coding (ASBC) of MPEG-21 descriptors

11612 Stephen DavisIan Burnett Proposed extra components for 15938-1 amd/2 and/or 21000-16

11640 Sylvain Devillers Alexandre Cotarmanac'h Draft definitions for an MPEG-21 Systems Processing Model

MPEG-21 DIP (11h30 - 12h00)   1504 (MDS Room)

90

11674 Frederik De KeukelaereRik Van de Walle Contribution to DIP reference software

11677Jeroen BekaertFrederik De KeukelaereSaar De ZutterRik Van de Walle Preliminary comments on ISO/IEC FCD 21000-10

MPEG-21 RDD (12h00 - 12h30) ER (12h00 - 12h30) 1504 (MDS Room)

11639 Kyunghee JiYoungjoo Song Editor's Comments on MPEG-21 Event Reporting Committee Draft

11550 Christian TimmererHermann Hellwagner Preliminary comments on 21000-15 CD

 

  

Tuesday Afternoon (14h00-20h00)

Break Out: DIP Tuesday pmBreak Out 2: ER (room TBD)

MPEG-21 RDD (16h00- 17h00)

with Reqts and Systems (14h00-16h00) 2465 (reqts)

11581Jeroen BekaertHerbert Van de SompelNiels RumpChris BarlasRik Van de Walle Typing Identifiers

11611 Joseph Thomas-Kerr Ian Burnett Bitstream Binding Language – a grammar for Digital Item Transport

11638

Sylvain DevillersAlexandre Cotarmanac'hMichael RansburgChristian TimmererHermann Hellwagner Metadata streaming use case and requirements

11746Mayumi KoikeTakuyo KogureNoboru Sonehara MPEG-21 IPMP Requirement from DCCSDP&DCCSDC in Japan

11503 Ian Burnett AHG on Digital Item Transport and Storage

11640 Sylvain Devillers Alexandre Cotarmanac'h Draft definitions for an MPEG-21 Systems Processing Model

11610

Itaru Kaneko (Tokyo Polytechnic University)Nobuyuki Kinoshita(mmg)Spencer Cheng (Morphbius Technologies)

Further study on Application Specific Binary Coding (ASBC) of MPEG-21 descriptors

MPEG-21 DIA Inputs(16h00- 17h00)   1504 (MDS Room)

11541Christian TimmererHermann Hellwagneron behalf of the Austrian NB Austrian NB comments on 21000-7 PDAM/1

11642 Sylvain Devillers Alexandre Cotarmanac'h Proposed modifications for gBS Schema

11670Cyril ConcolatoPhilippe de CuetosMariam KimiaeiBenoit Pellan Improvement of DIA Amd1: ConversionLink

11698Truong Cong ThangYong Ju JungYong Man RoJeho NamJae-Gon KimJin-Woo Hong Modeling Modality Conversion for QoS Management

11706Christian TimmererJörg HeuerAndreas HutterGabriel Panis

CE Report on Bit-stream Adaptation in Constrained and Streaming Environments

11742 Klaus LeopoldChristian Timmerer CE Report on Conversions

MPEG-21 RDD (17h00- 18h00) 1504 (MDS Room)

11556 Marc GauvinEva RodriguezJaime Delgado RDD versus 21000-1 (2nd edition) terms and definitions

11693 Chris Barlas Godfrey Rust RDD editors' response to M11556

91

   

Wednesday Morning (09h00-13h00)

MPEG Plenary (9h00-11h00)   Plenary room

 MPEG-21 DIA AMD/1 Editing (13h00- 14h30)

IPMP AHG/Inputs (11h00 - 12h30) 1504 (MDS Room)

11587HendryJeongyeon LimQonita ShahabMunchurl KimKeunsoo Park

A Generic Descriptor for Resource Protection with Extension to IPMP Info Schema

11549 Christian TimmererHermann Hellwagner Preliminary comments on 21000-4 CD

11594J.J. ChaeJeho NamKwanyong KimTae-hee KimJae-Gon KimJin-Woo Hong Proposal of Additional MPEG-21 IPMP ToolDescription

11679Liu Yongliang Liu shaohuiYao HongxunHuang TiejunGao Wen some suggestions about IPMP

 

Wednesday Afternoon (14h00-17h30)

 Break Out: IPMP Components

MPEG-21 RDD (17h00- 18h00)

DIA Conformance Issues (13h30-14h30) 1504 (MDS Room) 

MPEG-21 RDD (17h00- 18h00)

MDS Plenary (14h30-15h00) 1504 (MDS Room)

11766 Myriam Amielh Proposed grammar for Logical Models

11575 Jiang ZhangLi ZhaoBin LiShiQiang Yang A Flexible License Management Scheme for Digital Rights Management11642 Sylvain Devillers Alexandre Cotarmanac'h Proposed modifications for gBS Schema MPEG-21 RDD

WWW site and Schema Issues (15h00-15h30)

1504 (MDS Room)

92

(17h00- 18h00)  DIA BoG (15h30-16h30) 1504 (MDS Room)     MPEG-21 RDD (17h00- 18h00)

MPEG-A Part 2/DRM (15h30-16h30) Audio

11760 Thomas SulzerBenjamin DornElion Chin Proposed New Descriptors For Perceptual Music Attributes

11718 Stefan KraegelohHarald Fuchs DRM Amendment for MPEG-A Part-2 (Music Player Application Format)

 MPEG-21 Conformance (16h30 - 17h00) with Integration   1504 (MDS Room)

 MPEG-21 Ref. SW (17h00 - 18h00) with Integration 1504 (MDS Room)MPEG Social Event (18h30 - midnight)  

Thursday Morning (09h00-12h30)

MPEG-21

MPEG-21 Transport and Stor. Reqts with MDS & Reqts (10h00-11h00) Reqts

11610

Itaru Kaneko (Tokyo Polytechnic University)Nobuyuki Kinoshita(mmg)Spencer Cheng (Morphbius Technologies)

Further study on Application Specific Binary Coding (ASBC) of MPEG-21 descriptors

 

MPEG-21MPEG-21 MAF (11h00-12h00) Reqts

     

MPEG-21RDD Requirements (12h00-12h30) Reqts

11556 Marc GauvinEva RodriguezJaime Delgado RDD versus 21000-1 (2nd edition) terms and definitions

11693 Chris Barlas Godfrey Rust RDD editors' response to M11556

 Thursday Afternoon (14h00-19h00)  

MPEG-21DIA BoG Reporting (14h00-14h30)  

MPEG-21 DIP BoG Reporting  

93

(14h30-15h00)     

MPEG-21ER BoG Reporting (15h00-15h30)  

     

MPEG-21IPMP BoG Reporting (15h30-16h00)  

     Plenary MDS and Reports of BoG (16h00 - 17h00)MPEG-21 FID BoG Reporting  MPEG-21 DID BoG Reporting  Review of Output documents, AHGs, CEs, DoC, Std (17h00- 18h00)

   Friday Morning (09h00-13h00)  Wrapping up (09h00 - 13h00) 1504 (MDS Room)

Approval of resolutions, AHGs and Output documents 

Friday Afternoon (14h00-21h00)  MPEG Plenary   Plenary roomContact: Ian S Burnett

xBreak Out 4480 Room  

Annex 8Video

Annex 9Audio

94

Audio Subgroup Report for the 71st

MPEG Meeting

Source: S. Quackenbush, Chair, Audio Subgroup

1 Opening of the meeting...........................................................................................................952 Administrative matters.............................................................................................................95

2.1 Approval of previous meeting report...................................................................................952.2 Approval of agenda and allocation of contributions............................................................952.3 Communications from the Chair..........................................................................................952.4 Joint meetings.......................................................................................................................952.5 Received National Body Comments and Liaison matters....................................................952.6 Task Groups.........................................................................................................................96

3 AhG meetings..........................................................................................................................963.1 MPEG-4 Audio Lossless Coding (Sunday 1000 – 1200).....................................................963.2 Scalable Speech and Audio Coding (Sunday 1300-1700)...................................................96

4 Audio plenary, joint meeting and task group activities...........................................................974.1 Review of AHG reports........................................................................................................974.2 Received national body comments and liaison matters........................................................974.3 Audio plenary discussions....................................................................................................974.4 Joint Meetings......................................................................................................................98

4.4.1 Joint with MDS, Req on Content Protection for MAF Music Player............................984.4.2 Joint with MDS, Req on technology demonstration: descriptors for mood attributes. .984.4.3 Joint with Requirements at Audio on use cases and requirements for CfI on Scalable Coding....................................................................................................................................98

4.5 Task Group discussions........................................................................................................984.5.1 MPEG-4 Audio Issues...................................................................................................984.5.2 Lossless Coding.............................................................................................................994.5.3 MPEG-7.......................................................................................................................1004.5.4 Symbolic Music Representation..................................................................................1014.5.5 Scalable Speech and Audio Coding CfI......................................................................101

5 Meeting deliverables..............................................................................................................1015.1 Press statement...................................................................................................................1015.2 Dispositions of Comments.................................................................................................1025.3 Responses to Liaison and NB comments...........................................................................1025.4 Recommendations for final plenary...................................................................................1025.5 Establishment of Ad-hoc Groups.......................................................................................1025.6 Approval of output documents...........................................................................................102

6 Future activities.....................................................................................................................1026.1 Schedule of future meetings...............................................................................................1026.2 Agenda for next meeting....................................................................................................1026.3 All other business...............................................................................................................1026.4 Closing of the meeting.......................................................................................................102

Annex A Participants...............................................................................................................103Annex B Audio Contributions and Schedule...........................................................................104

95

Annex C Task Groups.............................................................................................................107Annex D Output Documents....................................................................................................108Annex E Agenda for the 72nd MPEG Audio Meeting............................................................110

96

Opening of the meetingThe MPEG Audio Subgroup meeting was held during the 71st meeting of WG11, Jaunary 17-21, 2005, Hong Kong, CN. The list of participants is given in Annex A.

Administrative mattersApproval of previous meeting reportThe 70th Audio Subgroup meeting report had been previously distributed by e-mail and was approved.

Approval of agenda and allocation of contributionsThe agenda and schedule for the meeting was discussed, edited and approved. It shows the documents contributed to this meeting and presented to the Audio Subgroup, either in the task groups or in Audio plenary. The Chair brought relevant documents from Requirements, Systems and MDS to the attention of the group. It was revised in the course of the week to reflect the progress of the meeting, and the final version is shown in Annex B.

Communications from the ChairThe Chair summarised the issues raised at the Sunday evening Chair’s meeting, proposed task groups for the week, and proposed agenda items for discussion in Audio plenary.

Joint meetingsThe joint meetings with Audio over the course of the week are listed here and are reported on below.

Groups What Where Day TimeAudio, Requirements

11555 A scenario for Digital Item MAF usage in DRM context11695 Requirements for Digital Item MAF

Req Tue 9:00 – 10:30

Audio, MDS, Req. 11718, Stefan Kraegeloh Harald Fuchs, DRM Amendment for MPEG-A Part-2 (Music Player Application Format)

Audio Wed 15:30 – 16:00

Audio, MDS, Req. 11716, Proposed new descriptors for Mood Attributes

Audio Wed 16:00 – 16:30

Req, MDS MPEG-21 MAF Req Thu 11:00 – 12:00

Audio, Requirements

Scaleable Speech and Audio Req Audio Thur 14:00 – 14:30

Received National Body Comments and Liaison mattersThe NB Comments and Liaison documents for the meeting that require a response are as shown below.No. Title Response by11561 USNB Contribution: Audio lossless coding S. Quackenbush11584 GNB Comment on MPEG-4 lossless audio coding R. Sperschneider11608 SgNB Comment on MPEG-4 Audio Scalable Lossless

Coding Work ItemS. Rahardja

11562 USNB Contribution: Scalable Audio S. Quackenbush

97

Task GroupsTask groups were convened for the duration of the MPEG meeting, as shown in Annex C. Results of task group activities are reported below.

AhG meetingsIn order to obtain a compete view of the business of this MPEG meeting, discussion of contributions in AhG meetings are recorded in this section of the Audio report.

MPEG-4 Audio Lossless Coding (Sunday 1000 – 1200)Tilman Liebchen, TUB, presented 11660 Tilman Liebchen Proposed Core Experiment on Block Switching for MPEG-4

ALS

This proposes that block length switching be more flexible, that being Six block lengths are supported (differing by factors of 2, but in a “hierarchical” manner) Independent block switching for each stereo channel pair A maximum predictor order of 1023 (previously 255)

For the 16/24 data set, the proposal showed an average relative improvement (with respect to RM8) of 0.52 and 0.94 for block switching and maximum order 255, and block switching and maximum order 1023, respectively. At 24/192 each gives in improvement of approximately 0.22 percent. The block switching improvement decreases for longer word lengths; the maximum order improvement decreases for both longer word lengths and higher sampling rates.The proposal indicates that block switching always produces an improvement in compression, and does not increase the decoder complexity, which is interesting for e.g. downloaded music applications. Note that block switching does significantly increase the encoder complexity.Takehiro Moriya, NTT, presented11747 Takehiro Moriya Noboru Harada Yutaka

KamamotoProposal of CE on Long Term Prediction for ALS (Audio Lossless Coding)

This showed an average improvement in relative performance (with respect to RM8) of 0.68 for long term predictor of only one delay value but four “smoothing filter” values. Juergen Herre, FhG, commented that it would be very interesting to compare complexity of RM8 versus RM8 + LPT when both systems achieve same compression.

Scalable Speech and Audio Coding (Sunday 1300-1700)James Johnston, Microsoft, chaired this meeting. Anisse Taleb, Ericsson, presented11592 Anisse Taleb Contribution to the CfI on Scalable Audio and Speech Coding:

Additional Use Cases and Applications and the Corresponding Requirements

This presented several use cases. The main one was multimedia mobile broadcast, e.g. mobile television, in which the media signal consists of a video an audio signal. It is typical in this case that the video signal be allocated 60% of the channel bit rate and the audio 40%, and that the channel bitrate could be as low as 40 kb/s to 60 kb/s. Hence an audio coder that can operate at rates as low as 16 kb/s (for a mono signal) is required.The main requirements identified are:

Scalable Low rate Robust to frame losses Provide good performance for signals dominated by speech

98

Use cases identified are: Network switching. Scalable streaming bitstream format, for server-based scaling Preview/prelisten capability with differentiated QoS (with respect to download or paid

streaming)

The contribution suggests that reference codecs used in a potential MPEG Call for Information should be state of the art, and that WG11 should be sure to identify such codecs in the CfI. Finally, the contribution suggests a number of additional requirements for a potential MPEG work item.Bernhard Feiten, T-Nova, presented,11593 Bernhard Feiten Use cases for scalable audio coding

This contribution discussed the following use cases: Music download On-demand streaming Broadcast/Multicast streaming Music servers, i.e. reduce the number of coding formats that need to be supported

And the contribution also proposes some additional requirements.Juergen Herre, FhG, presented11657 Ralph Sperschneider on behalf of Philips FhG

Samsung Coding Technologies NEC France Telecom NTT I2R

Performance and functionality of existing MPEG-4 technology in the context of CfI on Scalable Speech and Audio Coding

This presents a comprehensive review of the MPEG-4 codecs that address the functionality of scalable bit rate. It then maps these MPEG-4 codecs onto the use cases presented in the draft CfI.The AhG Chair, Jim Johnston, began to construct a table summarizing the use cases and the requirements for each.

Audio plenary, joint meeting and task group activitiesReview of AHG reportsThere were no requests to review any of the AHG reports.

Received national body comments and liaison mattersThe Audio Chair presented the NB Comments listed in Section , which also indicates who will respond to those comments.

Audio plenary discussionsKristofer Kjörling, Coding Technologies, presented

11654 Kristofer Kjörling Werner Oomen Juergen Herre

Status report on Spatial audio coding RM0 development

This reported that the proponent companies, Coding Technologies, FhG, Philips, have had several face-to-face meeting in order to progress the integration of their technology to form RM0.Nermin Osmanović reported on the University of Miami effort to donate multichannel test items to MPEG. He expects this material to consist of:

48 kHz, 5.1 channel, 16-bit material for use in the Spatial Audio Coding work192 kHz, stereo, 24-bit material for use in the Lossless Audio Coding work

Jim Johnston, Microsoft, presented a table of candidate Use Case, Requirements and Reference Codecs for use in the Call for Information document. Bernhard Feiten, T-Systems, presented his candidate Use Case, Requirements and Reference Codecs for use in the Call for Information document. Considerable discussion followed.

99

Joint Meetings Joint with MDS, Req on Content Protection for MAF Music PlayerStefan Kraegeloh, FhG, presented

11718 Stefan Kraegeloh Harald Fuchs DRM Amendment for MPEG-A Part-2 (Music Player Application Format)

The contribution discusses what is already in common between MPEG, OMA and ISMA in terms of file format, content coding, content encryption and signalling. It observes that all build upon the ISO base media file format, and uses MPEG media coding technology. It proposes that AAC media coding, AES128 encryption and DRM signalling be added to the MAF music player so as to maximize the commonality between MPEG, OMA and ISMA.The Requirements Chair noted that this expands the scope of the current MAF Music Player requirements. The MDS Chair questioned whether this is appropriate MAF for DRM issues. The Requirements Chair requested that Audio describe the application scenario and requirements addressed by this contribution as AHG activity. See N6832 for current MAF application scenarios and requirements. Dave Singer, Apple, noted that, in his opinion, MAF with DRM seems to be a simple application. The consensus action from this joint meeting is that Audio will refine this contribution into a set of use cases and associated requirements and discuss them in a joint meeting with Requirements Thursday at 14:30. Audio might put those use cases and associated requirements in a separate Audio output document that MPEG can study, and expects additional work to occur in the AhG period.

Joint with MDS, Req on technology demonstration: descriptors for mood attributes

Elion Chin, Moodlogic, presented11760 Thomas Sulzer Proposed new descriptors for Mood Attributes

Elion Chin gave an overview of the Moodlogic technology. Paul Jessop, IFPI, noted that “knowing how to and agreeing on how to fill in the attribute fields” determines the extent of interoperability of the standard. The Requirements Chair requested that Audio construct use cases and requirements that address audio as well as other media types. This can be an AhG activity. These requirements will motivate a Call for Proposals, and at the next MPEG meeting it can be decided whether this will be an internal call (via WG11 resolution) or an open call.

Joint with Requirements at Audio on use cases and requirements for CfI on Scalable Coding

The requirements motivated by the use cases in the CfI were reviewed and approved by Requirements.

Task Group discussionsMPEG-4 Audio IssuesContrib No. Author Title Discussions / Conclusions11637 Sunghee Park Sang-

Wook Kim Y.B. Thomas Kim Miyoung Kim

Proposed Corrigenda for MPEG-4 BSAC

Summary: proposed corrigenda to MPEG-4 BSAC text, fixes ambiguities and typos in text and aligns text to reference softwareConclusion: No objections from the audio subgroup-> a) issue DCOR now, or

b) have "proposed DCOR" as output doc-> Maybe merge with further corrigenda issues (see M11661 and M11662, below)

11712 Heiko Purnhagen Werner Oomen

Proposed Study on 14496-3:2001/AMD 2:2004/DCOR 1 (SSC+PS)

Summary: minor clarifications for the DCOR currently under ballotConslusion: No objections from the audio subgroup-> Convert M11712 into "study on DCOR" output document

11661 Alexander Groeschel Andreas Schneider

Proposed Clarification of StreamMuxConfig

Summary: clarify CRC polynomial in StreamMuxConfigConclusion: No objections from the audio subgroup

100

definition -> FhG suggests to also add clarification as to what bits are protected, no objections, CT will take care-> Merge into BSAC (proposed) DCOR document (see M11637)

11662 Alexander Groeschel Andreas Schneider

Proposed clarification of usage of ProgramConfigElement in AudioSpecificConfig

Summary: clarification for byte alignment of PCE in ASC neededConclusion: Problem was acknowledged by the audio subgroup, some discussion on which "reference point" to use for byte alignment-> Samsung asks to re-visit this issue again later during this week-> Merge into BSAC (proposed) DCOR document (see M11637)

11663 Andreas Schneider Status report of Parametric Stereo Conformance

Summary: reports on bitstream status, more bitstreams under preparation, clarification proposed for bitstream conformanceConclusion: No objections from the audio subgroup, possible timeline for progressing PS conformance (to be re-visited during this week)-> a) have as next WD output doc, or

b) start PDAM at this meeting11676 Frans de Bont

Werner OomenStudy on Working draft for SSC conformance

Summary: reports on status, generation of bitstreams in progressConclusion: No objections from the audio subgroup-> have a new WD on SSC conformace as output doc from this meeting

11558 Schuyler Quackenbush

Proposed conformance working draft for MPEG-1/2 Audio in MPEG-4

Summary: presents conformance textConclusion: Several helpful comments from audio subgroup-> incorporate and issue WD on Friday

11559 Schuyler Quackenbush

Proposed reference software working draft for MPEG-1/2 Audio in MPEG-4

Summary: presents reference software textConclusion: Several helpful comments from audio subgroup-> incorporate and issue WD on Friday

Lossless Coding

Ralf Geiger, FhG, presented11720 Ralf Geiger Juergen Herre Approximation Accuracy of IntMDCT

This is an informative presentation associated with a core experiment concluded at the previous MPEG meeting. The data confirms that the new IntMDCT has good approximation accuracy, and that this contributes to good compression efficiency. However, based on an earlier CE, the IntMDCT actually shapes the noise in the frequency domain, such that higher frequencies (where there is little or no signal energy) have a lower noise floor. This provides improved compression even though it is less accurate.Ralf Geiger, FhG, presented11721 Ralf Geiger Proposed Stereo IntMDCT Signaling in SLS

The SLS specification and reference code has both a Mono IntMDCT and a Stereo IntMDCT. This contribution proposes to explicitly signal the use of each. The members of the Audio Subgroup agreed encores these changes. How to implement these changes in the specification will be discussed during the processing of the DoC.Rongshan Yu, I2R, presented11632 Rongshan Yu Xiao Lin Susanto Rahardja Proposed bit-stream syntax revision for MPEG-4 SLS

This contribution proposes the following changes to the SLS specification: 1. The creation of two AOT that permits it to better work in either an AAC core mode or non-

core mode2. The specification of audioSpecificConfiguration information for SLS3. Creation of a mechanism to achieve coarse-step scalability.4. Creation of <element><instance_tag> in the SLS enhancement layer signalling so that there

is an unambiguous association of enhancement and core elements.

This permits SLS to be signalled and to operate in a non-core mode. For core mode, the combination of AAC and SLS would be a new AOT. The audio subgroup agreed to adopt and integrate these proposals into the FPDAM document.Eunmi Oh, Samsung, presented

101

11753 Eunmi Oh Jung-Hoe Kim KiHyun Choo ChangYong Son

The functionality of FGS in audio scalable lossless coding (SLS)

This contribution shows how to exploit the properties of arithmetic coding to decode additional symbols beyond the point of truncation of an access unit. The number of symbols that can be decoded is probabilistic. The increase in “virtual bitrate” depends on sampling rate and word length, but is in the range of 0.9% to 3.7%. This proposal looks very promising, but needs additional discussion during the week.Tilman Liebchen, TUB, presented11659 Patrick Runge Tilman Liebchen Report on MPEG-4 ALS Core Experiment 9 (ACFC)

This presents a cross-check on the ACFC tool, and, in conclusion, supports the adoption of the ACFC tool. Subsequent discussion noted that ACFC will not give compression gain for all sets of material, and that more realistic floating-point test material is needed. Noboru Harada, NTT, presented11591 Noboru Harada Takehiro Moriya Proposal of CE for improved floating-point

compression using Masked-LZ (Lempel-Ziv compression with masked bit comparison) in ALS (Audio Lossless Coding)

This contribution proposes “Masked L-Z” coding as a means to code the residual signal resulting from the ACFC tool. It shows compression improvement, but has potential for performance improvement. Rongshan Yu, I2R, presented 11634 Haibin Huang Dong-Yan Huang

Rongshan Yu Xiao Lin Susanto Rahardja

Additional Information on Lossless Audio Coding

This contribution presented information on the status of porting the RLS/LMS to integer implementation. The current status is that I2R has completed the porting of LMS to a 64-bit integer implementation. The contribution provides performance figures for the CE proposal, but with RLS order set to 0 and an LMS average order of 550. Tilman Liebchen, TUB, noted two shortcomings of the proposal: first, that the complexity of the LMS prediction engine is quite high, and second, that the performance under constraints of random access is actually worse. The Audio Chair asked CE proponents to bring final evidence of performance of their technology at the next meeting. The Audio Subgroup agreed to draft a workplan such that final evidence is available at the 72nd MPEG meeting. Rongshan Yu, I2R, presented 11633 Rongshan Yu, Ralf Geiger, Susanto

Rahardja, Xiao LinUpdates on Status of Performance and Complexity of Lossless Audio Coding Architectures

The update provides an architecture block diagram for the SLS non-core mode, and adds additional information about the performance of both SLS modes. A section on use cases was added. Finally, the performance/complexity curves were presented for each Fs/Wd set. The Audio Chair urges all experts to carefully review the document. Tilman Liebchen, TUB, presented

11658 Tilman Liebchen Proposed Text of ISO/IEC 14496-3:2001/FPDAM 4, Audio Lossless Coding (ALS), new audio profiles and BSAC extensions

This presentation in fact occurred in closing Audio plenary. Since it was not different from the Study document output from the previous MPEG meeting, it was approved with minimal discussion

MPEG-7

Elion Chin, Moodlogic, presented

102

11760 Thomas Sulzer Proposed new descriptors for Mood Attributes

This contribution presented descriptors that can capture the mood, energy level, “valence,” genre, tempo, beat, lyrical topic, etc. for songs. They currently have a user community of more than 1 million that have catalogued many millions of songs. The descriptors support e.g. the generation of music playlists based on finding songs that cluster around some point in a “mood” perceptual space. Such a point could even be specified as a “seed song.”An interested community manually enters the Moodlogic descriptor values via the Internet. Petar Goulev, Imperial College, remarked that he is interested in the real-time measurement of the mood of a listener as he or she reacts to a music presentation.Matthias Gruhne, FhG, presented11723 Matthias Gruhne Proposed descriptor for Enhanced Audio Identification

Symbolic Music Representation

Yong-Soo Choi, Kangwon National Univerity, presented11630 Hyoung-Joong Kim Yong-Soo Choi Yong-Ju

ChoSMR On the Korean Symbolic Music Representation

This contribution presented a SMR for traditional Korean music. The Audio SMR experts regarded it as a very interesting proposal that may be easily integrated into an available core technologyGiorgio Zoia, EPFL, reviewed the status of the 4 responses to the SMR CfP, which are:11542 David Crombie Roger Lenoir Neil McKenzie Proposed Technology for accessible SMR decoders11554 Maurizio Campanai; Pierfrancesco Bellini; WEDELMUSIC as SMR proposal11560 G. Bertoni Proposal for Braille Music Symbolic Representation11601 Tillman Weyde Hartmut Ring Proposal for Symbolic Music Representation Format

Contributions 11554, and 11601 are both quite comprehensive and address most aspect of the requirements. Contributions 11542 and 11560 are much narrower in scope. The completeness of the submissions will be verified at this MPEG meeting. The merit of the contributions will be evaluated at the AhG meeting in February 2005 in Paris. Symbolic Music Representation activity at the 71st meeting has been mainly dedicated to a preliminary review of documentation received from respondents to the Call for Proposal. Main documents (m11542, m11554, m11560, m11601) and additional material have been checked and a consolidation period until the AHG meeting in February (where evaluation will be started) has been decided. As an output, a workplan for the overall evaluation process has been approved and a report on results will be available at the 72nd meeting, possibly allowing the selection of RM0.In addition to the four documents above, a contribution proposing technology for the integration of traditional Korean Music format has been received (m11630). This document, even if not supported by all the information and test material required by the CfP, has been reviewed by the Audio subgroup and regarded as a very interesting proposal that may be easily integrated into an available core technology. Starting from the 72nd MPEG meeting authors will be requested to prepare a detailed integration proposal in relation to RM0.

Scalable Speech and Audio Coding CfI

Jim Johnston, Microsoft, presented his use case that motivates the requirements for the CfI. There was considerable discussion, both Thursday afternoon and Friday morning on the CfI text. This discussion resulted in the final CfI text found in document N7040, Call for Information on Scalable Speech and Audio Coding.

Meeting deliverablesPress statementThe Audio part of the press statement was prepared.

103

Dispositions of CommentsThe DoC were prepared and approved.

Responses to Liaison and NB commentsLiaison initiated by Audio were prepared and approved. The responses to the NB comments were prepared and approved.

Recommendations for final plenaryThe Audio recommendations were presented and approved.

Establishment of Ad-hoc GroupsThe following ad-hoc groups were established by the Audio subgroup:

No. Title Mtg7043 AHG on Audio Standards Maintenance No7044 AHG on Audio Coding Tool Repository No7045 AHG on MPEG-7 Audio No7046 AHG on Spatial Audio Coding No7047 AHG on MPEG-4 Lossless Audio Coding Yes7048 AHG on Symbolic Music Representation Yes7049 AHG on Exploration of Scalable Speech and Audio Coding No

Approval of output documentsAll output documents, shown in Annex D, were presented in Audio plenary and were approved.

Future activitiesSchedule of future meetingsAd Hoc group meetings are indicated in Section . Unless otherwise indicated, Ad Hoc group meetings will be held at the location of the next MPEG meeting on the weekend preceding that meeting.

Agenda for next meetingThe agenda for the next MPEG meeting is shown in Annex E

All other businessThere was none.

Closing of the meeting The 71st Audio Subgroup meeting was adjourned Friday at 14:15. The Chair offered to buy all Audio delegates the refreshing beverage of their choice on the next unlikely occasion that the closing Audio plenary is a calm, relaxing or even boring event.

104

Annex A ParticipantsFirst Name Last Name Country Affiliation E-mail addressElion Chin US MoodLogic elion@moodlogic.comKok Seng Chong SG Panasonic Singapore kschong@psl.com.sgBenjamin Dorn US MoodLogic b.dorn@calcag.comBernhard Feiten DE Deutsche Telekom bernhard.feiten@t-systems.comMatt Fellers USA Dolby mcf@dolby.comRalf Geiger DE FhG IIS ggr@iis.fraunhofer.dePetar Goulev UK Imperial College goulev@imperial.ac.ukBernhard Grill DE FhG IIS grl@iis.fraunhofer.deMatthias Gruhne DE FhG IIS AEMT ghe@emt.iis.fhg.deHsueh-Ming (Ming)

Hang USA National Chiao Tung Univ., Taiwan hmhang@mail.nctu.edu.tw

Jürgen Herre DE FhG IIS hrr@iis.fhg.deBoehm Johannes CE Thomson Johannes.Boehm@Thomson.netJames Johnston USA Microsoft jamesdj@microsoft.comSang-Wook Kim KR Samsung swkim@samsungait.comDong Soo Kim KR LG Electronics mahlerian@lge.comKristofer Kjörling S Coding Technologies kk@codingtechnologies.comMarc Klein

MiddelinkNL Philips marc.klein.middelink@philips.com

Tilman Liebchen DE TU Berlin liebchen@nue.tu-berlin.deTakehiro Moriya JP NTT t.moriya@ieee.orgToshiyuki Nomura JP NEC t-nomura@da.jp.nec.comTakeshi Norimatsu JP Panasonic Norimatsu.takeshi@jp.panasonic.comEunmi Oh KR Samsung sait@samsung.comNermin Osmanović USA Univ. of Miami n.osmanovic@umaimi.eduSunghee Park CN HKUST sunghee@pixtree.comPierrick Philippe FR France Telecom R&D pierrick.philippe@francetelecom.comHeiko Purnhagen S Coding Technologies hp@codingtechnologies.comSchuyler Quackenbush USA ARL srq@audioresearchlabs.comSusanto Rahardja SG I2R rsusanto@i2r.a-star.edu.sgJean Bernard Rault FR France Telecom R&D jeanbernard.rault@francetelecom.comAndreas Schneider DE Coding Technologies snd@codingtechnologies.comJeongil Seo KR ETRI seoji@etri.re.krRalph Sperschneider DE FhG IIS ralph.sperschneider@iis.fraunhofer.deAnisse Taleb SE Ericsson AB anisse.taleb@ericsson.comIngo Wolf DE Deutsche Telekom WolfI@t-systems.deLin Xiao SG I2R linxiao@i2r.a-star.edu.sgRongshan Yu SG I2R rsyu@i2r.a-star.edu.sgGiorgio Zoia CH EPFL giorgio.zoia@epfl.ch

105

Annex B Audio Contributions and ScheduleTime Agenda ItemNumber Title Source Complete

Sunday1000-1200 AHG on Lossless Coding - ALS11660 Tilman Liebchen Proposed Core Experiment on Block Switching for MPEG-4

ALSX

11747 Takehiro Moriya Noboru Harada Yutaka Kamamoto

Proposal of CE on Long Term Prediction for ALS (Audio Lossless Coding)

X

11752 S.R. Quackenbush Cross-Check of Proposed ALS Core Experiment X

1300-1700 AHG on Scalable S/A Coding11592 Anisse Taleb Contribution to the CfI on Scalable Audio and Speech Coding:

Additional Use Cases and Applications and the Corresponding Requirements

X

11593 Bernhard Feiten Use cases for scalable audio coding X11657 Ralph Sperschneider on behalf of Philips

FhG Samsung Coding Technologies NEC France Telecom NTT I2R

Performance and functionality of existing MPEG-4 technology in the context of CfI on Scalable Speech and Audio Coding X

Monday0900-1300 MPEG Plenary1300-1400 Lunch1400-1800 Audio Plenary  Opening of the meeting Audio Chair

Administrative mattersApproval of agenda XApproval of 70th MPEG meeting report XCommunications from the Chair- Review of Sun Chairs meeting

X

Allocation of contributions to agenda and schedule

X

Joint meetings XReview of AhG reports X

11492 Ralph Sperschneider AHG on Audio Standards Maintenance X11493 M. Gruhne AHG on MPEG-7 Audio X11494 S. Quackenbush AHG on Spatial Audio Coding X11495 Tilman Liebchen AHG on MPEG-4 Lossless Audio Coding X11496 Paolo Nesi Giorgio Zoia AHG on Symbolic Music Representation X11497 Jim Johnston AHG On Exploration of Scalable Audio and Speech Coding X

Task groups and mandates XNational body comments

11561 Andy Tescher for the USNB USNB Contribution: Audio lossless coding X11562 Andy Tescher for the USNB USNB Contribution: Scalable Audio X11584 Ralph Sperschneider on behalf of the

German National BodyGNB Comment on MPEG-4 lossless audio coding X

11608 Singapore NB SgNB Comment on MPEG-4 Audio Scalable Lossless Coding Work Item

X

Ballot comments11508 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 13818-1:2000/FDAM 5 [SC 29 N

6368]X

11572 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 13818-4:2004/FDAM 1 X11520 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-3:2001/PDAM 4 X11521 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-3:2001/PDAM 5 X11523 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-5:2001/FDAM 6 X

1400-1600 Plenary discussions11654 Kristofer Kjörling Werner Oomen Juergen

HerreStatus report on Spatial audio coding RM0 development X

1800- HOD Meeting

Tuesday0900 Audio Plenary Audio Chair

Outline plan for the day

0900-1130 MPEG-411637 Sunghee Park Sang-Wook Kim Y.B.

Thomas Kim Miyoung KimProposed Corrigenda for MPEG-4 BSAC X

106

Time Agenda ItemNumber Title Source Complete11712 Heiko Purnhagen Werner Oomen Proposed Study on 14496-3:2001/AMD 2:2004/DCOR 1

(SSC+PS) X

11661 Alexander Groeschel Andreas Schneider Proposed Clarification of StreamMuxConfig definition X11662 Alexander Groeschel Andreas Schneider Proposed clarification of usage of ProgramConfigElement in

AudioSpecificConfig X

11663 Andreas Schneider Status report of Parametric Stereo Conformance X11676 Frans de Bont Werner Oomen Study on Working draft for SSC conformance X11558 Schuyler Quackenbush Proposed conformance working draft for MPEG-1/2 Audio in

MPEG-4 X

11559 Schuyler Quackenbush Proposed reference software working draft for MPEG-1/2 Audio in MPEG-4

X

11:30 - 1200

Scalable S/A CfI

1200-1300 Lunch

1300-1400 MPEG-711723 Matthias Gruhne Proposed descriptor for Enhanced Audio Identification X11760 Thomas Sulzer Proposed new descriptors for Mood Attributes X

1400-1530 Lossless - SLS11632 Rongshan Yu Xiao Lin Susanto Rahardja Proposed bit-stream syntax revision for MPEG-4 SLS X11720 Ralf Geiger Juergen Herre Approximation Accuracy of IntMDCT X11721 Ralf Geiger Proposed Stereo IntMDCT Signaling in SLS X11753 Eunmi Oh Jung-Hoe Kim KiHyun Choo

ChangYong SonThe functionality of FGS in audio scalable lossless coding (SLS)

X

1630-1800 SMR11542 David Crombie Roger Lenoir Neil

McKenzieProposed Technology for accessible SMR decoders X

11554 Maurizio Campanai; Pierfrancesco Bellini; WEDELMUSIC as SMR proposal X11560 G. Bertoni Proposal for Braille Music Symbolic Representation X11601 Tillman Weyde Hartmut Ring Proposal for Symbolic Music Representation Format X11630 Hyoung-Joong Kim Yong-Soo Choi Yong-

Ju ChoSMR On the Korean Symbolic Music Representation X

1800-1815 Audio PlenaryStatus for Chairs Meeting

1900- Chairs Meeting

Wednesday0900-1100 MPEG Plenary

1400-1530 Lossless - SLS1530-1630 Lossless - ALS11591 Noboru Harada Takehiro Moriya Proposal of CE for improved floating-point compression using

Masked-LZ (Lempel-Ziv compression with masked bit comparison) in ALS (Audio Lossless Coding)

X

11659 Patrick Runge Tilman Liebchen Report on MPEG-4 ALS Core Experiment 9 (ACFC) X

1300-1400 Lunch

11633 Rongshan Yu Susanto Rahardja Xiao Lin Updates on Status of Performance and Complexity of Lossless Audio Coding Architectures

X

11634 Haibin Huang Dong-Yan Huang Rongshan Yu Xiao Lin Susanto Rahardja

Additional Information on Lossless Audio Coding X

1530-1630 Joint with Req, MDS at Audio MAF-MP and MPEG-7 11718 Stefan Kraegeloh Harald Fuchs DRM Amendment for MPEG-A Part-2 (Music Player

Application Format)X

11760 Thomas Sulzer Proposed new descriptors for Mood Attributes X

1700-1800 CfI

1830-2200 Social

Thursday

1000-1300 CfI

107

Time Agenda ItemNumber Title Source Complete

1300-1400 Lunch

1400-1500 Joint with Audio, Requirements Scaleable Speech and Audio CfIAudio player and DRM use casesPerceptual music attributes

1500-1600 CfI

1730-1800 Audio PlenaryStatus for Chairs Meeting

1800- Chairs Meeting

Friday

0900-1300 Audio PlenaryReport on Chairs meeting and outline of plan for the day Audio Chair

11658 Tilman Liebchen Proposed Text of ISO/IEC 14496-3:2001/FPDAM 4, Audio Lossless Coding (ALS), new audio profiles and BSAC extensions

Dispositions of commentsResponses to NB commentsLiaison statementsRecommendations for final plenaryEstablishment of new Ad-hoc groupsApproval of output documentsPress statementAgenda for next meetingA.O.B.Closing of the Audio meeting

1300-1400 Lunch

1400- MPEG Plenary

108

Annex C Task Groups1. MPEG-4 Audio Issues

Chair: S. QuackenbushMandates:1.1. Review contributions1.2. Prepare text on MP3on4 WD on Conformance and Reference Software1.3. MPEG-4 Edition 2005 progress

2. Lossless CodingChair: S. QuackenbushMandates:2.1. Review contributions2.2. Review CE status2.3. Review latest performance results2.4. Prepare DoC on 14496-3:2001/PDAM 4, ALS2.5. Prepare Text of 14496-3:2001/FPDAM 4, ALS2.6. Prepare DoC on 14496-3:2001/PDAM 5, SLS2.7. Prepare Text of 14496-3:2001/FPDAM 5, SLS2.8. Prepare DoC on 14496-3:2001/FPDAM 6, Lossless coding of 1-bit oversampled signals2.9. Prepare Text of 14496-3:2001/FDAM 6, Lossless coding of 1-bit oversampled signals

3. MPEG-7Chair: Matthias GruhneMandates:3.1. Review contributions3.2. Prepare Text of 15938-4:2002/PDAM 2, High-Level Description Extensions3.3. Produce appropriate workplan documents

4. Spatial Audio CodingChair: S. QuackenbushMandates:4.1. Review contributions4.2. Produce workplan for RM0, including verification listening test and report

5. Music Application FormatChair: S. QuackenbushMandates:5.1. Review contributions

6. Symbolic Music RepresentationChair: P. Nesi, G. ZoiaMandates:6.1. Review contributions

7. Scalable Speech and Audio CodingChair: J. JohnstonMandates:7.1. Review contributions7.2. Revise CfI7.3. Recommend next steps in exploration

Standards under Development:Name Description Progress to14496-3:2001/AMD 4 ALS FPDAM14496-3:2001/AMD 5 SLS FPDAM14496-3:2001/AMD 6 Lossless coding of 1-bit oversampled signals FDAM14496-4:2001/AMD X MP3onMP4 Conf WD14496-5:XXX/AMD X MP3onMP4 Ref Sw WD15938-4:2002/AMD 2 High-Level Description Extensions PDAM

109

Annex D Output DocumentsMPEG-2No. Title TBP Available

13818-7 MPEG-2 Audio7014 Proposed Fourth Edition of MPEG-2 AAC No 05/01/21

MPEG-4

No. Title TBP Available14496-3 MPEG-4 Audio

7015 DoC on 14496-3:2001/PDAM 4, ALS No 05/01/217016 Text of 14496-3:2001/FPDAM 4, ALS Yes 05/01/217017 DoC on 14496-3:2001/PDAM 5, SLS No 05/01/217018 Text of 14496-3:2001/FPDAM 5, SLS Yes 05/02/04

7019 DoC on 14496-3:2001/FPDAM 6, Lossless coding of 1-bit oversampled signals

No 05/01/21

7020 Text of 14496-3:2001/FDAM 6, Lossless coding of 1-bit oversampled signals

No 05/01/21

7021 Study on 14496-3:2001/AMD 2:2004/DCOR 1:200x No 05/01/217022 Proposed DCOR on MPEG-4 Audio No 05/01/21

7023 Status of Performance and Complexity of MPEG Lossless Audio Coding Architectures

No 05/01/21

7024 Application Scenarios for ALS and SLS No 05/01/217025 Workplan for Audio Lossless Coding (ALS) No 05/01/217026 Workplan for Scalable Lossless Coding (SLS) No 05/01/217027 Proposed MPEG-4 Audio Third Edition No 05/01/21

No. Title TBP Available14496-4 MPEG-4 Conformance

7028 Working Draft of High Quality Parametric Audio Conformance No 05/01/217029 Request for Parametric Stereo Conformance Amendment No 05/01/217030 Text of 14496-4:2004/PDAM 11, Parametric Stereo Conformance No 05/01/217031 Working Draft of Conformance for MPEG-1/2 Audio in MPEG-4 No 05/01/217032 Working Draft of Audio BIFS Version 3 Conformance No 05/01/217033 Status of MPEG-4 Audio Conformance No 05/01/21

No. Title TBP Available14496-5 MPEG-4 Reference Software

7034 Working Draft of Reference Software for MPEG-1/2 Audio in MPEG-4 No 05/01/21

MPEG-7

No. Title TBP Available15938-4 MPEG-7 Audio

7035 Request for Amendment on MPEG-7 Audio High-Level Description Extensions

No 05/01/21

7036 Text of 15938-4:2002/PDAM 2, High-Level Description Extensions No 05/02/18

110

7037 Workplan for MPEG-7 Audio No 05/01/21

Explorations and support

No. Title TBP AvailableMusic notation

7038 Workplan for the Evaluation of Responses to the CfP on SMR No 05/01/21

No. Title TBP AvailableSpatial audio coding

7039 Workplan for MPEG-4 Spatial Audio Coding No 05/01/21

No. Title TBP AvailableScalable Speech and Audio Coding

7040 Call for Information on Scalable Speech and Audio Coding Yes 05/01/21

No. Title TBP AvailablePromotion

7041 MPEG Audio Codecs History and Tools No 05/02/04

No. Title TBP Available23001-2 Application Formats: Music Player

7042 Proposed Applications Scenarios and Requirements for Protected Music Player MAF

No 05/01/21

111

Annex E Agenda for the 72nd MPEG Audio Meeting

Agenda Item1. Opening of the meeting2. Administrative matters

2.1. Approval of agenda2.2. Approval of 71st meeting report2.3. Communications from the Chair2.4. Allocation of contributions2.5. Joint meetings2.6. Review of AhG reports2.7. Review of task groups and mandates2.8. Received national body comments and liaison matters2.9. Plenary issues

3. Task group activities3.1. MPEG Maintenance3.2. MPEG-43.3. MPEG-4 Lossless Coding3.4. Spatial Audio Coding3.5. MPEG-7 Audio3.6. MPEG-Music Player Application Format3.7. Symbolic Music Notation

4. Discussion of unallocated contributions5. Meeting deliverables

5.1. Press statement5.2. Dispositions of comments5.3. Responses to NB comments5.4. Responses to Liaison statements5.5. Recommendations for final plenary5.6. Establishment of new Ad-hoc groups5.7. Approval of output documents

6. Future activities6.1. Agenda for next meeting

7. A.O.B.8. Closing of the meeting

112

Annex 10SNHC report

Source: MPEG-4 SNHCTitle: SNHC Hong Kong meeting reportAuthors: Mahnjin Han (Samsung AIT), Mikaël Bourges-Sévenier (Mindego Inc.)

SNHC meeting reportHong Kong, January 17-21, 2005

Opening of the Meeting

Approval of the agenda

Goals for the weekThe goals of this week are:

Review on-going AFX CE and explorations Review on-going GFX

113

ScheduleMonday Tuesday Wednesday Thursday Friday

:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30:00:30

20

21

22

Time

16

17

18

19

12

13

14

15

08

09

10

11

Lunch break

MPEG Plenary

Lunch break Lunch breakLunch break

Lunch break

MPEG Plenary

MPEG Plenary

Roll call, agendaFAQ

11628115511155211553GFX status report

Liaison

ChairsChairs

11710, 117251170211626

11715, 11716, 11582video/snhc in snhc11626 w/ Req. in SNHC

11423

Social event

Demos in Systems

1160911705

11699

1162311729Profile

Future of SNHC

RSW b/o

11729 cont.1172211711

GFX b/o

1170111619

GFX b/o

Profile

Physics

GFX b/o

Future of SNHC

FAQ

11626 w/ Req. in SNHC

11423

AFX CE reviewAFX exploration review

GFX status report

FAQ

Document reviewAhG set upDocument numberattributionFAQ

114

Allocation of joint meetingsSub-Groups Monday Tuesday Wednesday Thursday Friday

SystemsRequirements 12:00 in SNHC 09:00 in SNHC

MPEG-7 Video

Video/3DAV 11:00 in SNHCMDS

Rooms allocationSNHC 1403 (Breakout for GFX 4483)Systems 1401Requirements 2465Video 2464Chairs/HoD/Liaisons 2512

Allocation of contributions

N° Title Schedule ActivityD1 Monday D1

MPEG Plenary D1 09h00-14h00

MPEG Gen.

Report of AhG on AFX documents, CEs and software Marius PredaReport of AhG on MPEG-J extensions Mikaël Bourges-

SévenierSNHC D1 15h00-

16h30SNHC Gen.

Roll call, Agenda, Web site Mahnjin Han 15:00FAQ Jeong-Hwan, all 15:30SNHC D1 16h30-

18h00AFX

115

N° Title Schedule Activity11710 Editorial issues for AFX COR1 Marius Preda

Françoise Preteux16:00

11725 MeshGrid implementation into AFX encoder: Donation to ISO Alexandru Salomie11702 Multiresolution Geometry demonstration on the AFX website Patrick Gioia11626 Proposal for Mobile 3D Compression Profile Tae-Joon Park

Mahnjin Han17:00

SNHC breakout D1 16h30-18h00

GFX

11609 HI Corp's comment on the ISO/IEC 14496-21 CD (MPEG-J extension for rendering)

Itaru Kaneko,Mark Callow

16:30

11705 Considerations and updates to GFX APIs Mikael Bourges-Sevenier

17:00

Systems D1 18h00-19h00

Systems

Demos: FT 18h30D2 Tuesday D2

SNHC D2 9:00 – 12:00

3DMCF

11699

Results on Core Experiment E1, Mesh Compression Framework

Aljoscha SmolicKarsten MuellerMatthias KautznerThomas Wiegand

9:00

11623 Technical Issues in 3D mesh compression Euee S. JangDaiyong KimSunyoung LeeEunyoung ChangChunghyun Ahn

10:15

11729 3D CGI Films Coding Mario GutierrezFrederic VexoKhaled Mamou Marius Preda

11:00

116

N° Title Schedule ActivityFrancoise Preteux

Profile discussion 11:30SNHC+Req. in SNHC D2 12:00 –

13:30Profile

11626 Proposal for Mobile 3D Compression Profile Tae-Joon ParkMahnjin Han

12:00

SNHC D2 14:30 – 16:30

Physics

11628 Survey and proposal on existing physics model Seyoon Tak Jeong-Hwan Ahn James D. K. Kim

14:30

11551 CE Report for Physically-Based Animation Part 1: Survey of Physics Models and Applications

Thomas Di Giacomo Etienne LyardNadia Magnenat-ThalmannMarius PredaFrancoise Preteux

11552 CE Report for Physically-Based Animation Part 3: PhysicsShapeProperty Etienne LyardThomas Di GiacomoNadia Magnenat-ThalmannMarius PredaFrancoise Preteux

11553

CE Report for Physically-Based Animation Part 4: PhysicsBoneProperty

Thomas Di GiacomoEtienne LyardNadia Magnenat-ThalmannMarius PredaFrancoise Preteux

SNHC D2 16:30 – 18:00

SNHC Gen

117

N° Title Schedule ActivityGFX status report Mikael Bourges-

Sevenier16:30

Discussion on Future of SNHC All 17:00D3 Wednesday D3

MPEG Plenary D3 09h00-11h30

MPEG Gen.

SNHC + Video in SNHC D3 11h30-12h15

3DAV

11715 Results on Exploration Experiment: Multi-View Synthesis Reconstruction using DIBR Nodes

Eddie CookeAljoscha SmolicNoel O'Connor

11:00

11716 Proposal for Specification of 3D Camera Parameters Eddie CookeNoel O'ConnorAljoscha Smolic

11582 A Framework for Multi-view Video Coding using Layered Depth ImageYo-Sung HoSeung-Uk YoonSung-Yeol Kim

SNHC D3 12h15-13:00

Profile

Profile discussion

SNHC D3 14h00-18:00

3DMCF, MFR

FAQ – review the new structure 14:0011729 Continued presentation on 3D CGI Films Coding 14:3011711 VertexImage: Encoding Animated Geometry as Rectangular Video Marius Preda

Francoise Preteux15:00

11722 Encoding of Dynamic Meshes with MeshGrid (Part 1) Alexandru SalomieAneta MarkovaRudi DeklerckAdrian MunteanuPeter Schelkens

118

N° Title Schedule ActivityDiscussion on 3D Mesh Compression Framework 16:00

11701 Result for the CE on Multiresolution Footprint-based Representations - IM1 implementation

Patrick GioiaJérôme Royan

17:00

11619 Proposal for 3D building representation Minh Tuan LeHae-Kwang KimCong Du Nguyen

D4 Thursday D4SNHC+Req.+Systems in SNHC D4 09:00 –

10:00Profile

11626 Proposal for Mobile 3D Compression Profile Tae-Joon ParkMahnjin Han

SNHC D4 10h00-13h30

AFX

Physics discussion 10:00Future of SNHC discussion 11:00SNHC D4 14h30-

18h00SNHC Gen

SNHC output document review (Amd1, COR1, CE) 14:30GFX status reportFAQ

D5 Friday D5SNHC D5 9h00-

13h00SNHC Gen.

Document number attribution and resolutions 9:00FAQMPEG Plenary D5 14h00-

22h00MPEG Gen.

119

General issues

Web siteThe SNHC Web site is http://www.sait.samsung.co.kr/snhc/ A new web site will be made until the next meeting

AFX Reference softwareThe AFX Reference Software has been transferred to NIST and is available via CVS at

1. Register your login/password at http://mpeg.nist.gov/reg/login_new.php2. :pserver:<your login>@mpeg.nist.gov:/big/mpegcvs3. <your password>4. Checkout "MPEG-4/Systems2/IM1" module (case sensitive).

http://www-artemis.int-every.fr/~preda showcases some technologies developed by SNHC. We are asking for more contributions to update this web page with demonstrations. The Player3D is provided in binary form so that non-MPEG interested parties can play those contents.

A breakout meeting was held Tue. 6:00pm in SNHC room for reorganizing RSW.Cleaned up parts of the Ref. S/W document and CVS repository.Need to continue this activity until next meeting.

AFX encoder and other toolsNew tool addedMeshGrid encoder complements AFX encoder features

Standards from SNHCIn red, status reached at this meeting. In yellow, status reached at next meeting. Projects that reached International Standard status have been removed.

Std Pt Edit. Project Description CfP WD CDPDAMDCOR

FCDFPDAM

FDISFDAMCOR

4 11 2003 Amd.4 XMT and MPEG-J extensions

03/12 04/07 05/01

4 16 2004 Amd.1 AFX extension 03/07 04/07 05/01 05/074 16 2004 Cor.1 AFX Corrigendum 04/03 04/07 05/014 21 2005 MPEG-J extensions

for rendering03/12 04/07 04/10 05/04 05/10

Attendance list .

Name Country CompanyMahnjin Han Korea Samsung AITMikael Bourges Sevenier USA Mindego Inc.Francisco Moran Burgos Spain UPM

120

Etienne Lyard Switzerland

Univ. of Geneva

Samuel Cruz-Lara France LORIA/INRIA LorraineEun-Young Chang Korea ETRIPatrick Gioia France France Telecom R&DTae-Joon Park Korea ETRISeong Won Ryu Korea ETRIFrederic Vexo Switzerl

andEPFL/IC/ISIM-VRlab

Francoise Preteux France INTHae-Kwang Kim Korea Sejong Univ.Minh Tuan Le Korea Sejong Univ.Alexandru Salomie Belgium VUBThomas Di Giacomo Switzerl

andMIRALab, U. of Geneva

Rodolfo Lopez Pintor Spain Telefonica R&DMark Callow Japan HI CorporationMarius Preda France INTEuee S. Jang Korea Hanyang Univ.Sunyoung Lee Korea Hanyang Univ.Dai Yong Kim Korea Hanyang Univ.Jeong Hwan Ahn Korea Samsung AITHelge Drumm Germany Technical Univ. of Illmenau

SNHC FAQJeong-Hwan has kindly volunteered to be the editor of this documentWe need to restructure the FAQ to make it more readable.

- restructure the document and update the text- remove outdated questions and update outdated answers- overview of the specific technologies should be rewritten and technologies in

14496-16/FPDAM1 and 14496-11/FDAM4 should be added- Need 4 weeks editing period

Future of SNHC

Discovering Problems and possible solutions: How can we better promote SNHC to the market? Problems

Possible solutions and action items There is no solution for making MPEG-4 3D contents.

We can make our own players available together with authoring tool As a starter, we need at least an exporter plug-in for the widely used authoring tools in

the market (ex. MAYA, 3ds max) to be used by designers Launch an open source project for developing MPEG-4 3D tools make MPEG-4

SDK + applications + demo contents

We need to think what is the application of the 3D graphics? (ex. Games) Then we need to find out which application needs a standard at content level, instead of H/W or OS level. Also, among those applications, what is the killer app?

121

It is hard to read the MPEG-4 specification and hard to implement the system architecture Write an overview of MPEG-4 3D tools for promotion

MPEG-4 Systems is too heavy for mobile which is a platform where 3D standard is most needed now. The on-going work on AFX profile dimension and GFX are our current solution.

Less serious items that were recommended during the brainstorming session Very difficult to develop 3D content in general (time and money and hard to make). We

need a low cost and easy authoring solution. We strongly recommend companies in SNHC to develop products using MPEG-4 3D tools We have missed the timing for promotion. The reference software is not competitive enough in the sense of performance (speed,

memory, cost, etc.) MPEG is too generalized for some applications. Licensing is another drawback. (almost all standards are royalty free) The others (VRML and Web3D) have the similar problem, in the sense that they are not

successful in the market also. Size of the market should grow more in order for us to succeed = chicken and egg problem?

We need to be aggressive and try to grow the market with our technologies There are competitors in the market with full chain of solution from authoring to playing

(Macromedia (Shockwave3D), Java 3D, etc.) Emphasize the added values of MPEG, which are compression and streaming

AFX activities

Specifications updatesThe list of modifications for existing specifications handled by SNHC is as follows.

Part 16/COR1Additional corrigendum issue

- Default value for scale in BBA should be changed to 1 1 1.Issue COR1 this meeting

Part 16/AMD1No modification this meeting.Issue AMD1 and its DoC using the study document from the last meeting

Part 21Issue a study text for CD

AFX General issues

M11710 – Editorial issues for AFX COR1The proposed fix is a bug and will be added to the AFX COR.

122

M11725 – MeshGrid implementation into AFX encoder: Donation to ISOThe addition of MeshGrid part of AFX Encoder for XMT.Thanks to VUB for the donation.

M11702 – Multiresolution Geometry demonstration on the AFX websiteDemonstration about real time reconstruction of WSS.This is also demonstrated in Systems demo session.

Profiles

M11626 – Proposal for Mobile 3D Compression ProfileProposed by Korean Mobile 3D Standardization Forum (supported by TTA and composed of mobile phone manufacturers, telecommunication service providers. solution providers and content providers)The forum needs a standard for efficient 3D contents (compressed 3D model and animation data) without MPEG-4 Systems layer.Proposed a set of 3D compression tools in MPEG for mobile applications

DiscussionBIFS is not used in this profile. It is only the elementary streams of 3D compression tools.If the scenegraph does not exist, how can the decoded data be used in the scene? à That’s up to the application developers to manage the scene in the API level.We need some numbers for each level (such as numbers of triangles or bones). However, the numbers were removed in the original proposal because the Korean M3DS Forum felt that the numbers won’t have any meaning for the users (service providers). They wanted to leave it to the service providers and let the application decide on the complexity. Such numbers are considered to be a moving target and so the number will change rapidly. However, we will still need minimal requirements for proposed applications. For example, the global numbers such as ‘how many 3DMC streams will you allow’ and tool specific number such as number of triangles or number of bones. To know the global numbers, we need to know the complexity of each tool in the profile. We will have support from ISG on this activity. We also need to add a recommendation to have a related container in the form of scene description in the standard (the node spec).More supporting companies added: France Telecom, INT

Joint with Requirements + Systems (Thursday)Discussion

123

Package streamObject

Scene

à AFXà Object Type

à Profile

(List of tools)

LevelLevel

AFX Profile Dimension

AFX profiling dimension to be addedPackage stream will be defined in AFX (package stream is one object)Object has an object type (defined in AFX). In other words, object type is the characteristic of object.Objects are added in the scene and this is defined in profile (in AFX). In other words, profile is the characteristics about the scene defining the type of objects supported in the scene.In profile, there’s only one object typeAnd profile is refined by levelsProfile : functionality (combination of object types)Level : complexity (need numbers (maximum))

As for Systems part, this profile has to fit in the MPEG-4 architecture.This implies amendment to part 1 & 16

ResolutionAdd mandate to an AhG for redefining object type, profile and level that fits in MPEG-4 architecture

Demo session in SystemsSNHC demonstrated the following applications in Systems hosted demo session:

Demonstration of realtime reconstruction of WSS

Core experiments

CE1 – Physics based animation

M11628 – Survey and proposal on existing physics model

Deformable body modeling

124

Fluid Modeling

ResultsIt is desirable to have a general physics modelShould have reasonable computational time

M11551 – CE Report for Physically-based animation part 1: survey of physics models and applications

Most common data structures that can be extracted from these techniques are particle systems, mass-spring networks and finite elements methods, while the most common algorithms are time step integration and ODE, collision detection and responses.Finite element method should not be considered, because they cannot be done in real time and very specific to deformation.

Results

125

Finite element will not be considered in this activity.Start with particle system approach as the base line

M11552 – CE report for PBA Part 3: PhysicsShapePropertyWe need to specify which scheme to use for integration because two different integration schemes lead to different results.Keep two fields for damping: viscous damping and percentage decrease

ResultsUse table for integration schemeUse flag for percentage damping

M11553 – CE report for PBA Part 4: PhysicsBonePropertyMotion blending for transition between BBA and PhysicsBoneProperties animation is presentedThe PhysicsBoneProperties node spec updates are proposed

ResultsChange stiffness to boneStiffnessChange weight to blendWeightChange PhysicsBoneProperties to MassSpringBonePropertiesExplore the need for forceEuler when we already have forceQuaternion

General discussion on PBAThe integration scheme should be listed in a table and define the usage of specific integration scheme in application specific profileStarting point : Based on particlesDefine common parameters for all physics model propertyIt should not be hard to implement and should be able to run in real-timeNeed solutions for scheme that may have a magic number.

CE2 – Multi-resolution Footprint-based Representation

M11701 – Result for the CE on Multiresolution Footprint-based Representation – IM1 implementation

Implementation of multi-resolution footprint based representation in IM1Partial implementation in IM1

- Node representation- Stream decoder

ResolutionContinue the CE for support of adaptation functionality

M11619 – Proposal for 3D building representationProposed attributes of real building to be stored to reconstruct and represent most buildings.General building properties are already supported in MRFRAdditional properties (ex. Root type) may improve MRFR

Resolution

126

Try to integrate this concept to MRFR

Explorations

E1. 3D Mesh Compression Framework

M11699 – Results on Core Experiment E1. Mesh Compression FrameworkCompared D3DMC with 3DMC (for each frame) and IC#.The reported IC# is not the interpolator compression in the standard, but the compression of static mesh on regular spaced of key frames and linearly interpolating.Performs at 10-20% of 3DMCPerforms at 10-90% of IC# depending on the group of meshesNeed to define purpose for animation compression

- for streaming (compare with BIFSAnim)- for downloading (compare with 3DMC & IC)

ResolutionContinue the EE and try to finalize the original test

- use two representations : frame by frame (streaming) and interpolator (downloading)- use the AFX framework (IndexedFaceSet & CoordinateInterpolator nodes) for input and

outputNext step: Use variable GOM sizes to adapt to changing motion

M11623 – Technical Issues in 3D mesh compressionList of problems and issues for the current 3D mesh compression tool in MPEG-4

Limited support of IndexedFaceSet representation (non-orientable or non-manifold models) by 3DMC

Lossless compression of attributes is not possible Change of vertex order after compression Change of face order after compression Inefficient compression of attributes other than geometry Implications of the aforementioned issues: need to consider the above issues for the new

framework.

ResolutionNeed proof that non-manifold and non-oriented mesh is needed in the industry.This proposal is used as the basis for experiment conditions of the on going EE.

M11711 – VertexImage: Encoding Animated Geometry as Rectangular Video

Transforming from 3D (displacement vector) to video (RGB or YUV) domain introduces error. Therefore, we need to find the best solution that minimizes this errorAlso, image coder may introduce errors.

ResolutionContinue the experimentUpdate the EE description according to the comments received (see CE document for details)

127

M11722 – Encoding of Dynamic Meshes with MeshGrid (Part 1)Reminder of MeshGrid as another existing tool for comparison.This may be used only for application where remeshing is allowed.ResolutionGenerate test data with MG that does not change the topology throughout the animationData set for 3DAV will be transformed to MG

General discussion on 3D mesh compression frameworkThings to be considered in 3D Mesh compression EE1

1. Input test data formatA. Static mesh : IndexedFaceSetB. Dynamic mesh: IndexedFaceSet + CoordInterpolator

2. Comparing ToolsA. For streaming of dynamic mesh: BIFS-AnimB. For downloading of dynamic mesh: Interpolator compressionC. Static Mesh: 3DMC

3. FunctionalitiesA. Compression efficiencyB. Lossless support of attributesC. Full support of IFS representation (vertex/face order, non-manifold/non-orientable

models)D. Streaming of dynamic mesh

4. Test methodologyA. Static mesh

i. Compression efficiency: 1. Coord : MESH tool2. Color : ?3. Texture Coordinate : ?4. Normal : ?

ii. Lossless support: ?B. Dynamic mesh

i. Key preserving : N4416 (measure in CE for IC)ii. Path preserving : N4416

E2. Multi-View Synthesis Reconstruction Using DIBR NodesMore details on E2 (3DAV issues) are described in Video report

M11582 – A Framework for Multi-view Video Coding using Layered Depth Image

Proposed a framework to encode multi-view video using the concept of LDIResolutionMore data (the correct ones) needed for resuming the experiment.

M11715 + M11716 – Results on EE2 and Proposal for 3D Camera Parameters

Current DIBR nodes do not support the intrinsic camera parameters.Proposed a node called 3DCameraNode with widely used intrinsic camera parameters.

128

ResolutionThe intrinsic camera parameter information will be included in the video stream instead of scene graph node.

E3. Model based 3D Movie Streaming

M11729 – 3D CGI Films CodingProposal for a representation of animated 3D synthetic scenes for 3D movie streaming application (Representation of a scene for a single application)Geometry is represented as textured Polygonal Strip Set format.This is not a compression but a new representation for mesh.It reduces the complexity for having 3DMC.It clusters part of an object and the textures are updated as video stream

ResolutionIt should be investigated with Systems since it is related to a new style of making a scene.Search for more application that may benefit from this kind of scene structure and investigate if it is generic enough.

MPEG-4 Part 21

Graphics Framework Extensions

M11609 – Comment on the ISO/IEC 14496-21 CD (MPEG-J extension for rendering)HI proposes a mechanism to allow discovery of a rendering API in a terminal so that the specification can allow support for any rendering engine. The mechanism is based on System.getProperty(String key), where key is the Java namespace of the rendering API. The method returns null is the API is not available or the version of API if supported.

HI also proposed editorial comments in the current text of the specification, which were agreed.

M11705 – Considerations and updates to GFX APIsMindego proposes to align MPEGlet design with Xlet behavior and semantic. Using Xlet mechanism, the terminal has a better management of the states of an application and an application can inform the terminal of its intent to change state.

While access to systems services are identical to MPEG-J specification, the proposed design relies on interfaces rather than classes, which is a much cleaner way to use terminal's services. It is important to note that Xlet design follows the well-known inversion of control principle used in virtually all frameworks today. MPEGlet design and in particular MPEG-J applications don't respect this principle.

In the proposed architecture, there is no distinction between applications residing in the terminal or downloaded from a stream: they are all GFXlets and follow the same management by the terminal. The proposal did not make any attempt to align existing MPEG-J design but rather proposed a new design aligned with industry practices and targeted at applications using possibly hardware rendering resources. However, this new design reuses MPEG-J APIs to access terminal's resources.

MPEG-J architecture is described in section and proposed GFX architecture in section .

129

DiscussionRequirementsThe functionalities proposed by the two proposals are not new in terms of requirements, they were already requested for many meetings but no proposal was made. In short, the proposed requirements are:

Support for any rendering engine

Possibility to pause applications for 2 applications to share a rendering resource

Use a framework similar to Xlet framework (and it happens to be the same for MIDlets)

Application context passed to the application not created by the application – there was disagreement whether this is a requirement as some felt this was more a style issue.

Get access to application properties

Notification to the terminal about state changes

Carriage of application-specific data synchronized with other elementary streams

Support for any rendering engine

Application (GFXlet)

(Scenegraph) M3G

Proprietaryrasterizer

JSR-239OpenGL ES

MPEG-J/GFX(ISO/IEC 14496-21ISO/IEC 14496-11)

MPEG terminal(Systems / Decoders)

Java (in terminal)

Native (in terminal)

Java (sent to terminal)

MPEG-J Rendering APIs

ProprietaryGraphicsEngine

Java bindings

Figure 1 - Block diagram of an MPEG-4 Player with MPEG-J extensions for rendering (extended from GFX CD text)

As shown in the figure above (Figure 1) it is conceivable that a proprietary API can be used alternatively. However it is expected there would be at least one rendering API implemented: JSR-239, JSR-184, or a proprietary API.

It was decided to update the specification with the following sentence:

There are two APIs selected as a recommended practice, a low-level graphics API (JSR-239), and an API with higher level constructs such as scene graphs etc. (JSR-184). Alternatively an implementer can choose to use a proprietary API. The responsibility of ensuring the behavior of the private API calls is outside the scope of this specification.

In other words if one or both of the APIs are chosen then this spec defines the normative behaviors of the renderers.

ArchitectureThe architecture answering the requirements for graphics applications has created a lengthy debate mainly for the following reasons:

130

Proposed GFXlet behavior model (M11705) is different from current MPEGlet model

Needs for graphics applications (in particular threading issues with graphical engines) was not part of MPEG-J initial design

Need to maintain backward compatibility with existing MPEG-J specification

We tried to keep in mind that our goal is to design a lightweight, compact, fast, secure, platform (Java profile) independent framework suitable for many applications graphical or not.

Before entering into the chosen architecture for GFX specification, we detail the behavior model of MPEG-J and proposed GFX designs.

MPEG-J architecture and behavior modelMPEG-J supports two application models:

MPEGlets are applications that inherit MPEGlet interface and are downloaded from an MPEG-J elementary stream.

MPEG-J applications reside in the terminal. They don't inherit MPEGlet interface.

Both models follow the same architecture (Figure 2) but have a different behavioral model (Figure 3). From Figure 2, MPEGlets are run in a thread spawn by the MPEGletManager inside the terminal (this object is for illustration purpose; MPEGletManager is not part of MPEG-J specification). This manager can only start and stop the MPEGlet. In our discussions, it was also unclear why stop() and destroy() are separate methods since there is no way to restart the MPEGlet once stopped and hence it should destroy all its resources (Figure 3 left).

MPEG-J applications are simply resident programs in the terminal. The terminal starts them but Figure 3 shows that the terminal has no way to control them: they may finish by themselves or when the terminal is closed or maybe when they throw an exception in which case the terminal should destroy them (MBS: not sure if this is in the spec?).

Runnable«interface»

mpegj::MPEGlet{abstract}

+ init() : void+ stop() : void+ destroy() : void

MPEGletManager

MPEGletContextmpegj ::MpegjTerminal

+ MpegjTerminal()+ MpegjTerminal(MPEGlet)+ getResourceManager() : ResourceManager+ getInitOD() : ObjectDescriptor+ getODs(int) : Vector+ getSceneManager() : SceneManager+ getNetworkManager() : NetworkManager

«creates»

Figure 2 – MPEGlet and MPEG-J architecture.

131

MPEGletManager

MPEGlet

MpegjTerminal

Thread

MPEGlet()

init()

MpegjTerminal(this)

Thread(MPEGlet)

start()

run()

stop()

(exit thread)

destroy()

(terminal garbage collected)

Terminal

MPEG-J appl ication

MpegjTerminal

MpegjTerminal()

Figure 3 – MPEGlet (left) and MPEG-J application (right) behaviors.

Following Figure 3, MPEGlets and MPEG-J applications both use an MpegjTerminal object to access the terminal's resources (e.g. ResourceManager, NetworkManager, and so on). During our discussions, it was commented that this design seems to imply that managers are global objects in the terminal. In fact, this is not true for MPEGlets and so the reason MpegjTerminal contructor takes the MPEGlet as a parameter: this enables the terminal to use the MPEGlet as a key to determine the resources it belongs to (i.e. the content defined by its IOD, and hence ODs and content specific managers). However, it was also commented that this mechanism requires an heavier management in the terminal than if the MPEGletManager was passing the MpegjTerminal as an argument to the init() method of the MPEGlet.

Finally, it was noted that MPEGlet specification follows Java Applet design.

Proposed GFX architecture and behavior modelFigure 4 shows GFX architecture. Compared to MPEG-J diagrams in the previous sections, there are key differences:

All objects are accessed via interfaces (Figure 4)

GFXlets don't create an MpegjTerminal but a conceptual GFXletManager within the terminal creates a GFXletContext, which enables access to terminal resources (via MPEGTerminal interface)

GFXlets are completely managed by the GFXletManager. They can be paused, re-started, and destroyed (Figure 5) by the GFXletManager or the GFXlet itself. In response to an uncaught exception, the GFXletManager will destroy the GFXlet and, following Xlet/MIDlet design, if a state management operation takes too long, the GFXletManager may destroy the GFXlet thinking something is wrong.

GFXletContext enables bi-directional notifications between the framework and the GFXlet (Figure 6):

o Framework → GFXlet: framework provides interfaces to access terminal resources, including a display where the GFXlet can draw onto the terminal's display device

132

o GFXlet → Framework: state management notifications enable the GFXlet to inform the framework of its intent or should an error occurs that it should be destroyed.

GFXlets can be used as downloaded applications or terminal's resident applications. The framework treats both identically.

GFXlets architecture follows Xlets (in Java Personal Basis Profile) and MIDlet (in Java MIDP) designs.

GFXlets reuse MPEG-J APIs to access MPEG-4 Systems resources and hence provide the same Systems features as MPEG-J.

«interface»gfx::GFXlet

{abstract}

+ initGFXlet(GFXletContext) : void+ startGFXlet() : void+ pauseGFXlet() : void+ destroyGFXlet(boolean) : void

«interface»gfx::GFXletContext

{abstract}

+ getDisplay() : GFXDisplay+ checkPermission(String) : int+ getGFXletProperty(String) : String+ notifyDestroyed() : void+ notifyPaused() : void+ resumeRequest() : void+ getMPEGTerminal() : MPEGTerminal

«interface»gfx::GFXDisplay

{abstract}

+ addComponent(Object) : void+ setCurrent(Object) : void+ getCurrent() : Object

Object attribute can be:- javax.microedition.lcdui.Canvas for MIDP- java.awt.Canvas for PP and JDK 1.x

notifyDestroyed(), notifyPaused(), resumeRequest() inform terminal of GFXlet state changes

startGFXlet(), pauseGFXlet() enable terminal to start, pause, restart GFXlets.

«interface»gfx::MPEGTerminal

{abstract}

+ getResourceManager() : ResourceManager+ getNetworkManager() : NetworkManager+ getInitOD() : ObjectDescriptor+ getODs(int) : Vector

«uses»

Figure 4 – GFX architecture.

Initial

Activ eLoaded Paused

Destroyed

Final

initGFXlet()startGFXlet()

pauseGFXlet()

destroyGFXlet()

Figure 5 – GFXlets state diagram.

GFXlet state management is identical to Xlet and MIDlet state management.

133

Application specificApplication management

GFXletManager

GFXletContext

Rendering Thread

Renderer

Conceptually, the GFXlet starts a rendering thread to drive a renderer.

GFXlet

initGFXlet(GFXletContext)

startGFXlet()

getDisplay() : GFXDisplay

Renderer(GFXDisplay)

start()

run()

notifyPaused()

notify GFXlet is paused

resumeRequest()

notify GFXlet wishes to re-start

notifyDestroyed()

notify GFXlet terminates

pauseGFXlet()

exit thread

release rendering resources

destroyGFXlet()

release all resources

Figure 6 – GFXlet behavior model.

GFXlets behavior model is identical to Xlets and MIDlets. Figure 6 shows the clear separation between application management by the terminal and application-specific managed resources. In particular, this design is necessary to avoid collisions between Java rendering thread (e.g. AWT) and (hardware) rendering thread (RenderingThread / Renderer in this diagram).

Discussion1. MPEGlet.stop() behavior is not clear because it should correspond to GFXlet.pauseGFXlet() but

it is not, it is akin to MPEGlet.destroy() or GFXlet.destroyGFXlet(true). GFXlet.destroyGFXlet(false) may be used by the terminal to indicate the application it is going to be destroyed. In this case, the application can throw a GFXletStateChangeException to indicate it doesn't want to be destroyed at this time (for example, this may happen when

134

graphics commands are not fully flushed to a rendering device). In principle, MPEGlet.stop() could wait for rendering commands to be flushed but this may result in the terminal to be un-responsive, which shouldn't happen with GFXlet.destroyGFXlet(false).

2. MPEGlets and GFXlets follow a different but overlapping behavior model:

Once started, MPEGlet logic occurs in the MPEGlet.run() method. MPEGlet.stop() seems to be designed to stop the logic in the run() method. With this design, it is not possible to restart the application. As such stop() and destroy() could have been one method i.e. destroy().

GFXlets are started using startGFXlet() method and paused with pauseGFXlet(). In pauseGFXlet(), the application should release all shared resources (for example, rendering device). A GFXlet can be restarted by the terminal by calling its startGFXlet() method again.

Can GFXlet behavior be added to MPEGlets? Of course, the same states can be added to MPEGlet interface and the same behavior added to MPEGletManager. The MpegjTerminal class can also be extended with GFXletContext methods. However, MpegjTerminal class breaks inversion of control principle i.e. the application should not create the context but the terminal or MPEGletManager who manages terminal's resources (including MPEGlets).

Second, the rationale for MpegjTerminal to be a class is for MPEG-J applications. In our discussions, it was lengthily commented that this separation between MPEGlets and MPEG-J applications is artificial and that there is no reason for treating them as two separate scenarios; both cases can be easily handled by a unique MPEGlet/GFXlet design.

3. It was also asked why do we need to derive Renderer interface from 2 event notification interfaces MPRendererEventGenerator and MPRendererFrameEventGenerator? Isn't this application-specific? or wasn't this necessary for BIFS scenes where no control on the renderer was possible and hence terminal notifications were needed?

Decisions for GFX specificationThe compromised solution is shown in the figures in this section. In order to keep the MPEG-4 Systems (ISO/IEC 14496-11) unchanged for the behavior of the terminal when receiving a Java stream, we decided to keep the same interface for MPEGlet albeit enhanced with additional methods. The terminal will know the difference when receiving the JavaStreamHeader whose version is 0x2 for this specification (see section )..

The diagram and behavior follows Figure 4. However, TerminalContext interface has been defined for a more generic design. We assumed that a terminal must always provide an access to its resources (ResourceManager) and to network (NetworkManager). An MPEG-4 terminal also provides access to object descriptors and BIFS scene. AnotherTerminal may provide other information.

135

«interface»

MPEGlet{abstract}

+ init(context :MPEGletContext) : void+ pause() : void+ stop() : void+ destroy() : void

«interface»

MPEGletContext{abstract}

+ checkPermission(permission :String) : int+ getDisplay() : Display+ getProperty(key :String) : String+ getTerminalContext() : TerminalContext+ requestResume() : void+ requestPause() : void

«interface»MPEGContext

{abstract}

+ getInitOD() : ObjectDescriptor+ getODs() : Vector+ getSceneManager() : SceneManager

«interface»Display

{abstract}

+ addComponent(component :Object) : void+ getComponent() : Object

«interface»TerminalContext

{abstract}

+ getResourceManager() : ResourceManager+ getNetworkManager() : NetworkManager

«class»MpegjTerminal

+ MpegjTerminal()+ MpegjTerminal(mpeglet :MPEGlet)

«interface»AnotherTerminal

{abstract}

«interface»Runnable

{abstract}

+ run() : void

Runnable.run() is akin to starting an MPEGlet.We need to study if usage of Runnable.run() is better than using aMPEGlet.start() method.

MpegjTerminal is from MPEG-J v.1.Using this architecture, it is the same as before and maybe used as such within the terminal .

These classes are for il lustration purpose.

«use»

Figure 7 – GFX MPEGlets architecture.

Figure 8 depicts the architecture for Renderers. While any renderer is possible, the specification defines the interfaces for M3G (M3GRenderer) and OpenGL ES (GLRenderer).

«interface»Renderer

{abstract}

«interface»M3GRenderer

{abstract}

+ getGraphics3D() : Graphics3D

«interface»GLRenderer

{abstract}

+ getEGL() : EGL+ getGL() : GL

«interface»AnotherRenderer

{abstract} for illustration purpose

Figure 8 – Renderer architecture.

Figure 9 shows the various states of a GFX MPEGlet: these are the same states as Figure 5 with an Initialized state added (the Running state corresponds to the Active state in Figure 5).

136

Initialized

Paused

Running

Initial

Final

Destroyed

Loaded

ini t(MPEGletContext)run()

pause()

run()stop()

stop()

destroy() destroy()

destroy()

destroy()

Figure 9 – GFX MPEGlets states.

Figure 10 shows the sequence of operations for MPEGletContext.requestResume() and MPEGletConxt.requestPause() when the application wishes to inform the terminal it wants to resume and to pause respectively (typically, the user hit a resume or pause button that triggers this notification). In return, the terminal calls MPEGlet.resume() and MPEGlet.pause() respectively. Note that this behavior is not exactly the same as Xlets, as shown in Figure 6.

Terminal

«interface»MPEGlet

«interface»MPEGletContext

requestPause()

notify MPEGlet wants to pause

pause()

requestResume()

notify MPEGlet wants to resume

run()

Figure 10 – Sequence of operations for pausing and resuming GFX MPEGlets.

137

Carriage of private data streamAs Graphics applications can define their own scene representation and logic, a dedicated format may be used to carry data to the application. This is supported by enabling the MPEG-J elementary stream to carry private data similar to audio and video elementary streams. By making it part of the MPEG-J elementary stream the timing model in MPEG-4 Systems can be used for synchronization with other elementary streams.

In section 11.4.3.2, we update the Java packet header with the fields in bold below. The changes are backward compatible with existing MPEGlets.

If hasPrivateData = 1, the PrivateData class contains an array of bytes and is passed to the application in the Buffer interface (to be defined)

If hasApplicationDescriptor = 1, the application descriptor is provided as a null-terminated String. The application descriptor is similar to a Jar's manifest file. It contains specific key-value pairs that indicates the framework specific resources (in particular graphics) the application needs. If the terminal doesn't support such resources, it can skip loading further data from the stream.

for this specification, version = 10 in binary or 0x2 in hexadecimal

aligned(32) class JavaStreamHeader { bit(2) version;bit(1) isClassFlag;bit(13) numReqClasses;bit(1) isPackaged ;bit(3) compressionScheme;bit(1) hasPrivateData;bit(1) hasApplicationDescriptor;bit(10) reserved;JavaClassID classID;

JavaClassID reqClassID[numReqClasses];

if(hasPrivateData)PrivateData privateData;

if(hasApplicationDescriptor)String appDescriptor;

}

aligned(32) class PrivateData {}Known issuesAPI to access to private data stream buffer is not resolved.

MPEG-J managers, ResourceManager and NetworkManager, are still too MPEG-4 specific. A more generic approach is preferable and contributions are expected at the next meeting.

We need to define application descriptor's specific keys (e.g. renderer = javax.microedition.m3g).

MPEGlet inherit from Runnable interface, which means it is typically started within a Thread managed by the terminal. It is not clear if this is needed vs. using a start() method instead of

138

Runnable.run(). As shown in Figure 6, the application typically starts its own rendering or animation thread. So the question is whether to have the terminal control this thread or the application? This will be studied until the next meeting.

Resolutions of SNHC

Output documents

The SNHC subgroup recommends to approve the following documents

No. Title TBP Available14496-16 MPEG-4 Animation Framework eXtension (AFX)

6985 DoC on ISO/IEC 14496-16/PDAM1 No 05/01/216986 Text of ISO/IEC 14496-16/FPDAM No 05/01/216987 Text of ISO/IEC 14496-16/COR1 No 05/01/216988 AFX Core Experiments Description No 05/01/216989 SNHC FAQ 13.0 Yes 05/02/18

No. Title TBP Available14496-21 MPEG-4 MPEG-J Extension for rendering

6990 Study text of ISO/IEC 14496-21/CD Yes 05/02/07

ResolutionsMPEG-4Part 16

The SNHC subgroup would like to thank the Korean Mobile 3D Standardization Forum for contributing on the definition of 3D Compression Profile in MPEG-4.

The SNHC subgroup acknowledge the new approach for building profiles specific to 3D compression as jointly discussed with the Requirements subgroup in order to support specific needs of mobile 3D industry.

The SNHC subgroup would like to thank Mikaël Bourges-Sévenier for his outstanding dedication to SNHC and for the essential guidance that he has given to the MPEG work for many years.

The SNHC subgroup would like to thank Mahnjin Han for agreeing to lead the SNHC activities.

Part 21 The SNHC subgroup is please to see that JSR-239 expert group has selected APIs defined

during GFX activity as the basis of their specification.

Establishment of SNHC Ad-Hoc groups

No. Title Mtg ChairN6991 AhG on AFX documents, CEs, and

softwareYes Marius Preda

N6992 AhG on MPEG-J extensions for rendering

Yes Mikaël Bourges-Sévenier

139

N6991 Ad Hoc Group on AFX documents, CEs, and softwareMandate: 1. Maintain and edit SNHC documents.

2. Coordinate SNHC CE and EE activities.3. Coordinate collection of demonstration data set of SNHC tools4. Coordinate reorganization of reference software in CVS repository5. Coordinate activity on definition of AFX profiling dimension

Chairman: Marius Preda (INT)Co-chairs Jeong-Hwan Ahn (Samsung AIT)

Francisco Moran Burgos (UPM)Duration: Until 72nd meetingMeetings Sunday before 72nd meetingReflector: mpeg-snhc AT gti. ssr. upm. esSubscribe: Send an email to mpeg-snhc-request AT gti. ssr. upm. es with the message

“subscribe” as the first line in the body.

N6992 Ad Hoc Group on MPEG-J extensions for renderingMandate: 1. Maintain and edit 14496-21 (GFX) documents

2. Harmonize Java bindings to OpenGL ES with JSR-239 expert group3. Investigate GFX implementation in IM1

Chairman: Mikaël Bourges-Sévenier (Mindego Inc.)Co-chairs Vishy Swaminathan (Sun Microsystems)

Itaru Kaneko (Waseda University)Duration: Until 72nd meeting Meetings Sunday before 72nd meetingReflector: mpeg-j AT it-aru. comSubscribe: Send an email to mpeg-j-request AT it-aru. com with the message “subscribe” as

the first line in the body.

Closing of the MeetingSee you in Busan in April.

Annex 11Integration

Opening of the Meeting

Allocation of contributionsMonday Plenary

11475T. ChiangYi-Shin TungChung-Neng Wang

AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance

11476 A. Yamada AHG on Maintenance of MPEG-7 Visual related Documents and

140

L. CieplinskiSang-Kyun KimStephan Herrmann

Reference Software

11485Marius PredaMahnjin HanPatrick Gioia

AHG on AFX documents, CEs, and software

11525 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-5:2001/PDAM 811527 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:2004/PDAM 911528 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 21000-811533 Jean-Claude Dufourd Reference Software for the LASeR/SAF FCD11558 Schuyler Quackenbush Proposed conformance working draft for MPEG-1/2 Audio in MPEG-411559 Schuyler Quackenbush Proposed reference software working draft for MPEG-1/2 Audio in MPEG-4

11565 Jean-Claude Dufourd LASeR/SAF software with SVGT1.1 compatibility

11572 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 13818-4:2004/FDAM 1

11614Mayumi KoikeTakuyo KogureNoboru Sonehara

MPEG-2 IPMP - Implementation Report and Issues of Feasibility

11615Qonita ShahabHendryMunchurl Kim

Analysis of MPEG-4 LASeR Reference Software

11674 Frederik De KeukelaereRik Van de Walle

Contribution to DIP reference software

11690Juergen SchmidtOliver BaumKlaus Eilts-Grimm

Proposed WD 0.2 of AudioBIFS v.3 Conformance

List of standards under developmentStd Pt Edit. Project Description CfP WD CD FCD FDIS

4 4 200x Cor.1 Visual Bitstreams 04/03 04/10 05/044 4 200x Amd.1/Cor.1 FGS Bitstreams 04/10 05/044 4 200x Amd.9 AVC FRExt Conformance 04/03 04/07 05/01 05/074 4 200x Amd.10 New Levels of SP Conf 04/07 04/10 05/044 4 2004 Amd.11 Parametric Stereo Conformance 05/01 05/04 05/104 5 2004 Amd.8 AVC FRExt Ref Soft 04/07 05/01 05/07

21 8 200x 1st Ed. Reference software 03/03 04/03 04/07 05/0721 14 200x 1st Ed. Conformance 03/10 05/04 05/07 05/12

Latest references

Project P. Standard Issue No.MPEG-4 4 ISO/IEC 14496-4:2003 (MPEG-4

Conformance 2nd Ed.)02/12 Awaji N5457

MPEG-4 4 ISO/IEC 14496-4:2001/Amd.1 (FlexTime, Studio and Streaming Video Profile)

02/07 Klagenfurt

N5083

MPEG-4 5 ISO/IEC 14496-5:2001 (Ref. Soft 2nd Ed.) 01/07 Sydney N4368MPEG-4 5 ISO/IEC 14496-5:2001/Amd.1 (FlexTime) 02/03 Jeju N4711MPEG-4 5 ISO/IEC 14496-5:2001/Amd.2 (XMT) 02/05 Fairfax N4865MPEG-7 6 ISO/IEC 15938-6:2002 (Reference Software) 01/12 Pattaya N4475MPEG-7 7 ISO/IEC 15938-7:2002 (Conformance) 02/07

KlagenfurtN4937

141

Request documentsProj P A Description Issue No

2 2 1 Request for New Amendment: ISO/IEC 13818-2:2000/Amd 1 30614 4 1 Request for amendment 1 to ISO/IEC 14496-4 35044 4 2 Request for ISO/IEC 14496-4/Amd.2 35704 5 2 Request of ISO/IEC 14496-5/Amd.2 38644 4 3 Request for ISO/IEC 14496-4/Amd.3 38684 4 1 Request for Amendment 1 of ISO/IEC 14496-4:2001 40884 5 1 Request for Amendment 1 of ISO/IEC 14496-5:2001 40894 5 2 Request for Amendment 2 of ISO/IEC 14496-5:2001 42794 4 3 Request for Amendment 3 for ISO/IEC 14496-4 47074 5 3 Request for ISO/IEC 14496-5:2001/Amd.3 486521 8 Request for Subdivision to ISO/IEC 21000-8 49044 4 3 Request for ISO/IEC 14496-4:2002/AMD3 50854 4 4 Request for ISO/IEC 14496-4/AMD4 54424 5 4 Request for ISO/IEC 14496-5/AMD4 54444 4 5 Conformance Extensions for Error Resilience Scalable Profile 56694 5 5 Error Resilience Scalable Profile Reference Software 56702 4 1 IPMP Conformance Extensions 57992 5 1 IPMP Reference Software Extensions 58084 4 6 AVC Conformance 58154 5 6 AVC Ref Soft 58227 7 1 Conformance Extensions 58254 4 4 IPMP Conformance Extensions 58954 4 7 AFX Conformance Extensions 58964 5 4 IPMP Reference Software Extensions 58974 5 7 AFX Reference Software Extensions 589821 14 Request for Subdivision ISO/IEC 21000-14 MPEG-21 Conformance 60702 4 2 Request for Amd 2 of ISO/IEC 13818-4:200X 62334 4 8 Request for Amd 8 of ISO/IEC 14496-4:2003 62414 4 9 AVC Fidelity Range Extensions Conformance 63524 5 8 AVC Fidelity Range Extensions Reference Software 63554 4 10 Request for 14496-4:2004 Amd.10 64974 4 11 Parametric Stereo Conformance 05/01

MPEG-4 Conformance (14496-4)

11690Juergen SchmidtOliver BaumKlaus Eilts-Grimm

Proposed WD 0.2 of AudioBIFS v.3 Conformance

This is a follow-up on the contribution to Palma. Conformance is improved by adding parameter printout and presenter input comparison. Question: can you force a decoder to implement parameter output to be able to check conformance ?Help is welcome, and FTRD has agreed to lend a hand.

142

MPEG-4 Reference Software (14496-5)

11614Mayumi KoikeTakuyo KogureNoboru Sonehara

MPEG-2 IPMP - Implementation Report and Issues of Feasibility

Presentation of Digital Cinema Distribution, which uses MPEG-2, with IPMP for DRM: the intent of the contribution is an evaluation of the IPMP reference software. 5 issues have been found. Work will continue juntil next meeting to determine if the spec should be amended. If not, the reference software will need to be improved and the proponents will help with this. The whole resolution may require a high-level discussion on how to practically apply the abstract IPMP concepts defined in the specification.

MPEG-21 ConformanceReview of WD5.0 of MPEG-21 Conformance. Question about RDD conformance (not needed because there is no syntax instantiation). Discussion about DID Parser conformance, which got solved by defining a formal output for DID Parsers. No need for an AHG.

MPEG-21 Reference SoftwareThe document was updated according to the DoC in Palma.

143

Resolutions of Integration

Resolutions The Integration subgroup solicits contribution of Ambisonics content with suitable

copyright for use in the creation for AudioBIFS conformance test sequences The Integration subgroup requests ISO to make MPEG-21 Conformance Testing Bitstreams

and Reference Software freely available on ITTF website

Documents

MPEG-4

No. Title TBP Available14496-4 MPEG-4 Conformance

7029 Request for Amendment 11 of ISO/IEC 14496-4 Parametric Stereo Conformance

N 05/01/21

7030 Text of ISO/IEC 14496-4/PDAM11 Parametric Stereo Conformance N 05/01/216995 DoC on ISO/IEC 14496-4/PDAM9 AVC FRext Conformance N 05/01/216996 Text of ISO/IEC 14496-4/FPDAM9 AVC FRext Conformance N 05/01/21

No. Title TBP Available14496-5 MPEG-4 Reference Software

6896 DoC on ISO/IEC 14496-5/PDAM8 AVC FRext Reference Software N 05/01/216897 Text of ISO/IEC 14496-5/FPDAM8 AVC FRext Reference Software N 05/01/31

MPEG-21

No. Title TBP Available21000-8 MPEG-21 Reference Software

6941 Draft DoC on ISO/IEC 21000-8/CD MPEG-21 Reference Software N 05/01/216940 Study of ISO/IEC 21000-8/FCD MPEG-21 Reference Software N 05/01/21

144

Annex 12Test report

Source: Tobias Oelbaum

Opening of the Meeting

Goals for the weekThe goals of this week are:

Evaluate proposals for the CfE on Multi View Coding Processing of the results of the CfE on Multi View Coding; documentation of the results and

the test procedure Discussion about test conditions for a possible CfP on Multi View Coding

Joint MeetingsThe following joint meetings were scheduled

with Video – 3DAV CfE Multi View Coding

Test Activities

CfE on Multi View CodingAs previously discussed via email it was decided to use a Double Stimulus test method and to treat the anchor as one of the proposals. This allowed drawing conclusions about the quantitative differences between different proposals and between the anchor and one proposal.Results were presented at a joint meeting with Video and are documented in N6999.A detailed description of the performed visual quality evaluation is documented in N6999.Discussion about test conditions for a possible CfP on Multi View Coding was started. Tests will be performed in advance to the meeting following the CfP. Special attention was drawn to the availability of test material. For a successful CfP at least 6 different test sequences should be available which shall have SD resolution or above. Results of this discussion can be found in N6910 “Draft Call for Proposals on Multi-View Video Coding”.

Test Resolutions

Output Documents N6999 Report of the Subjective Quality Evaluation for Multi View Coding CfE

AdHoc GroupsNo AdHoc Groups have been set up at this meeting.

145

Annex 13ISG

Source: ISG ChairEditor: Marco Mattavelli (EPFL)

OverviewThe main work items of the Implementation Studies Subgroup in Hong-Kong are:

1. The advances in the development of the MPEG-4 “Part 9 Reference Hardware Description” Phase 2 concerning the integration of the MPEG-4 Optimized Reference software Part 7 and the Reference Hardware Part 9 so as to constitute a “mixed” software hardware description of MPEG-4 video using the concept of the virtual socket.

2. The planning and extension of supported features for the integrated framework, putting together in a single application MPEG-4 Part 9 with MPEG-7 Part 7 and AVC (MPEG-4 Part-9) software.

Input contributions w.r.t. the above items are summarized according to the following table:

Contributions

M11487 Report of the AHG on MPEG-4 Part 9 Reference Hardware Description"

Marco Mattavelli EPFL, Robert Turney Xilinx Research Lab.

M11535 An Updated SystemC model for 2x2 Hadamard Transform and Quantization with Application to MPEG–4 Part 10 (with Conformance Test)

Author: Ihab Amer, Wael Badawy, and Graham Jullien Advanced Technology Information Processing Systems (ATIPS), Calgary, Alberta, Canada.

M11536 An Updated SystemC model for 4x4 Hadamard Transform and Quantization with application to MPEG-4 Part 10 (with Conformance Test)

Author: Ihab Amer, Wael Badawy, and Graham Jullien Advanced Technology Information Processing Systems (ATIPS), Calgary, Alberta, Canada.

M11537 An Updated SystemC Model for the MPEG-4 Part 10 4x4 DCT-Like Transformation and Quantization with Conformance Test

Author: Ihab Amer, Wael Badawy, and Graham Jullien Advanced Technology Information Processing Systems (ATIPS), Calgary, Alberta, Canada.

M11600 A HW block for H.264/AVC quarter pel full search variable block motion estimation.

Author: Choudhury A. Rahman and Wael BadawyAdvanced Technology Information Processing Systems (ATIPS), Calgary, Alberta, Canada.

146

Detailed Report

The advances in the development of the MPEG-4 “Part 9 Reference Hardware Description”

The ISG activity at the Hong-Kong meeting has mainly been devoted to:

the dissemination of information about the ISG activity for the development of Part 9 to several new comers to the ISG group that showed interest for the activity,

the review of the contributions presenting updated HDL module submissions, the review of contributions on the new proposed improvements to the API specification and

implementation improvements of the “Virtual Socket”, the update of MPEG-4 Part 2 and Part 10 module submission status, the editing of the second edition of the Technical Report.

A good part of the meeting have been dedicated to present past and current activity of ISG to several Chinese companies and universities that have been attending the Hong-Kong meeting. The rest of the time has been devoted to the review of contributions. Now all modules submitted so far are accompanied by documentation according to the template defined at Seattle meeting. For some modules the conformance part that was missing in previous documentation submission has been added. For most of the modules such part needs to be completed by next Busan meeting. According to the new submissions the table of module submission commitment has been updated and reported in a specific output document (question marks indicate that the commitment is uncertain concerning the delivery date or that the module has not been selected for a submission commitment) (output document N6956). A document describing the implementation of the “Virtual socket” with title “Tutorial on Multiple IP-Core Hardware-Accelerated Software System Framework for MPEG4-Part9” (document M11764) has been presented and discussed. With such contribution that complete the software submission there are two alternative implementations of the “Virtual socket” supported by ISG for the implementation of mixed SW/HW description of MPEG video on platform composed by a PC and a WildcardII.

The ad-hoc group on the development of MPEG-4 Part 9 has been re-established with updated mandates, including a specific mandate for the specification and development of the demonstration platform and a new mandate for investigating a possible hardware reference description for IDCT as answer to the Call issued by video and JVT. The ad-hoc schedule includes 4 telephone conferences before next meeting. Phone conferences are planned on the 3rd February, 3rd March, 31st March and 7th April at 3 p.m. GMT. Tel: (from US 1-877-582-3182, from outside US 1-770-970-4161, participant code 9202060193).

ResolutionsThe above activities have led to the following resolutions and output document approval.

MPEG-4

147

No. Title TBP Available14496-9 MPEG-4 Reference Hardware Description

6956 Status of HDL submissions and commitments for MPEG-4 Part-9 N 05/01/21

14.1.3 The Implementation Studies subgroup would like to thank all submitters of HDL code and contributors to the implementation of the virtual socket and encourages them to continue this fruitful effort and collaboration.

148

Annex 14Liaison

Source: Jan Bormans (Jan dot Bormans at IMEC dot BE)

The Liaisons Group considered the following input documents:

Input Contribution Number

Title

M11507 Liaison Statement from SC 29/WG 1M11516 SC 24 Liaison on ISO/IEC 19775-1/PDAM 1M11517 SC 24 Liaison on ISO/IEC CD 19775-3M11519 Liaison Statement from 3GPP TSG SA WG4M11530 IEC TC 100 Liaison on IEC CDV 62298-4M11538 Liaison Statement from ITU-T SG 16M11539 Liaison Statement from TVAM11543 Liaison Statement from IEC TC 100M11548 Liaison Statement from OMAM11590 Activity Report of DCCSDP&DCCSDC in Japan Part-3M11761 Liaison Statement from ISMAM11765 Liaison Statement from OMA

The Liaison input from IEC TC 100, as well as the accompanying document M11573 “Proposal to support new colour space in IEC TC100” was discussed on Tuesday in a joint meeting with requirements and video. The consensus was reached to set up an Ad-hoc Group (AhG) to achieve a better understanding of this subject and to assess its potential impact on MPEG standards (see N7008). During the Liaison meeting, a brief presentation was given about the DCCSDP&DCCSDC activities.

In addition to replying, when appropriate, to the incoming Liaison Statements, it was agreed to take the initiative to send outgoing Liaison Statements to: ITU-R WP6A – on the status of the standardization of the MPEG-4 HE-AAC (High Efficiency

AAC) and HE-AAC v2 audio profiles; CCSDS Panel 2 – on the relationship between their work on the standardization of XML

Formatted Data Units (XFDU) aimed at “representing widely applicable XML-based packaging techniques, and MPEG-21 DID (ISO/IEC 21000-2).

Finally, the responses for the non-technical National Body comments as well as an updated list of organisations with which MPEG entertains liaisons were completed.

The following recommendations were issued:

The approval of the following documents (Liaison Statements):

No. Title TBP AvailableGeneral

7006 Liaison Statement to ITU-R WP6A No 05/01/217007 Liaison Statement to ITU-T SG 16 No 05/01/217008 Liaison Statement to IEC TC 100 No 05/01/21

149

7009 Liaison Statement to CCSDS Panel 2 No 05/01/217010 Liaison Statement to ISMA No 05/01/217011 Liaison Statement to WG 1 on JPSearch No 05/01/21

The approval of the following documents (other Liaison documents):

No. Title TBP AvailableGeneral

7012 Responses to National Body Comments No 05/01/217013 List of Organisations with which MPEG entertains liaisons No 05/01/21

150