Ouagadougou, Burkina Faso, 18 July 2013 1 Overview of ITU-T Study Group 12 Activities Joachim Pomy,...

Ouagadougou, Burkina Faso, 18 July 20131

Overview of ITU-T Study Group 12 Activities

Joachim Pomy, SG 12 RapporteurConsultant, Opticom GmbH

[email protected]

ITU Workshop on “Benchmarking QoS Evaluation of Multimedia

Networks”

(Ouagadougou, Burkina Faso, 18 July 2013)



Where it All Begins:Real Communication Situation


... and where Technology comes to Play:Employing a Telecommunication System


SG 12 Key History Events (1)

Established in 1957Separate SG 16 for Transmission Planning

Old SG 12 just did subjective testing & telephone standardsAt CCITT Plenary Assembly in 1984, these SGs were merged to form the present-day SG 12

During same time SG 12 had a Laboratory WPSubjective & objective testing for loudness of telephonesIn the CCITT Laboratory in Geneva - closed in 1988

Since 1986 Speech Quality Experts Group (SQEG)To better provide the quality requirements and subjective testing for speech coding algorithms standardized by SG 18 (later SG 15, now SG 16)Key role in the standardization of all of the G.711-G.729 speech and audio codecs, and still exists as Q7/12.


SG 12 Key History Events (2)

Since 1997 Video Quality Experts Group (VQEG) With a nucleus of subjective and objective video quality expertise from SG12SG12 still maintains close contact with VQEG

Since the early 1990s work in SG 12 has expandedInto many new technology areas

ATMVoIPMultimediaDigital wirelessIP QoS classesEthernet IPTV, etc.Network PerformanceResource Management.

Since 2008 SG12 was given responsibility forOperational aspects of telecommunication network service qualityResponsibility for the QoS Development Group (QSDG).


SG 12 Mandate

Performance, QoS and QoE

Responsible for Recommendations on performance, quality of service (QoS) and quality of experience (QoE) for

full spectrum of terminals, networks and servicesranging from speech over fixed circuit-based networks to multimedia applications over networks that are mobile and packet based

Included are operational aspects of performance, QoS and QoEend-to-end quality aspects of interoperabilitydevelopment of multimedia quality assessment methodologies, both subjective and objective.

SG 12 is the Lead SG on quality of service and quality of experience driver distraction and voice aspects of car communications

http://www.itu.int/en/ITU-T/studygroups/2013-2016/12/Pages/default.aspx


SG 12 Recommendations

E.420-E.479, E.800-E.859G.100-series, except G.160-, G.180- and G.190-seriesG.1000-seriesI.350-series (including Y.1501/G.820/I.351), I.371, I.378, I.381P-series, except P.900-seriesY.1220-, Y.1530-, Y.1540-, Y.1560-serieshttp://www.itu.int/ITU-T/recommendations/index_sg.aspx?sg=12


SG 12 Leading Team

ChairmanKwame Baah-Acheamfuor (Ghana)

Vice ChairmenPaul Barrett (United States)Vinvent Barriac (France)Gamal Amin Elsayed (Sudan)Hyung-Soo Kim (Republic of Korea)Al Morton (United States)Qi Feng (China)José Guadalupe Rojas Ramírez (Mexico)Akira Takahashi (Japan)Hassan Talib (Morocco)

TSB SupportHiroshi Ota, CounsellorSarah Scott, Assistant


Working Parties

WP 1 Terminals and multimedia subjective assessment

CHAIR: Lars Birger Nielsen (Denmark)VICE CHAIR: Gunilla Berndtsson (Sweden)

WP 2 Objective models and tools for multimedia quality

CHAIR: Paul Barrett (United States)VICE CHAIR: Vincent Barriac (France)

WP 3 Multimedia QoS and QoECHAIR: Paul Coverdale (China)VICE CHAIR: Akira Takahashi (Japan)


Groups overseen by SG12

CarCom Focus Group (closed in 2013)

Hans Gierlich, Chair

Driver Distraction Focus Group (closed in 2013)

Scott Pennock, ChairQoS Development Group

Yvonne Umutoni, ChairRegional Group for Africa

Gamal Amin Elsayed, Chair


CarCom Focus Group

In car communicationQuality parameters & testing methods

Interaction of car hands free systems with radioRequirements on sub-system levelRequirements and testing procedures for super-wideband and fullband systemsInteraction with other audio components and systems in the carSpecial requirements/testing procedures for speech recognition systems in carsQuality models: what and how can be applied for the car environment?


QoS Development Group

Encourages wider participation in international QoS activities

Identifies and develop performance monitoring activities for QoS

Identifies procedures & practices for inclusion in the ITU-T Rec.s

Disseminates information relating to QoS techniques & procedures

Development of coordinated approach to study of QoS

Pursues other activities which may improve international QoS


Work Programme (1/8)

Coordination of QoS/performance studiesCommunications Quality of Service: A framework and definitionsVocabulary for performance and quality of serviceMean Opinion Score (MOS) terminologyTransmission characteristics for wideband digital handset and headset telephones - Inclusion of extended wideband terminalsTransmission characteristics for cordless and moblie digital terminalsTransmission characteristics for wideband digital loudspeaking and hands-free telephony terminals - Inclusion of extended wideband terminalsTechnical requirements and test methods for the universal wired headset or headphone interface of digital mobile terminalsNarrowband hands-free communication in motor vehiclesWideband hands-free communication in motor vehicles



User interface requirements for automotive applicationsSubsystem requirements for automotive speech servicesArtificial earsCalculation of loudness ratings for telephone setsUse of head and torso simulator (HATS) for hands-free and handset terminal testingBone conduction testing setupMultiple test positions setupSetups and testing techniques for terminal performance measurements with background noiseArtificial voicesSpeech processing devices for acoustic enhancementTransmission characteristics and speech quality parameters of hands-free terminals



Test signals for use in telephonometryObjective test methods for speech communication systems using complex test signalsMethods for determining the ‘Objective Quality Number’ as overall quality value for terminalsApplicability of psycho-acoustic models to HATS based setups for the benefit of terminal testingSetup signals for terminal with background noiseSubjective quality evaluation of telephone services based on spoken dialogue systemsSubjective performance of active signal processing devicesCultural/language/nationality dependence of subjective qualitySubjective evaluation of generic sound activity detectorsMultidimensional scaling quality assessmentSubjective assessment methods for music quality of narrowband and wideband telephony



Test methodology for web browsing and browser based applicationsSubjective usability evaluation of speech-based or multimodal interactive servicesQ.7/12 defines test plans for tests of speech coders, and reports the test results and analysisE-model extension for non-handset user interfacesE-model extension for speech processing devicesE-model update for conversational quality featuresMixed-band and beyond-wideband E-modelE-model for monitoringOperational quality estimatorPerceptual approaches for multi-dimensional analysisPerceptual objective noise reduction



Perceptual Objective Prediction of Speech IntelligibilityNo-reference models for quality predictionSubjective method for simulated conversation tests addressing audio and audiovisual call qualityEffect of delays on the telemeeting qualityUse of auditory and visual cues for high-quality telemeetingsOverall telemeeting quality value (long term goal)Quality implications and requirements for telemeeting and conferencing servicesSpatial audio meetings quality evaluationFrequent updates of AppendicesQuality of Experience aspects of Multi ConnectionEnd-to-end QoE aspects of tandemmed speech processing devices



End-to-end performance for managed voice over LTE networks This Recommendation describes the key aspects impacting end-to-end performance of managed voice applications over LTE networks.Definitions and associated measurement methods for user-centric parameters for call handling in cellular mobile voice serviceMobile QoSSupplement XX to ITU-T E.800-series Recommendations (Guidelines on Regulatory Aspects of QoS)End-user multimedia QoS categoriesNetwork model for evaluating multimedia transmission performance over Internet ProtocolOpinion model for video and audio streaming applicationsQoE of Web-browsingQoE requirements for multicast video streaming servicesQoE requirements for telepresence servicesGuidance for the use of P.1201 and P.1202 in operational contexts



QoE-diagnostic information from P.120X.Y type models on technical causes of QoE impairmentsIntegral index of quality for general service monitoring (per user-session); KQI definitionsMedia-session QoE model (temporal pooling, long sequences; UDP- and TCP-based streaming)Parametric non-intrusive assessment of audiovisual progressive download, considering stalling/re-buffering & quality integrationParametric non-intrusive assessment of TCP-based multimedia streaming quality, considering adaptive streamingIn-service non-intrusive measurement device – Voice service measurementsAnalysis and interpretation of INMD voice-service measurementsConformance testing for voice over IP transmission quality assessment modelsConversational modelFramework for invoking diagnostic functionsVoice Service Diagnosis Framework



Technical cause analysisBuffer models for development of client performance metricsHand-over performance among multiple access networksInternet protocol data communication service – IP packet transfer and availability performance parametersNetwork performance objectives for IP-based servicesMeasurements in IP networks for inter-domain performance assessmentEthernet frame transfer and availability performanceEthernet service activation test methodologyHome network performance parametersProposed Appendices for Y.1566 : QoS mapping and interworking between Ethernet, IP and MPLS


Cannot find your Topic ?

Work in ITU-T is contribution driven !Next Meeting of Study Group 12

3 – 12 December 2013 in GenevaDeadline for Contributions

20 November 2013http://www.itu.int/net/ITU-T/ddp/Default.aspx?groupid=T13-SG12


Any questions ?

Joachim PomyTelecommunications & Int'l StandardsGermanyTel.: +49 177 78 71958Email: [email protected]

Ouagadougou, Burkina Faso, 18 July 2013 1 Overview of ITU-T Study Group 12 Activities Joachim Pomy,...

Documents

Transcript of Ouagadougou, Burkina Faso, 18 July 2013 1 Overview of ITU-T Study Group 12 Activities Joachim Pomy,...