ITU-T Study Group 12: Structures and Guide for University Participants
-
Upload
tanya-oconnor -
Category
Documents
-
view
27 -
download
2
description
Transcript of ITU-T Study Group 12: Structures and Guide for University Participants
ITU-T Study Group 12: Structures andGuide for University Participants Sebastian Möller(with the support from Jean-Yves Monfort, ITU-T SG12 Chairman)
Quality and Usability Lab, Deutsche Telekom Laboratories
TU Berlin, Germany
2
Overview
Structure of ITU-T Study Group 12 – General structure of the ITU-T– Study Group 12– Documents, etc.
Quality assessment and prediction for voice services
3
General Secretariat: Coordinates the Union's activities and the overall management of the Union
ITU-T: Telecommunication standardization on a world-wide basis on technical, operating and tariff Questions
ITU-R: Radio communications and wireless ITU-D: Use and deployment of telecom networks
and services in the developing nations
Plenipotentiary Conference
ITU Council
ITU-TWorld
Telecommunication Standardization
Assembly
ITU-RWorld
Radiocommunication Conference
ITU-DWorld
Telecommunication Development Conference
GeneralSecretariat
Structure of ITU-T Study Group 12General structure of the ITU-T.
4
WORLD TELECOMMUNICATIONSTANDARDIZATION ASSEMBLY
TELECOMMUNICATIONSTANDARDIZATIONADVISORY GROUP
WORKINGPARTY
R
STUDY GROUP X STUDY GROUP Y
WORKINGPARTY
WORKINGPARTY
R R R
R = RAPPORTEUR GROUP
RECOMMENDATION EDITORS
R R R R
(WTSA)
(TSAG)
(WP)
STUDY GROUP XX
Structure of ITU-T Study Group 12Structure of ITU-T Study Groups and Working Parties.
5
Workshops / Seminars: Cover the most important topics in modern
telecommunication technology and applications. Speakers are renowned telecommunication experts. Usually free of charge and open to public . To come : From Speech to Audio: Bandwidth Extension,
Binaural Perception, see http://www.itu.int/ITU-T/studygroups/com12/index.asp.
Focus Groups: Participation of non-member experts welcome. Work on a well-defined topic and time-schedule for
completion. e.g. : IPTV Focus Group in which SG12 is involved Under SG12 : Focus Group From/In/ToCarCommunication,
see http://www.itu.int/ITU-T/studygroups/com12/fgfit/index.html
Joint Coordination Groups: Coordinate a broad study by more than one study group.
They do not perform technical studies nor write Recommendations.
Structure of ITU-T Study Group 12Structure of ITU-T Study Groups and Working Parties.
6
Responsible for Recommendations on the end-to-end transmission performance of terminals and networks, in relation to the perceived quality and acceptance by users of text, data, speech, and multi-media applications. Although this work includes the related transmission implications of all networks and all telecommunication terminals, a special focus is given to IP QoS, interoperability and implications for NGN, and also includes work on performance and resource management.
Structure of ITU-T Study Group 12Study Group 12 mandate.
7
Bridging the gapfor developping countriesMr J.J. Massima-Landji, VC
SG 12 – Performance and QoS
Chairman Mr Jean-Yves Monfort
Telephonometry, terminals and subjectiveassessmentCo-Chairs : C. Quinquis, G. Lecucq
Performance, planning and tools
Mr Klemens Adler, SG 12 Vice Chair
WP 1
WP 2
WP 3 IP-related QoS and resource management
M. Paul Coverdale, SG 12 Vice Chair
QoS CoordinationMr C. Dvorak, VC
TSB Support
Mrs J. Katona Kiss, Councellor
Mrs S. Scott, Secretary
Structure of ITU-T Study Group 12Management team and structure.
8
SG 12 – Questions 1/12 and 15/12
Q.1/12
Q.15/12QoS and performance
coordinationMr C. Dvorak
QoS and performancecoordination
Mr C. Dvorak
Workprogram, definitions, handbooks, guides, tutorials, Bridging the Standardization GapsMr JY Monfort, Mr J. Pomy, Mr J.J. Massima-Landji
Structure of ITU-T Study Group 12SG12 structure and questions.
9
WP /12 – Telephonometry, terminalsand Subjective assessment
Co Acting Chairs C. Quinquis, G. Lecucq
Q.4/12
Q.5/12
Hands-free communications in vehicles Mr H.W. Gierlich, Mr M.
Rung
Telephonometrics methodologies for handsets and headset terminals Mr L. Madec
Q.7/12 Methods, tools and test plans for the subjective assessment… Mr P. Usai and Mrs C. Quinquis
Q.3/12
Analysis methods using complex measurement signals…. Mr H.W. Gierlich
Q.6/12
Speech transmission characteristics of speech terminals … Mr Shi Denian
Structure of ITU-T Study Group 12SG12 structure and questions.
10
WP 2/12 – Performance, Planning and Tools
Chairman Mr Klemens Adler
Q.9/12
Q.10/12
Perceptual-based objective methods for voice, audio and visual quality… Mr J. Berger
Transmission planning and performance considerations… Mr V. Sypli
Q.20/12 Objective assessment of conversational speech quality in networks Mr J. Pomy
Objective assessment of conversational speech quality in networks Mr J. Pomy
Q.8/12
In-service non intrusive assessment of voice transmission performance Mr V. Barriac
Q.14/12
Extension of the E-model Mrs U. Jekosch and Mr S. Möller
Q.12/12Performance evaluation of services based on speech technology Mr S.Möller&MrA. Raake
Structure of ITU-T Study Group 12SG12 structure and questions.
11
WP 3/12 – IP-Related QoS andRessource management
Chairman Mr Paul Coverdale(also involved in Questions* 13/12 and 19/12)
Q.13/12
Q.16/12
IP based multimedia services end to end transm. planning …. M. J. Pomy
IPTV and multimedia QoE/QoS performance requ. and assessment methods A. Takahashi
IPTV and multimedia QoE/QoS performance requ. and assessment methods A. Takahashi
Q.19/12
Performance of IP-based networks Mr A. Morton and Mr
H. Kim
Speech transmission charact. & meas. methods for IP terminals and gateways Mr U. Brunner
Q.11/12
Broadband and IP-related resource management Mr D. Mustill
Q.17/12
Call processing performance Call processing performance
Q.2/12
Structure of ITU-T Study Group 12SG12 structure and questions.
12
SG 12 Liaison OfficersSG 12 Liaison Officers
IEEE
QSDG
Electroacoustics Mr L. Madec, Mr H.Gerlich
Electroacoustics Mr A. WooElectroacoustics Mr A. Woo
Others
Communication Mr C. Dvorak,EWM Mr J. Pomy, Bridging the standardization Gaps Mr J.J. Massima-Landji
Joint Rapporteur Group "Multimedia quality assessment" Mr P. Juric
IEC 29
QoS Development Group Mr D. Mustill
TSAG
Security, OAM, ICG-SAT Mr JY Monfort, FGNGN Mr C.Dvorak, FGNGN Mr P. CoverdaleITU-D Mr J.J. Massima
Security, OAM, ICG-SAT Mr JY Monfort, FGNGN Mr C.Dvorak, FGNGN Mr P. CoverdaleITU-D Mr J.J. Massima
JRG MMQA
Flagship Group QoS Mr D. Waturu Flagship Group QoS Mr D. Waturu
Structure of ITU-T Study Group 12SG12 structure and questions.
13
Questions: Set up by the WTSA or by the Study Group. Define a particular subject to be studied.Rapporteurs: Appointed by the SG or a WP to each Question. Ensure progress of the group of experts towards
Recommendations. Lead, moderate debates (e-mails, conf. Calls, etc.)
and coordinate progress. Chair the meetings of the experts (Rapporteurs
Group Meetings).Editors: Appointed by Rapporteurs, prepare and follow-up
draft Recommendations.
Structure of ITU-T Study Group 12Questions, Rapporteurs and Editors.
14
Alternative Approval Process (AAP):
For technical Recommendations
Once the text is considered to be mature, it is submitted for AAP at an SG or WP meeting (Rec. A.8)
Traditional Approval Process (TAP):
For Recommendations subject to policy or regulatory implications
Initiated at an SG or WP meeting and completed, for final approval, at the subsequent SG meeting (Res. 1)
Structure of ITU-T Study Group 12Approval of Recommendations.
15
TG120480-00
4(b)
(c)
9 11
(a)
(a) (b)
(a)(b)
SG orWP
meeting(1)
Editedtext
for LC(2)
Director'sannouncementand postingfor LC
(3)
Editedtext
for AR(8)
Director'sannouncementand postingfor AR
(10)
Director'sannouncement
and posting(5)
SGMeeting
(6)
Director'snotification
and publication(see Rec. A.11)
(12)
3 weeks
LC: Last Call
AR: Additional Review
Approved
Approved
Approved
Commentresolution
AR3 weeks
LC4 weeks
(7)
See Figure 1 (Rec. A.8)
Structure of ITU-T Study Group 12AAP Sequence.
16
Contributions (C):
To be submitted at least 10 calendar days before the meeting.
Reports (R):
Official records of SG or WP meetings. To be available shortly after the closure of the meetings (Rec. A.1).
Temporary Documents (TDs):
Submitted by an ‘official’ (a member of the SG Management Team, Rapporteur, Editor, etc.) within the meeting participants.
Working Documents (WDs):
Issued during meetings by small groups.
Structure of ITU-T Study Group 12Meeting documentation.
Visit www.itu.int/ITU-T/studygroups/com12/index.aspfor more information.
Structure of ITU-T Study Group 12Further information.
18
Overview
Structure of ITU-T Study Group 12 Quality assessment and prediction for voice
services– Quality assessment and prediction– Taxonomy of prediction models– E-model for NB and WB networks
19
Our focus: Methods for assessing narrow-band and wideband speech,but also video quality
Quality Assessment and PredictionVoice services.
ModelEstimated Quality Index
SystemParameter
s
Linguist.Backgr.
AttitudeEmotions Experi-ence
Motivation,
GoalsUser Factors
Subjective Quality Judgment
Transmission
System
20
Quality:Result of judgment of theperceived composition ofan entity with respectto its desired composition.(Jekosch, 2005) Quality of Service
(Rec. E.800) Quality of Experience
Quality Assessment and PredictionQuality aspects of transmitted speech.
Quality of Service
ServiceFactors
Contextual
Factors
Speech Communication
Factors
Voice Transmissio
nQuality
Ease of Communic
ation
Conversation
Effectiveness
Communication
Efficiency
Economical
Benefit
Service Efficien
cy
Usability
Utility
Acceptability
UserSatisfacti
on
User
Facto
rs
Quality of Experience
(Möller, 2000)
21
Input information: Signals
− one or two signals− acoustic or electric
Parameters Protocol information
Measurement of input information:
Online Offline Estimation
Quality Assessment and Prediction Taxonomy of prediction models.
Output information: Listening-only
− integral quality− quality features
Conversational Talking-only
Application area: Planning Set-up and optimization Monitoring
Network type: Narrow-band Wideband
22
Quality Assessment and Prediction Taxonomy of prediction models: Narrow-band case.
Listening Conversation
OverallQuality
QualityFeat.
OverallQuality
QualityFeat.
Signals 1, el. P.563 Psychoac.
Measures
CCI (P.562)
1, ac. Psychoac.
Measures
2, el. P.862P.OLQA
[Heute05]
P.CQO? P.CQO?
2, ac. P.OLQA [STI]P.OLQA
?Protocol Meas. P.VTQ?
P.CQO?P.CQO?
Parameters Estim. G.107
Meas. NIEM (P.562)
Output InformationIn
put
Info
rmati
on
23
Listening Conversation
OverallQuality
QualityFeat.
OverallQuality
QualityFeat.
Signals 1, el. Psychoac.
Measures
1, ac. Psychoac.
Measures
2, el. P.862.2P.OLQA
[Heute05]
2, ac. P.OLQA [STI]P.OLQA
?Protocol Meas.
Parameters Estim. WB-E-Model
Meas.
Quality Assessment and Prediction Taxonomy of prediction models: Wideband case.
Output InformationIn
put
Info
rmati
on
24
Quality Assessment and Prediction E-model for narrow-band networks.
Backgr.noise,acousticcoupling
Linear distortion, delay
Codec Packetloss
Jitterbuffer,VAD
Talker echo,listener echo
Circuitnoise
Backgr.noise,acousticcoupling
IP WAN
IP WAN
4
4
25
IP WAN
IP WAN
4
4
Quality Assessment and Prediction E-model for narrow-band networks.
Overall quality R = Ro - Is - Id - Ie,eff
Estimated user judgment MOS = f (R )
Impairments SNR simultaneous delayed nonlin./timevar.
Ps, Ds,STMR
SLR, RLR, Ta
Ie, qdu PplBpl TELR, T,WEPL, Tr
Nc, Nfor Pr, Dr,LSTR
26
Quality Assessment and Prediction E-model extension for wideband networks.
(Raake, 2006; Appendix II, ITU-T Rec. G.107, 2006)
0 20 40 60 80 1000
20
40
60
80
100
120
140R
max=129
RNB/WB
RN
B
Ro,max = 129
27
Quality Assessment and Prediction E-model extension for wideband networks.
Ref.Operating rate kbit/s
Ie,wbvalue
G.722 64 1356 2048 31
G.722.1 32 1324 19
G.722.2 23.85 823.05 119.85 318.25 515.85 714.25 1012.65 138.85 266.6 41
G.711 64 36G.728 16 43G.729 8 46G.729A + VAD 8 47IS-54 8 56GSM 06.10, FR 13 56GSM 06.60, EFR 12.2 41G.723.1 5.3 55G.723.1 6.3 51
Ro,max = 129
(Raake, 2006;Möller et al., 2006)
AMR-WB (23.05)
AMR-WB (6.6)
Thanks to Jean-Yves Monfort (ITU-T SG12 Chairman) for providing the description of Study Group 12.
Thank you for your attention.
Visit www.qu.tlabs.tu-berlin.de for more information.