Towards an Open System for Multimedia Mobile Phone Exchange: Adaptation Architecture
TOWARDS “WOW!” MULTIMEDIA QUALITY OF EXPERIENCE: IF … · towards “wow!” multimedia...
Transcript of TOWARDS “WOW!” MULTIMEDIA QUALITY OF EXPERIENCE: IF … · towards “wow!” multimedia...
![Page 1: TOWARDS “WOW!” MULTIMEDIA QUALITY OF EXPERIENCE: IF … · towards “wow!” multimedia quality of experience: if you can measure it, you can achieve it judith redi multimedia](https://reader035.fdocuments.in/reader035/viewer/2022062601/5e0545d72b6f46561e057e07/html5/thumbnails/1.jpg)
TOWARDS “WOW!” MULTIMEDIA QUALITY OF EXPERIENCE:
IF YOU CAN MEASURE IT, YOU CAN ACHIEVE ITJUDITH REDI
MULTIMEDIA COMPUTING, TU DELFT DISTRIBUTED AND INTERACTIVE SYSTEMS, CWI
![Page 2: TOWARDS “WOW!” MULTIMEDIA QUALITY OF EXPERIENCE: IF … · towards “wow!” multimedia quality of experience: if you can measure it, you can achieve it judith redi multimedia](https://reader035.fdocuments.in/reader035/viewer/2022062601/5e0545d72b6f46561e057e07/html5/thumbnails/2.jpg)
WOW! EXPERIENCES
![Page 3: TOWARDS “WOW!” MULTIMEDIA QUALITY OF EXPERIENCE: IF … · towards “wow!” multimedia quality of experience: if you can measure it, you can achieve it judith redi multimedia](https://reader035.fdocuments.in/reader035/viewer/2022062601/5e0545d72b6f46561e057e07/html5/thumbnails/3.jpg)
WOW! EXPERIENCES
![Page 4: TOWARDS “WOW!” MULTIMEDIA QUALITY OF EXPERIENCE: IF … · towards “wow!” multimedia quality of experience: if you can measure it, you can achieve it judith redi multimedia](https://reader035.fdocuments.in/reader035/viewer/2022062601/5e0545d72b6f46561e057e07/html5/thumbnails/4.jpg)
VIDEO CONSUMPTION
Broadband speedUser Expectations
The amount of time lost from a viewing session due to a 1% buffering increase, has quadrupled in the past 4 years (Conviva 2015)
It would take an individual over 5 million years to watch the amount of video that will cross global IP networks each month in 2020(CISCO white paper 2016)
HDRUHD360!
Hex
abite
spe
r mon
th
![Page 5: TOWARDS “WOW!” MULTIMEDIA QUALITY OF EXPERIENCE: IF … · towards “wow!” multimedia quality of experience: if you can measure it, you can achieve it judith redi multimedia](https://reader035.fdocuments.in/reader035/viewer/2022062601/5e0545d72b6f46561e057e07/html5/thumbnails/5.jpg)
QOE CONTROL
Adaptive streaming
Perceptual coding
… Optimization …
Quality Preservation
Postprocessing
QoE-based network MGMT
![Page 6: TOWARDS “WOW!” MULTIMEDIA QUALITY OF EXPERIENCE: IF … · towards “wow!” multimedia quality of experience: if you can measure it, you can achieve it judith redi multimedia](https://reader035.fdocuments.in/reader035/viewer/2022062601/5e0545d72b6f46561e057e07/html5/thumbnails/6.jpg)
QOE CONTROL
The quality measurement system should reproduce accurately human QoE appreciation
Adaptive streaming
Perceptual coding
… Optimization …
Quality Measurement Quality Preservation
Postprocessing
QoE-based network MGMT
Lower quality! Q = 0.3!
![Page 7: TOWARDS “WOW!” MULTIMEDIA QUALITY OF EXPERIENCE: IF … · towards “wow!” multimedia quality of experience: if you can measure it, you can achieve it judith redi multimedia](https://reader035.fdocuments.in/reader035/viewer/2022062601/5e0545d72b6f46561e057e07/html5/thumbnails/7.jpg)
OBJECTIVE QUALITY MEASUREMENT
Distortion (=blockiness, stalls, freezes…) visibility ~ QoE
Prediction module QoE
CBP Neural Network
Circular Extreme Learning
MachineTCSVT 2010SPIC 2013Neurocomputing 2013
![Page 8: TOWARDS “WOW!” MULTIMEDIA QUALITY OF EXPERIENCE: IF … · towards “wow!” multimedia quality of experience: if you can measure it, you can achieve it judith redi multimedia](https://reader035.fdocuments.in/reader035/viewer/2022062601/5e0545d72b6f46561e057e07/html5/thumbnails/8.jpg)
OBJECTIVE QUALITY MEASUREMENT
Distortion (=blockiness, stalls, freezes…) visibility ~ QoE
TCSVT 2010SPIC 2013Neurocomputing 2013
But… is this really measuring QoE?
QoE
![Page 9: TOWARDS “WOW!” MULTIMEDIA QUALITY OF EXPERIENCE: IF … · towards “wow!” multimedia quality of experience: if you can measure it, you can achieve it judith redi multimedia](https://reader035.fdocuments.in/reader035/viewer/2022062601/5e0545d72b6f46561e057e07/html5/thumbnails/9.jpg)
QoE is the degree of delight or annoyance of the user of an application or service.It results from the fulfillment of his or her expectations with respect to the utility and / or enjoyment of the application or service in the light of the user’s personality and current state
SO, WHAT IS (WOW) QOE?
![Page 10: TOWARDS “WOW!” MULTIMEDIA QUALITY OF EXPERIENCE: IF … · towards “wow!” multimedia quality of experience: if you can measure it, you can achieve it judith redi multimedia](https://reader035.fdocuments.in/reader035/viewer/2022062601/5e0545d72b6f46561e057e07/html5/thumbnails/10.jpg)
QoE is the degree of delight or annoyance of the user of an application or service.It results from the fulfillment of his or her expectations with respect to the utility and / or enjoyment of the application or service in the light of the user’s personality and current state
SO, WHAT IS (WOW) QOE?
Variance explained by user factorsVariance explained by system factorsQoMEX 2016, PQS 2016
![Page 11: TOWARDS “WOW!” MULTIMEDIA QUALITY OF EXPERIENCE: IF … · towards “wow!” multimedia quality of experience: if you can measure it, you can achieve it judith redi multimedia](https://reader035.fdocuments.in/reader035/viewer/2022062601/5e0545d72b6f46561e057e07/html5/thumbnails/11.jpg)
ENABLING “WOW!” EXPERIENCES
Providing the right video to the right user at the right time and at the right quality for that user
![Page 12: TOWARDS “WOW!” MULTIMEDIA QUALITY OF EXPERIENCE: IF … · towards “wow!” multimedia quality of experience: if you can measure it, you can achieve it judith redi multimedia](https://reader035.fdocuments.in/reader035/viewer/2022062601/5e0545d72b6f46561e057e07/html5/thumbnails/12.jpg)
ENABLING “WOW!” EXPERIENCES
Providing the right video to the right user at the right time and at the right quality for that user
Perception
System Factors
Bitrate, loss, ...
QoE
![Page 13: TOWARDS “WOW!” MULTIMEDIA QUALITY OF EXPERIENCE: IF … · towards “wow!” multimedia quality of experience: if you can measure it, you can achieve it judith redi multimedia](https://reader035.fdocuments.in/reader035/viewer/2022062601/5e0545d72b6f46561e057e07/html5/thumbnails/13.jpg)
ENABLING “WOW!” EXPERIENCES
Providing the right video to the right user at the right time and at the right quality for that user
Perception
System Factors
Bitrate, loss, ...
QoE
Context Factors
TaskSocial Context
Economical Cont.
Semantic ContentAffective ContentISM’16
User Factors
PersonalityInterestGender..MM’16
CHB’15
![Page 14: TOWARDS “WOW!” MULTIMEDIA QUALITY OF EXPERIENCE: IF … · towards “wow!” multimedia quality of experience: if you can measure it, you can achieve it judith redi multimedia](https://reader035.fdocuments.in/reader035/viewer/2022062601/5e0545d72b6f46561e057e07/html5/thumbnails/14.jpg)
ENABLING “WOW!” EXPERIENCES
Providing the right video to the right user at the right time and at the right quality for that user
Perception
System Factors
Bitrate, loss, ...
QoE
Context Factors
TaskSocial Context
Economical Cont.Interaction
TVX’15
Semantic ContentAffective ContentISM’16
User Factors
PersonalityInterestGender..MM’16
CHB’15
![Page 15: TOWARDS “WOW!” MULTIMEDIA QUALITY OF EXPERIENCE: IF … · towards “wow!” multimedia quality of experience: if you can measure it, you can achieve it judith redi multimedia](https://reader035.fdocuments.in/reader035/viewer/2022062601/5e0545d72b6f46561e057e07/html5/thumbnails/15.jpg)
WOW! EMPATHIC EXPERIENCES
8
![Page 16: TOWARDS “WOW!” MULTIMEDIA QUALITY OF EXPERIENCE: IF … · towards “wow!” multimedia quality of experience: if you can measure it, you can achieve it judith redi multimedia](https://reader035.fdocuments.in/reader035/viewer/2022062601/5e0545d72b6f46561e057e07/html5/thumbnails/16.jpg)
WOW! EMPATHIC EXPERIENCES
8
![Page 17: TOWARDS “WOW!” MULTIMEDIA QUALITY OF EXPERIENCE: IF … · towards “wow!” multimedia quality of experience: if you can measure it, you can achieve it judith redi multimedia](https://reader035.fdocuments.in/reader035/viewer/2022062601/5e0545d72b6f46561e057e07/html5/thumbnails/17.jpg)
WOW! EMPATHIC EXPERIENCES
Can we design MM systems that are so intelligentthat they can detect negative affective states and
and provide empathic experiences to make the user feel better?
8
![Page 18: TOWARDS “WOW!” MULTIMEDIA QUALITY OF EXPERIENCE: IF … · towards “wow!” multimedia quality of experience: if you can measure it, you can achieve it judith redi multimedia](https://reader035.fdocuments.in/reader035/viewer/2022062601/5e0545d72b6f46561e057e07/html5/thumbnails/18.jpg)
EMPATHIC MM EXPERIENCES: CHALLENGES
User Sensing and Modeling
Design: MM Alternate Realities