Evalvid overview. Contents Introduction Framework and Design Functionalities Tools.
-
Upload
sharon-allison -
Category
Documents
-
view
216 -
download
0
Transcript of Evalvid overview. Contents Introduction Framework and Design Functionalities Tools.
![Page 1: Evalvid overview. Contents Introduction Framework and Design Functionalities Tools.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e915503460f94b96f40/html5/thumbnails/1.jpg)
Evalvid
overview
![Page 2: Evalvid overview. Contents Introduction Framework and Design Functionalities Tools.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e915503460f94b96f40/html5/thumbnails/2.jpg)
Contents
• Introduction• Framework and Design• Functionalities• Tools
![Page 3: Evalvid overview. Contents Introduction Framework and Design Functionalities Tools.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e915503460f94b96f40/html5/thumbnails/3.jpg)
Introduction
• Publicly available tools for video quality evaluation often assume synchronized frames at the sender and the receiver side, which means they can’t calculate the video quality in the case of frame drops or frame decoding errors
• Evalvid: evaluation of transmission-distorted video
• Trace files
![Page 4: Evalvid overview. Contents Introduction Framework and Design Functionalities Tools.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e915503460f94b96f40/html5/thumbnails/4.jpg)
Framework and Design
![Page 5: Evalvid overview. Contents Introduction Framework and Design Functionalities Tools.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e915503460f94b96f40/html5/thumbnails/5.jpg)
Functionalities
• Determination of Packet and Frame Loss• Determination of Delay and Jitter• Video Quality Evaluation
![Page 6: Evalvid overview. Contents Introduction Framework and Design Functionalities Tools.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e915503460f94b96f40/html5/thumbnails/6.jpg)
Packet loss
• unique packet id -> cancel the effect of reordering.
• which kind of data is in the packets
![Page 7: Evalvid overview. Contents Introduction Framework and Design Functionalities Tools.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e915503460f94b96f40/html5/thumbnails/7.jpg)
Frame loss
• 1 frame can be paketized in many packets -> frame loss
![Page 8: Evalvid overview. Contents Introduction Framework and Design Functionalities Tools.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e915503460f94b96f40/html5/thumbnails/8.jpg)
Determination of Delay and Jitter
• play-out buffer– This would eliminate any possible jitter at the cost
of a additional delay of the entire transmission time. The other extreme would be a buffer capable of holding exactly one frame. In this case no jitter at all can be eliminated but no additional delay is introduced
– Delay the Entire video -> big size possible
![Page 9: Evalvid overview. Contents Introduction Framework and Design Functionalities Tools.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e915503460f94b96f40/html5/thumbnails/9.jpg)
• The formal definition of jitter • variance of the inter-packet or inter-frame
time. • The “frame time” : the time at which the last
segment of a segmented frame is received.
![Page 10: Evalvid overview. Contents Introduction Framework and Design Functionalities Tools.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e915503460f94b96f40/html5/thumbnails/10.jpg)
![Page 11: Evalvid overview. Contents Introduction Framework and Design Functionalities Tools.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e915503460f94b96f40/html5/thumbnails/11.jpg)
![Page 12: Evalvid overview. Contents Introduction Framework and Design Functionalities Tools.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e915503460f94b96f40/html5/thumbnails/12.jpg)
Video Quality Evaluation
• two approaches to measure digital video quality
• subjective quality measures– impression of the user
• Objective quality measures– metric
![Page 13: Evalvid overview. Contents Introduction Framework and Design Functionalities Tools.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e915503460f94b96f40/html5/thumbnails/13.jpg)
PSNR: closed to subjective evaluation
![Page 14: Evalvid overview. Contents Introduction Framework and Design Functionalities Tools.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e915503460f94b96f40/html5/thumbnails/14.jpg)
PSNR -> MOS
![Page 15: Evalvid overview. Contents Introduction Framework and Design Functionalities Tools.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e915503460f94b96f40/html5/thumbnails/15.jpg)
Tools
![Page 16: Evalvid overview. Contents Introduction Framework and Design Functionalities Tools.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e915503460f94b96f40/html5/thumbnails/16.jpg)
Files and Data Structures
• Raw (uncoded) video files• trace files
![Page 17: Evalvid overview. Contents Introduction Framework and Design Functionalities Tools.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e915503460f94b96f40/html5/thumbnails/17.jpg)
VS - Video Sender
• generate a trace file from the encoded video file
• two trace files containing information about every frame in the video file and every packet generated for transmission
![Page 18: Evalvid overview. Contents Introduction Framework and Design Functionalities Tools.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e915503460f94b96f40/html5/thumbnails/18.jpg)
![Page 19: Evalvid overview. Contents Introduction Framework and Design Functionalities Tools.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e915503460f94b96f40/html5/thumbnails/19.jpg)
ET - Evaluate Traces
• calculation of packet and frame losses and delay/jitter takes place
• three trace files
![Page 20: Evalvid overview. Contents Introduction Framework and Design Functionalities Tools.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e915503460f94b96f40/html5/thumbnails/20.jpg)
![Page 21: Evalvid overview. Contents Introduction Framework and Design Functionalities Tools.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e915503460f94b96f40/html5/thumbnails/21.jpg)
ET (cont)
• ET can also take into account the possibility of the existence of certain time bounds.– Playout buffer
• generation of a corrupted (due of losses) video file
![Page 22: Evalvid overview. Contents Introduction Framework and Design Functionalities Tools.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e915503460f94b96f40/html5/thumbnails/22.jpg)
FV – Fix Video
• Digital video quality assessment is performed frame by frame. Therefore, the total number of video frames at the receiver side, including the erroneous frames, must be the same as that of the original video at the sender side. If the codec cannot handle missing frames, the FV component is used to tackle this problem by inserting the last successfully decoded frame in the place of each lost frame as an error concealment technique
![Page 23: Evalvid overview. Contents Introduction Framework and Design Functionalities Tools.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e915503460f94b96f40/html5/thumbnails/23.jpg)
PSNR
![Page 24: Evalvid overview. Contents Introduction Framework and Design Functionalities Tools.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e915503460f94b96f40/html5/thumbnails/24.jpg)
MOS
![Page 25: Evalvid overview. Contents Introduction Framework and Design Functionalities Tools.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649e915503460f94b96f40/html5/thumbnails/25.jpg)
3rd party tools
• TCP dump: phan tich luu luong