Sencogi® for Video Conferencing · o SENCOGI® for compression has US patent, 15/899,331...
11
Sencogi® for Video Conferencing September 2019
Transcript of Sencogi® for Video Conferencing · o SENCOGI® for compression has US patent, 15/899,331...
Sencogi® for Video Conferencing
September 2019
INTRODUCING COGISEN 2
o Granted patents for unique technology: Machine learning with physical models, not statistics.
1. US20180240221A1
2. US15/899,301
3. US15/899,331
PATENTS
o Visual complexity model which can predict eye fixations
o This model plugs into encoders and in real time modulates the codec
o Video conferencing users keep perception of quality, while provider has large improvement in bandwidth
TECHNOLOGY
o World-class experts in Machine learning, mathematics, physics, neuroscience, electronics and aerospace engineering
o Licensing contract with Tier-1 Silicon Valley Company
o Offices in Rome, Italy and Palo Alto, California
THE COMPANY
3SENCOGI ® - A SOLVED INDUSTRY MACHINE LEARNING PROBLEM
Sencogi® in real time creates a model that predicts eye fixations. This can be plugged into an encoder, allowing for compression modulation. What users notice stays the same quality, while 25-50% bandwidth is saved
The perceived quality and bandwidth savings have been validated by Cogisen’s Neuroscience experts in subjective tests that follow the industry standard for Single Stimulus Continuous Quality Scale (SSCQS) method with hidden reference removal
SENCOGI ® makes control of the subjective quality of videos possible
4USING THE PRODUCT SENCOGI ® - Conference call services
CLOUD SERVICE VIDEO Re-ENCODING
-35%bitrate
-35%bitrate
Sencogi® can connect to your cloud server encoder, to reduce downstream bitrate
Plug into server encoder
CLOUD SERVICE
-35%bitrate
Sencogi® is fast enough to run on to your device encoder, to reduce upstream bitrate
Plug into source encoder
-35%bitrate
CLOUD SERVICE VIDEO Re-ENCODING
-35%bitrate
Sencogi® works for multiple live video streams, at multiple resolutions
… for live streaming
-35%
-35%
-35%
o Plug-in code applied on server or in source depends on where customer has ability to access encoding code
o Gains are also possible if just 1 side of a conference call plugs in SENCOGI®
o Ideal use cases are live or almost live streaming:ü Video conferencingü Sportsü Live news/Streams
5USING THE PRODUCT SENCOGI ® - The Demo
H.264
View can be switched to a live presentation of the visual complexity model that predict eye fixations
A vertical, adjustable slider, dividing the screen between standard H.264 on the left and H.264 with SENCOGI® on the right
Standard x.264: 0.0000 Mbit/s - PNSR: 00.00 - SSIM:0.00
Real time metrics showing the speed and bandwidth gains for both the standard h.264 and with the SENCOGI®plugged-in
Sencogi: 0.0000 Mbit/s - PNSR: 00.00 SSIM: 0.00
On the side of the SENCOGI® you will clearly see that the person stays the same quality while background noise is reduced
Gain: 00.00% - Diff.PSNR: 0.00 - Diff.SSIM: 0.00 Mem Frame: 0.00 MB - Mem Max : 0.00 MB
6
BANDWIDTHLow (up to 640x480)
0.5-1.60 (Mbps) / 30fpsMedium (up to 1440x1080)
1.60-5.0 (Mbps) / 30fpsHigh (from 1920x1080/higher)
>5.0 (Mbps) / 30fpsAverage bitrate gain [1] 25% 35% 50%MODEL SPEED, INDEPENDENT FROM ENCODER :
CPU cycles per pixels [2] 500-600 180-250 20-50
Model calc time (sec) [3] 0.015 0.015 0.015
Latency [4] 2 frames 2 frames 2 frames
ENCODING OVERHEAD WITH SENCOGI®
Time needed to encode [5] 5% slower 5% faster 10% faster
o It can run on current server, mobile or programmable hardware platforms o Linux and Windowso Billions of videos have been encoded for H.264 using SENCOGI
Note:[1] – Perceptual gains validated with Neuroscience tests[2] – SENCOGI® speed per frame; single thread equivalent[3] – For entire frame, Intel i7[4] – Temporal model [5] – Real-time, “very-fast” mode, Intel i7
SENCOGI® REAL TIME MODEL WITH VALIDATED GAINS
7SENCOGI® SPECS & DETAILS
DETAILS SPECS
Sencogi® codebase C++ library
Lines of code in library 8700
Size of compiled binary library <1 Mb
Memory usage for real time calculation of model [1] 0.2-1.0 Mb
Lines of code that plugs into encoder <10
Gains are on top of variable bitrate encoding yes
Format of output with/without Sencogi Unchanged
Easy integration, fast enough to run directly on devices:
Note:[1] – 64 bit Windows 10, at 320x240 and 1280x720
8METRICS COMPARISON – Same bitrate (BD)
0,9682
0,9684
0,9686
0,9688
0,9690
0,9692
0,9694
0,9696
CRF 27 BD Low Res. Video Conf.
SSIM filtered SSIM unfi ltered
0,9806
0,9808
0,9810
0,9812
0,9814
0,9816
0,9818
0,9820
0,9822
CRF 23 BD Low Res. Video Conf.
SSIM filtered SSIM unfi ltered
0,9852
0,9853
0,9854
0,9855
0,9856
0,9857
0,9858
0,9859
0,9860
0,9861
CRF 21 BD Low Res. Video Conf.
SSIM filtered SSIM unfi ltered
75,00
80,00
CRF 27 BD Low Res. Video Conf.
VMAF filtered VMAF unfil tered
78,00
81,00
CRF 23 BD Low Res. Video Conf.
VMAF filtered VMAF unfil tered
79,50
81,50
CRF 21 BD Low Res. Video Conf.
VMAF filtered VMAF unfil tered
21,9000
22,0000
22,1000
22,2000
22,3000
22,4000
22,5000
22,6000
CRF 27 BD Low Res. Video Conf.
SMST filtered SMST unfiltered
22,4500
22,5000
22,5500
22,6000
22,6500
22,7000
22,7500
CRF 23 BD Low Res. Video Conf.
SMST filtered SMST unfiltered
22,7900
22,8000
22,8100
22,8200
22,8300
22,8400
22,8500
CRF 21 BD Low Res. Video Conf.
SMST filtered SMST unfiltered
37,7537,8037,8537,9037,9538,0038,0538,1038,1538,2038,2538,30
CRF 27 BD Low Res. Video Conf.
PSNR filtered PSNR unfiltered
Metrics H.264 + Sencogi H.264
SSIM 0,9694 0,9686
VMAF 79,1729 78,9055
SMST 22,5162 22,1208
PSNR 38,2389 37,9399
o The subjective gains that Sencogi® gives have been validated with Neuroscience tests.o When creating this perceptual model, care has been taken not to compromise objective metrics, as
shown for example for low resolution with the same bitrate (BD) at CRF 27 on H.264:
SSIM - H.264 + Sencogi® SSIM - H.264 VMAF - H.264 + Sencogi® VMAF - H.264 SMST - H.264 + Sencogi® SMST - H.264 PSNR - H.264 + Sencogi® PSNR - H.264
9
o SENCOGI® for compression has US patent, 15/899,331 – “Method for image processing and video compression”
o The Assessment of Sencogi: A Visual Complexity Model Predicting Visual Fixations➔ 21st Human-Computer International Conference, HCII 2019, Orlando, FL, USA,
July 26–31, 2019
o Explicit and Implicit Measures in Video Quality Assessment
➔ HUCAPP 2019, 3rd International Conference on Human Computer Interaction Theory and Applications, Prague (Czech Republic) 25-27 February 2019
SENCOGI: PEER-REVIEWED TECHNOLOGY WITH IP PROTECTION
10
Demo
Executable with live Windows demonstration on a PC of functionality and speed of Sencogi®
+1 week
Testing phase Licensing Terms Full roll-out
Full support for fast integration on customer’s servers to allow customer to quickly achieve the gain in production
FAST TO TEST AND INTEGRATE SENCOGI®
T 0
Licensing Agreementdepending onbusiness models andapplications
Executable for testingencoding on servers in both Windows and Linux at differentresolutions and qualitylevels
11CONTACTS
Pratap ReddyChief Business OfficerCogisen
T: +1 (408) 420-6559E: [email protected]
www.cogisen.com
