THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5...

40

Transcript of THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5...

Page 1: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint
Page 2: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint
Page 3: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

THE MCUTHE SFU P2P MESH

Page 4: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

THE MCUTHE SFU P2P MESH

mix

Page 5: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

THE MCUTHE SFU P2P MESS

mix

Page 6: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

mix

THE MCUTHE SFU P2P MESS

Page 7: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

mix

THE MCUTHE SFU P2P MESS

ALL ABOUT THE PERFALL ABOUT INTEROP ALL ABOUT … NOT SURE

Page 8: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

THE SFU

ALL ABOUT THE PERF

Page 9: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

20% CPU1000 video streams550 Megabitshttps://jitsi.org/videobridge/performance

Page 10: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

BANDWIDTH?but … then how do you adapt to

Page 11: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

SIM & SVCin a nutshell

Page 12: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

s i m u l c a s t

Page 13: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

SVC: SCALABLE VIDEO CODING

Page 14: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

SVC: SCALABLE VIDEO CODING

Page 15: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

SVC: SCALABLE VIDEO CODING

Page 16: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

SVC: SCALABLE VIDEO CODING

Page 17: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

SPACIAL SVC

Page 18: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

TEMPORAL SVC7.5 fps15 fps

30 fps

Page 19: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

1080p

simulcast: raison d'être

360p

720p

1080p

using endpoint generated bandwidth estimations (REMB)draft-alvestrand-rmcat-congestiondraft-alvestrand-rmcat-remb

Page 20: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

1080p

fiber or cable

simulcast: raison d'être

360p

720p

1080p

using endpoint generated bandwidth estimations (REMB)draft-alvestrand-rmcat-congestiondraft-alvestrand-rmcat-remb

Page 21: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

Wi-Fi

720p

simulcast: raison d'être

360p

720p

1080p

using endpoint generated bandwidth estimations (REMB)draft-alvestrand-rmcat-congestiondraft-alvestrand-rmcat-remb

Page 22: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

3g

360p

simulcast: raison d'être

360p

720p

1080p

using endpoint generated bandwidth estimations (REMB)draft-alvestrand-rmcat-congestiondraft-alvestrand-rmcat-remb

Page 23: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

3g

360p

fiber or cable

simulcast: raison d'être

360p

720p

1080p

using endpoint generated bandwidth estimations (REMB)draft-alvestrand-rmcat-congestiondraft-alvestrand-rmcat-remb

Page 24: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

3g

360p

Wi-Fi

simulcast: raison d'être

360p

720p

using endpoint generated bandwidth estimations (REMB)draft-alvestrand-rmcat-congestiondraft-alvestrand-rmcat-remb

Page 25: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

360p

3g

360p

3g

simulcast: raison d'être

using endpoint generated bandwidth estimations (REMB)draft-alvestrand-rmcat-congestiondraft-alvestrand-rmcat-remb

Page 26: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

noyes sort of

Page 27: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

yes soon maybe soon maybe

Page 28: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

simulcast in chromeo=- 3407482598521328076 2 IN IP4 127.0.0.1s=-t=0 0a=group:BUNDLE audio video data...m=audio 9 RTP/SAVPF 111 103 104 9 0 8 106 105 13 126...m=video 9 RTP/SAVPF 100 116 117 96...cre

ateOf

fer

Page 29: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

simulcast in chromeo=- 3407482598521328076 2 IN IP4 127.0.0.1s=-t=0 0...m=audio 9 RTP/SAVPF 111 103 104 9 0 8 106 105 13 126...m=video 9 RTP/SAVPF 100 116 117 96a=ssrc-group:SIM 3535700627 3169665807 0902838992a=ssrc:3535700627 cname:localCnamea=ssrc:3535700627 msid:DN4NQ 0a1622a6a67da=ssrc:3169665807 cname:localCnamea=ssrc:3169665807 msid:DN4NQ 0a1622a6a67da=ssrc:0902838992 cname:localCnamea=ssrc:0902838992 msid:DN4NQ 0a1622a6a67dse

tLocal

Descr

iption

simulc

ast

Page 30: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

THREE SIMULCAST LAYERSWITH 3 TEMPORAL

BONU

SLAYERS EACH

Page 31: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

s i m u l c a s t

Page 32: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

THANKS FOR THE HELP, GEORGE POLITIS

Page 33: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

simulcast in chrome

Page 34: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

simulcast @ ietfoff

er/an

swer m=video

a=sendrecva=mid:v1 (max resolution)a=rid:1 send pt=*; max-width=1280; max-height=720; max-fps=30a=rid:2 recv pt=*; max-width=1280; max-height=720; max-fps=30a=rid:5 send pt=*; max-width=640; max-height=360; max-fps=15a=rid:6 send pt=*; max-width=320; max-height=180; max-fps=15

draft-pthatcher-mmusic-rid

Page 35: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

simulcast with ortc

Page 36: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

RTCP TERMINATION

Page 37: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

WITHOUT RTCP TERMINATION80% PACKET LOSS

Page 38: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

WITH RTCP TERMINATION00% PACKET LOSS 80% PACKET LOSS

Page 39: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint

WITH RTCP TERMINATION00% PACKET LOSS 80% PACKET LOSS

NACK TERMINATION AND PACKET CACHING

Page 40: THE SFUTHE MCUP2P MESHfiles.meetup.com/8878612/2015-10-06-jitsi@sydney_s.pdf · TEMPORAL SVC 7.5 fps 15 fps 30 fps. 1080p simulcast: raison d'être 360p 720p 1080p using endpoint