Web rtc infrastructure the hard parts v4
-
Upload
dialogic-inc -
Category
Documents
-
view
99 -
download
3
Transcript of Web rtc infrastructure the hard parts v4
COMPANY CONFIDENTIAL © COPYRIGHT 2015 DIALOGIC CORPORATION. ALL RIGHTS RESERVED.1
COMPANY CONFIDENTIAL © COPYRIGHT 2015 DIALOGIC CORPORATION. ALL RIGHTS RESERVED.
WebRTC Infrastructure:THE HARD PARTS
WebRTC Global Summit
COMPANY CONFIDENTIAL © COPYRIGHT 2015 DIALOGIC CORPORATION. ALL RIGHTS RESERVED.2
Why Terminate Media?
NAT Traversal: TURN Gateway Media Server
COMPANY CONFIDENTIAL © COPYRIGHT 2015 DIALOGIC CORPORATION. ALL RIGHTS RESERVED.3
NAT Traversal: TURN Gateway Media Server
Why Terminate Media?
TURN Server
TURN for NAT Traversal
COMPANY CONFIDENTIAL © COPYRIGHT 2015 DIALOGIC CORPORATION. ALL RIGHTS RESERVED.4
NAT Traversal: TURN Gateway Media Server
Why Terminate Media?
Gateway for Interworking
Web signaling
WebRTC media
SIP
VoIP media
GW SIP
COMPANY CONFIDENTIAL © COPYRIGHT 2015 DIALOGIC CORPORATION. ALL RIGHTS RESERVED.5
NAT Traversal: TURN Gateway Media Server
Why Terminate Media?
Media Servers for…
COMPANY CONFIDENTIAL © COPYRIGHT 2015 DIALOGIC CORPORATION. ALL RIGHTS RESERVED.6
Many Reasons for a Media Server
Conferencing InterworkingTranscoding
Stream processingRecording Person-to-machine
COMPANY CONFIDENTIAL © COPYRIGHT 2015 DIALOGIC CORPORATION. ALL RIGHTS RESERVED.7
Why process media server-side?
COMPANY CONFIDENTIAL © COPYRIGHT 2015 DIALOGIC CORPORATION. ALL RIGHTS RESERVED.8
Many Reasons for a Media ServerConferencing
Conferencing
COMPANY CONFIDENTIAL © COPYRIGHT 2015 DIALOGIC CORPORATION. ALL RIGHTS RESERVED.9
Mesh model does not scale
Distributed peer-to-peer mesh Centralized with media server
COMPANY CONFIDENTIAL © COPYRIGHT 2015 DIALOGIC CORPORATION. ALL RIGHTS RESERVED.10
Many Reasons for a Media ServerTranscoding
Transcoding
Transcoding: because we live in an imperfect world
COMPANY CONFIDENTIAL © COPYRIGHT 2015 DIALOGIC CORPORATION. ALL RIGHTS RESERVED.11
Many Reasons for a Media ServerServer Side Media-Processing
Server-side media handling for:
Application work-flows
Security
Compliance
Performance
Reliability
Stream processingRecording Person-to-machine
COMPANY CONFIDENTIAL © COPYRIGHT 2015 DIALOGIC CORPORATION. ALL RIGHTS RESERVED.12
Add value to terminated media
+
Today• Audio & video conferencing• Multi-camera switching• Compliance recording• Speech detection• Audio/video insertion• Speech recognition• Automated IVR navigation• Speaker CDR analytics
Not too far away• Live RTC stream distribution• Facial recognition• Voice fingerprinting• Health biometrics• Object detection• Machine vision• Sentiment analysis• Augmented reality
COMPANY CONFIDENTIAL © COPYRIGHT 2015 DIALOGIC CORPORATION. ALL RIGHTS RESERVED.13
Many Reasons for a Media ServerConferencing
Conferencing
COMPANY CONFIDENTIAL © COPYRIGHT 2015 DIALOGIC CORPORATION. ALL RIGHTS RESERVED.14
Traditional MCU Resource Usage
Worst-case process:1. Each stream
decoded at the MCU
2. MCU mixes each conferee
3. MCU encodes individual mix for each conferee
MCU
11 2
23
34
455
66
Ingress streams 6
Egress streams 6
MCU decodes 6
MCU encodes 6
COMPANY CONFIDENTIAL © COPYRIGHT 2015 DIALOGIC CORPORATION. ALL RIGHTS RESERVED.15
Efficient MCU Resource Usage
Efficient process:1. Each stream
decoded at the MCU
2. MCU mixes each conferee
3. MCU shares same encoder for all conferees
MCU
12
3
45
6
Ingress streams 6
Egress streams 6
MCU decodes 6
MCU encodes 1
1
30%-50% reduction in compute resources
COMPANY CONFIDENTIAL © COPYRIGHT 2015 DIALOGIC CORPORATION. ALL RIGHTS RESERVED.16
Newer Approach: SFU
SFU
Selective Forwarding Unit (SFU) routing
Clients send one & receive many
Client can instruct SFU which streams to send
High throughput
Can be lots of downlink bandwidth
Low latency
COMPANY CONFIDENTIAL © COPYRIGHT 2015 DIALOGIC CORPORATION. ALL RIGHTS RESERVED.17
Newer Approach: SFU
SFU
Selective Forwarding Unit (SFU) routing
Clients send one & receive many
Client can instruct SFU which streams to send
High throughput
Can be lots of downlink bandwidth
Low latency
COMPANY CONFIDENTIAL © COPYRIGHT 2015 DIALOGIC CORPORATION. ALL RIGHTS RESERVED.18
New WebRTC Approach: Simulcast
SFU
High bitrate
Low bitrate
Selective Forwarding Unit (SFU) with Simulcast
Clients send multiple streams to SFU
one high-bit rate
one or more lower-bit
Client directs SFU which streams to receive
Reduces bandwidth vs. SFU
Simulcast in WebRTCcoming
COMPANY CONFIDENTIAL © COPYRIGHT 2015 DIALOGIC CORPORATION. ALL RIGHTS RESERVED.19
Future Approach with VP9 – SVC?
SFU
MediumHigh LowLayered bitrates:
Selective Forwarding Unit (SFU) with Scalable Video Coding (SVC)
Clients send layered stream to SFU
Layers have varying bitrates –time, size, quality
SFU directs who gets what
Coming to WebRTC eventually
COMPANY CONFIDENTIAL © COPYRIGHT 2015 DIALOGIC CORPORATION. ALL RIGHTS RESERVED.20
Media server network model
Load BalancerMRB
Client Client Client Client Client Client
App ServerApp ServerApp Server
Media Server
Media Resource Broker:Intelligent load balancer & orchestration for media servers
COMPANY CONFIDENTIAL © COPYRIGHT 2015 DIALOGIC CORPORATION. ALL RIGHTS RESERVED.21
Pseudo Call-flow with a media server
AS MRB MS1 MS2 Client
Call signaling
Media control
MS1 status
MS2 status
Media control Media
COMPANY CONFIDENTIAL © COPYRIGHT 2015 DIALOGIC CORPORATION. ALL RIGHTS RESERVED.22
Pseudo Call-flow – traditional fail-over with RE-INVITE
AS MRB MS1 MS2 Client
Call signaling – REINVITE with new addresses
Media control
MS1 status
MS2 status
Media control + call states
Media
COMPANY CONFIDENTIAL © COPYRIGHT 2015 DIALOGIC CORPORATION. ALL RIGHTS RESERVED.23
Pseudo Call-flow – fail-over the cloud/NFV way
AS MRB MS1 MS2 Client
Media control
MS1 status
MS2 status
New container
Media
Memcache & Virtual IP Address
COMPANY CONFIDENTIAL © COPYRIGHT 2015 DIALOGIC CORPORATION. ALL RIGHTS RESERVED.24
Conclusions
Terminating media isn’t cheap, so avoid it if you can
Like it or not, you will probably need server-side media sometimes
If you need server-side media, maximize the value you get from it
Architectures are evolving to make media-processing more efficient & scalable