NGI Summer Project Streaming Media Extensions to Open Mash and Indiva Allan Gu.
-
date post
19-Dec-2015 -
Category
Documents
-
view
221 -
download
1
Transcript of NGI Summer Project Streaming Media Extensions to Open Mash and Indiva Allan Gu.
![Page 1: NGI Summer Project Streaming Media Extensions to Open Mash and Indiva Allan Gu.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d3b5503460f94a163fa/html5/thumbnails/1.jpg)
NGI Summer ProjectNGI Summer Project
Streaming Media Extensionsto Open Mash and Indiva
Allan Gu
![Page 2: NGI Summer Project Streaming Media Extensions to Open Mash and Indiva Allan Gu.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d3b5503460f94a163fa/html5/thumbnails/2.jpg)
NGI Summer Research (8/02) 2
Multicast BackboneMulticast Backbone(Mbone)(Mbone)
MulticastDistribution of IP packets to many hosts
Many-to-many communication
Mbone ToolsNSDR
VAT/RAT
VIC
![Page 3: NGI Summer Project Streaming Media Extensions to Open Mash and Indiva Allan Gu.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d3b5503460f94a163fa/html5/thumbnails/3.jpg)
NGI Summer Research (8/02) 3
NSDRNSDR SAP listener SAP announcer
![Page 4: NGI Summer Project Streaming Media Extensions to Open Mash and Indiva Allan Gu.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d3b5503460f94a163fa/html5/thumbnails/4.jpg)
NGI Summer Research (8/02) 4
VAT/RATVAT/RAT
Audio tool Participants talk
to each other
![Page 5: NGI Summer Project Streaming Media Extensions to Open Mash and Indiva Allan Gu.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d3b5503460f94a163fa/html5/thumbnails/5.jpg)
NGI Summer Research (8/02) 5
VICVIC Viewer Encoder
![Page 6: NGI Summer Project Streaming Media Extensions to Open Mash and Indiva Allan Gu.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d3b5503460f94a163fa/html5/thumbnails/6.jpg)
NGI Summer Research (8/02) 6
OpenMashOpenMash
Comprehensive toolkitCollection of Mbone toolsOpen source
![Page 7: NGI Summer Project Streaming Media Extensions to Open Mash and Indiva Allan Gu.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d3b5503460f94a163fa/html5/thumbnails/7.jpg)
NGI Summer Research (8/02) 7
ProblemsProblems
VIC displays useless streamSave screen real estateSave resources
Cache of multicast sessionsWeb interface
![Page 8: NGI Summer Project Streaming Media Extensions to Open Mash and Indiva Allan Gu.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d3b5503460f94a163fa/html5/thumbnails/8.jpg)
NGI Summer Research (8/02) 8
![Page 9: NGI Summer Project Streaming Media Extensions to Open Mash and Indiva Allan Gu.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d3b5503460f94a163fa/html5/thumbnails/9.jpg)
NGI Summer Research (8/02) 9
Blue StreamBlue StreamCamera OffEncoder encodes default blue
![Page 10: NGI Summer Project Streaming Media Extensions to Open Mash and Indiva Allan Gu.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d3b5503460f94a163fa/html5/thumbnails/10.jpg)
NGI Summer Research (8/02) 10
Algorithm to RemoveAlgorithm to RemoveBlue StreamBlue Stream
Check YUV frame
5 blocks of 4 pixels
Compare Y, U, V with known color
Blue is (Y,U,V) = (35, 212, 114)
![Page 11: NGI Summer Project Streaming Media Extensions to Open Mash and Indiva Allan Gu.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d3b5503460f94a163fa/html5/thumbnails/11.jpg)
NGI Summer Research (8/02) 11
Black StreamBlack Stream
Lights Off Can’t
compare Different
black Error not
black
![Page 12: NGI Summer Project Streaming Media Extensions to Open Mash and Indiva Allan Gu.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d3b5503460f94a163fa/html5/thumbnails/12.jpg)
NGI Summer Research (8/02) 12
Algorithm to RemoveAlgorithm to RemoveBlack StreamBlack Stream
Examine 20 blocks of 4 pixels eachNeed more samples to detect
Count number of values within ranges4 BINS (3 Black, 1 Other)
Also compute average value of pixelsBlack if satisfy certain condition
50% of pixels is true black (Y<16, 120<U&V <136)
AvgY<28, 120<avgU&avgV<136
![Page 13: NGI Summer Project Streaming Media Extensions to Open Mash and Indiva Allan Gu.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d3b5503460f94a163fa/html5/thumbnails/13.jpg)
NGI Summer Research (8/02) 13
Remove StreamRemove Stream
Drop packets from senderRemove thumbnail Callback to test stream later
Accept packet and check if still black or blue
If not black or blue, put back thumbnail
If still black or blue, register another callback
![Page 14: NGI Summer Project Streaming Media Extensions to Open Mash and Indiva Allan Gu.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d3b5503460f94a163fa/html5/thumbnails/14.jpg)
NGI Summer Research (8/02) 14
![Page 15: NGI Summer Project Streaming Media Extensions to Open Mash and Indiva Allan Gu.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d3b5503460f94a163fa/html5/thumbnails/15.jpg)
NGI Summer Research (8/02) 15
Indiva: Middleware for Streaming Indiva: Middleware for Streaming Media Equipment and ResourcesMedia Equipment and ResourcesNFS metaphor
Application mounts a server and issues commands
High level commandse.g., encode, move, copy, link, mkses, etc.
Bridge conventional audio/video environment and streaming media
Hide physical connections and control interfacesAllocate paths through conventional routing switchesAllocate encoding/decoding resources in a broadcast center
![Page 16: NGI Summer Project Streaming Media Extensions to Open Mash and Indiva Allan Gu.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d3b5503460f94a163fa/html5/thumbnails/16.jpg)
NGI Summer Research (8/02) 16
ISAPISAP
Cache of active Mbone sessionsClone of NSDR
Web interface
Run continuously
Well-known address for SAP 224.2.127.254/9875
A web-cast guide
![Page 17: NGI Summer Project Streaming Media Extensions to Open Mash and Indiva Allan Gu.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d3b5503460f94a163fa/html5/thumbnails/17.jpg)
NGI Summer Research (8/02) 17
ISAPISAP
Parse message according to IETF protocol
Execute indiva manager to create conference
Associate callbackAfter 30 minute, delete conference
Future – click link to participate in session
![Page 18: NGI Summer Project Streaming Media Extensions to Open Mash and Indiva Allan Gu.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d3b5503460f94a163fa/html5/thumbnails/18.jpg)
NGI Summer Research (8/02) 18
![Page 19: NGI Summer Project Streaming Media Extensions to Open Mash and Indiva Allan Gu.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d3b5503460f94a163fa/html5/thumbnails/19.jpg)
NGI Summer Research (8/02) 19
![Page 20: NGI Summer Project Streaming Media Extensions to Open Mash and Indiva Allan Gu.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d3b5503460f94a163fa/html5/thumbnails/20.jpg)
NGI Summer Research (8/02) 20
Future ResearchFuture Research
RTP a/v synchronizationA “time-based corrector” for RTP packet streams
Implement new Indiva services and applications
Ncast Telepresenter service
Webcast control apps
…
![Page 21: NGI Summer Project Streaming Media Extensions to Open Mash and Indiva Allan Gu.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d3b5503460f94a163fa/html5/thumbnails/21.jpg)
NGI Summer Research (8/02) 21
AcknowledgementAcknowledgement
NGILarry RoweWei Tsang OoiPeter PletcherJose Maria Gonzalez…and the entire OpenMash
community
![Page 22: NGI Summer Project Streaming Media Extensions to Open Mash and Indiva Allan Gu.](https://reader031.fdocuments.in/reader031/viewer/2022032704/56649d3b5503460f94a163fa/html5/thumbnails/22.jpg)
NGI Summer Research (8/02) 22
For More InformationFor More Information
http://www.openmash.orghttp://www.bmrc.berkeley.edu/
frame/projects/indiva/