1 MASH: A Multimedia Architecture that Scales Across Heterogeneous Environments Steven McCanne,...
-
Upload
noreen-powell -
Category
Documents
-
view
214 -
download
0
Transcript of 1 MASH: A Multimedia Architecture that Scales Across Heterogeneous Environments Steven McCanne,...
1
MASH: A Multimedia Architecture that Scales Across Heterogeneous Environments
Steven McCanne, Randy H. Katz, Eric Brewer
Computer Science DivisionUniversity of California, Berkeley
Berkeley, CA 94720-1776© 1997-98
ProxyProxy
ProxyVirtual Collaborative Environment
Internet Multicast Backbone
Virtual Room Environment Desktop Environment Virtual Room Environment
Real-Time Data and Control Transcoding
Transmission format chosen by network characteristics and receiver capabilities
2
Minutes
• Student volunteers to scribe notes?
3
Outline
• Introductions and Agenda
• Brief Overview & Direction of Project
• Accomplishments & Schedule
• Internet Systems Research Group
4
Outline
• Introductions and Agenda
• Brief Overview & Direction of Project
• Accomplishments & Schedule
• Internet Systems Research Group
5
Retreat Goals &Technology Transfer
UC Berkeley Project Team Industrial CollaboratorsGovernment Sponsors
Friends
PeopleProject Status
Work in ProgressPrototype Technology
Early Access to Technology
Early Access to TechnologyPromising Directions
Reality CheckFeedback
6
Ongoing Collaborations
• Semantic Multicast
Hughes & UCLA
• MediaNet
Cornell
7
MASH Design Team
• Core MASH Team
Yatin Chawathe (SRM Proxy & Archive)
Gene Cheung (Codec Synthesis & Optimization)
Adam Costello (Randomcast-based RM)
Todd Hodes (Service Location & Control)
Ketan Mayer-Patel (Scalable Effects Processing)
Matt Podolsky (Internet Audio & FEC)
8
MASH Design Team (cont’d)
• Core MASH Team (cont’d)
Suchitra Raman (SRM, data consistency models)
Angie Schuett (Archive & Distributed Recorders)
Andrew Swan (System Issues for Layered Media)
Tina Wong (Quasi-reliable Multicast, Infocast)
9
MASH Design Team (cont’d)
• Departures
Elan Amir (MeGA & SCUBA)
– FastForward Networks
Cindy Romer (Toolkit Components Integration)
– Netscape
Teck-Lee Tung (MediaBoard & Active Objects)
– Singapore Government
Kristin Wright (WebCast & SRM WebCache)
– Salt Lake-based E-commerce Startup
10
MASH Design Team (cont’d)
• Technical Support
Brian Shiratsuki (Room Deployment, Network
Maintenance, Sys Admin)
Keith Sklower (Sys Programming, Network
Maintenance)
• Administrative Support
Terry Lessard-Smith
Bob Miller
11
Project Collaborators
• James Landay (CSCW Course)
• Martin Vetterli (FEC for Internet Audio)
• Brian Smith (MediaNet, Cornell)
• Peter Kirstein (UCL)
• Deborah Estrin (VINT, USC/ISI)
• Bill Fenner (Xerox PARC)
• Mark Handley (VINT, USC/ISI)
• Kevin Fall (LBNL)
• Sally Floyd (LBNL)
12
Project Collaborations (cont’d)
• Son Dao (Semantic Multicast, Hughes)
• Richard Muntz (Semantic Multicast, UCLA)
• Lixia Zhang (Semantic Multicast, UCLA)
13
Sponsors and Guests
• DARPA IC&V Program
Kevin Mills, DARPA PM
Bob Ollerton, SPAWAR
• Industrial SponsorsFuji Xerox Palo Alto LabsIBMIntelMicrosoftXerox PARC
14
Sponsors and Guests (cont’d)
• Friends
Lance Berc (Compaq/Digital SRC)
Steve Casner (Cisco)
Steve Deering (Cisco)
Anoop Gupta (Microsoft Research)
Christian Maciocco (Intel)
Jean Bolot (INRIA)
Hamid Ahmadi (AT&T Research)
15
Retreat Schedule• Monday, July 13
1200-1300 Lunch at Granlibakken
1300-1330 Introductory Session
– Introductions
– Brief Overview & Direction, Steven McCanne
1330-1600 Talks I: Reliable Multicast
– Brief word on SRMv2, Steven McCanne
– RMX: Proxy-based Reliable Multicast, Yatin Chawathe
– Periodic Information Dissemination Using Quasi-reliable Multicast,
Tina Wong
– Search Party and Rumor Mill: Status and Future Work, Adam
Costello
16
Retreat Schedule
• Monday, July 13 (cont’d)
1530-1800 Break (tennis, hiking, check-in)
1800-1930 Dinner
1930-2100 Demos, Posters, & Refreshments
(In the Lake Room)
– The MBone Playback and Transcoding Service: Soft-state
Archive as an Active Service, Angie Schuett
– The Dali Convergence: Using Dali within MASH for Scalable
Effects Processing across a Cluster, Ketan Mayer-Patel
17
Retreat Schedule
1930-2100 Demos (cont’d)
– Beyond Layered Media Formats: Systems Issues in realizing
RLM and Layered Codecs in RTP/LWS, Andrew Swan
– The SRMv2 Toolkit: Design, Status, and Direction,
Suchitra Raman
– Scaling Reliable Multicast with a Randomized Forwarding
Service and Understanding the Search Party and Rumor Mill
Variants with Network Visualization, Adam Costello
– Control from Afar, Todd Hodes
– RMX: Proxy-based Scalable Reliable Multicast,
Yatin Chawathe
18
Retreat Schedule
1930-2100 Demos (cont’d)
– PalmVideo: MeGafied Video on a Pilot PDA,
Taher Taveliwala, Michael Kaminsky, Eric Mao,
Benjamin Ling, Michael Chew, Andrew C. Huang, and
Kevin Yen (MBA project advisor)
19
Retreat Schedule
• Tuesday, July 14
0730 - 0830 Breakfast
0830 - 1000 Talks II: A Taste of Theory
– Inference of Multicast Routing Trees and Bottleneck
Bandwidths from End-to-end Measurements,
Sylvia Ratnaswamy
– Results from a Simple Model for Delay-constrained
Progressive Internet Audio, Matt Podolsky
– Optimal Lookup Table Design under memory constraints for IP
address lookup and Huffman decoding, Gene Cheung
20
Retreat Schedule
• Tuesday, July 14 (cont’d)
1030 - 1230 Talks III: Systems and Protocols
– Media archival as a soft-state active service, Angie Schuett
– Layered Media and the Session Directory Service,
Andrew Swan
– Scalable Video Effects Processing, Ketan Mayer-Patel
– WebTP: A Receiver-driven, ALF-based Transport Framework
for the Web, Rajarshi Gupta
21
Retreat Schedule
• Tuesday, July 14 (cont’d)
1230 - 1330 Lunch
1330 - Hike to Cascade Falls Rafting on the Truckee
(catch the corresponding bus)
1800 - 1930 Dinner
22
Retreat Schedule
• Tuesday, July 14 (cont’d)
1930 - 2100 Guest Presentations
– An Evaluation Study of MASH, Andy Greenberg, NIMA
– HIPNET Requirements for Reliable Multicast, Bob Ollerton,
SPAWAR
– Enhancing Presence with 3D Audio, Jean Bolot, INRIA
– Ubiquitous Networked PDAs, James Landay, UCB
2100 - 2300 Refreshments & Group Discussion
– six month planning meeting among students
23
Retreat Schedule
• Wednesday, July 15
0730 - 0830 Breakfast
0830 - 1000 Six Month Planning, Steven McCanne
1000 - 1030 Break & Check-out
1030 - 1200 Guest Feedback Session, McCanne
1200 - 1300 Lunch
1300 - Depart Granlibakken
24
Outline
• Introductions and Agenda
• Brief Overview & Direction of Project
• Accomplishments & Schedule
• Internet Systems Research Group
25
The Challenge: Heterogeneous Collaboration Environments
326 Soda
UC-Net /UC-MBone
CAIRN
UCLA
UCBPARC
LBL
MIT
DARPA
NIMA
ISDN
Internet(MBone)
UCL
T1OC-3c
POTS
ISDN
Pen-Based PCs
• Collaboration
in the face of heterogeneity
at large scale
26
Approach
• Build on MBone Tools
and LWS
• Create core mash software system
reusable, scripted components
Web-based “platform”
27
Key Tasks
• On top of mash platform...
Flexible coordination framework
– Coordination Bus
– SCUBA
– Room device controllers
– XML-based UIs for control
– Soft-state gateways
28
Key Tasks (cont’d)
• On top of mash platform...
Active Services
– MeGa Transcoding Service
– Soft-state Archive
– Scalable Effects Processing
» Cornell’s Dali integegration
– RMX Proxy Deployment
Virtual Room Testbed
29
Key Tasks (cont’d)
• Reliable multicast
ALF-based toolkit for SRMv2
Naming for RM
Scalability analysis (SIGMETRICS 98)
Quasi-reliable Info Dissemination
Novel approaches based on Randomcast
– Rumor Mill & Search Party
30
Key Tasks (cont’d)
• Novel media enhancements
Soft-ARQ for Internet audio
Systems issues for layered media
Clustering algorithms for end-to-end multicast
– I.e., tree inference
Codec synthesis & optimization
– side effect: solve fast route lookup problem
31
MASH Colab
Remoteparticipants
LocalParticipants
Details: James LandayDetails: James Landay(this afternoon)(this afternoon)
32
Outline
• Introductions and Agenda
• Brief Overview & Direction of Project
• Accomplishments & Schedule
• Internet Systems Research Group
34
Key Achievements
• Fall 1997
major software and tools components
• Spring 1998
algorithmic work
publications
enhancements to existing software components
35
33
Achievements—Dec 1997
•• MASH ToolkitMASH Toolkit
Design and implementation of flexible, new
programming model and “mash platform”
Vic and vat retrofitted into new toolkit
Number of new tools written against toolkit
MPlug: MASH Plug-in for Netscape
35
Achievements—Dec 1997
•• Mashbrowser Mashbrowser (Suchitra
Raman & Angie Schuett)
ARMS server
client RTSP object
re-usuable ArchiveSystem
OTcl object
Browser platform --- plug
mashlets into viewing area
35
Achievements—Dec 1997
•• Collaborator Collaborator (Cindy Romer)
integrated user-interface
based on CSCW course feedback
35
Achievements—Dec 1997
•• MashCastMashCast (Kristin Wright)
Efficient multicast of web
pages
Novel decomposition
– Casting Director
– WebCache
36
36
Achievements—Dec 1997
•• MediaBoard MediaBoard (Teck-Lee Tung)
Existence proof for ALF/SRM framework
Capabilities
– Active objects
– Extensible data types
– Variety of new formats
(e.g., GIFs)
– Rate control
– Re-play
MediaBoard/Pilot Proxy36
Achievements—Dec 1997
•• MPlugMPlug (Yatin Chawathe)
Reaching real users
Critical vehicle for realizing
“mash platform”
Embed any mash applet in a
browser
Runs under
– Windows or Unix
– Netscape or IE
36
Achievements—Dec 1997
•• MeGa/SCUBA MeGa/SCUBA (Elan Amir)(Elan Amir)
Design and evaluation of SCUBA & MeGa
Robust implementation in MASH toolkit
Integration with directory service
Regular use in CSCW classroom
Seamless bridge into MBone
ISDN
MeGa326 Soda(back porch)
36
Achievements—Dec 1997
•• nsdr nsdr (Andrew Swan)
Flexible session directory tool
Easy config of multiple media
apps
Integrated with MeGa
Research vehicle for
– layered session advertisement
– split addr allocation arch (e.g.,
via DHCP)
37
Achievements Spring 1998
• Major progress on publications
Four papers in ACM MM98!
– including Best Student Paper (Swan)
INFOCOMM-98
SIGCOMM-98
NOSSDAV-98
SIGMETRICS-98
Half dozen or so more in the pipeline...
38
Achievements Spring 1998
• Algorithmic work
clustering algorithms
consistency issues in RM
table design for lookup algorithms
• Software
refined active services (MeGa, archive)
refined component APIs
release snapshots
39
Project Plan
Aug 96 Aug 97 Aug 98 Aug 99
Develop local tool coordarch, API, and GUI
Develop proxy mgr, wide-area “coherent” objects
Active object extensionsto MBone tools
Scalable reliable multicast“middleware”: C++ library
RTP A/V storage repr,Server control protocol,Recording tools and formats
Design and implement 1stcollaboration room
Develop global coord archpubl floor cntrl spec
Develop scalable R/T proxyExploit user focus
Prototype network animatorbased on SRM toolkit
tk/java rendering widget,deployment and feedback
SRM archive tool, sessionrecorder, playback tool;Integrate with Digital Libr
Deploy second room andperform experiments
Experimentation andRefinement of Coordinationand Proxy architectures,IETF standardization;
Extensive interoperability testing;
Demonstration of ease ofextension thru objectarchitecture
Deploy scaled archive &annotation architecture;Integrate feature extractors
Deploy 3rd room andCHI evaluation
Coord-ination
Proxy
ActiveObjects
Archive
Testbed
40
Looking Forward
• Next six months…
specifications and documentations
evaluation
disseminate software
… more on Wed morning
41
Outline
• Introductions and Agenda
• Brief Overview & Direction of Project
• Accomplishments & Schedule
• Internet Systems Research Group
42
Internet Systems Research Group (ISRG)
• Cooperative effort in network/systems
research in UCB EECSEric Brewer
David Culler
Anthony Joseph
Randy Katz
Steven McCanne
43
ISRG Mission
• Basic research to “make the Internet work”
Unify on-going and future research projects
Facilitate technology transfer and standardization
Work closely with industrial partners in an open
laboratory environment Cooperative effort in
network/systems research in UCB EECS
Cultivate ties with external network researchers
(LBL, PARC, USC/ISI, … others?)
44
Project Synergies
BARWANWireless Overlay Networks
Scalable Proxies
MASHCollaboration Applications
Active Services
RTPGatewayService Discovery
vic, vat,wb
TranSendTACC Model
Wireless Access
MASH ToolkitActive Services
Model
NOW/MillenniumComputing Platform
NINJAScalable, Secure Services
Computation in the Network“Smart Spaces” as an app
Event-ResponseProgrammable Access
45
NetworkInfrastructure
GSM BTS
Millennium Cluster
Millennium Cluster
WLANPager
IBMWorkPad
CF788
MC-16
MotorolaPagewriter 2000
Text
Speech
Image/OCR
306 Soda
326 Soda “Colab”
405 Soda
Ericsson
Smart SpacesPersonal Information Management
Fax
Experimental Testbed
46
Retreat Schedule• Monday, July 13
1200-1300 Lunch at Granlibakken
1300-1330 Introductory Session
– Introductions
– Brief Overview & Direction, Steven McCanne
1330-1600 Talks I: Reliable Multicast
– Brief word on SRMv2, Steven McCanne
– RMX: Proxy-based Reliable Multicast, Yatin Chawathe
– Periodic Information Dissemination Using Quasi-reliable Multicast,
Tina Wong
– Search Party and Rumor Mill: Status and Future Work, Adam
Costello
47
SRMv2
• Key mash deliverable
many important external applications
• Naming component design
MM98 paper on “SNAP” (Raman)
• Low-level toolkit API in place
stand-alone C API (independent of mash)
(Raman)
48
SRMv2 (cont’d)
• Need to
exercise in new apps (Tina, Ketan)
write down more formal protocol specs
document API
• Future work
refine the spectrum of reliability
49
Receiver Reliability
• Wb
announce/listen page state
triggers data repair requests
• SNAP
announce/listen name state (I.e., meta-data)
triggers name state repairs
in turn, triggers data repairs
50
Hybrid Reliability
• To scale SNAP
we summarize meta-data with “signatures”
I.e., meta-meta-data (see Raman’s paper)
• So we have an optimization problem
fixed bandwidth
how to divide among
– announce/listen of data, meta-data, meta-meta-data and
so forth…
– received-driven SRM repairs