Overview of The Multimedia Networks -...

24
Overview of The Multimedia Networks Hamid R. Rabiee Mostafa Salehi, Fatemeh Dabiran, Hoda Ayatollahi Spring 2011

Transcript of Overview of The Multimedia Networks -...

Overview of TheMultimedia Networks

Hamid R. RabieeMostafa Salehi, Fatemeh Dabiran, Hoda Ayatollahi

Spring 2011

Digital Media Lab - Sharif University of Technology2

Outlines

² Course Introduction (Syllabus)

² Course Outline

² Why Multimedia Networking?

Multimedia Networking

² Instructors: Hamid R. Rabiee, PhD ([email protected])² Office: CE department #804 or #803 (DML)

² TAs: ² Mostafa Salehi ([email protected])

² Office: CE department #803 (DML lab)

² Hoda Ayatollahi ([email protected])² Office: CE department #803 (DML lab)

² Fatemeh Dabiran ([email protected])² Office: CE department #803 (DML lab)

² Hours:² Class hours:

² Exercise hours:

² Course web page: http://dml.ir/?page_id=346

Digital Media Lab - Sharif University of Technology3

Course Introduction

² The course goal:

² This course is primarily concerned with the problems that arise when

carrying audio/video contents over the modern communication networks

² The course will :

² Present an overview of current/future multimedia applications and

architectures

² Discuss deployment problems

² Discuss Multimedia Network Design and study solutions

² Examine emerging technologies and open research problems related to

multimedia networking

Digital Media Lab - Sharif University of Technology4

Course Introduction

² Prerequisites:

² Signal and Systems, Multimedia Systems, Computer Networks

² Background in Computer Systems Performance Evaluation (e.g., Simulation,

Experimental, or Analytical approaches)

² Experience with Matlab and GNU/Linux.

² Simulation Tool: OpNet

² Style:

² Both slides and whiteboard

² Reading List:

² Recommended books and papers

² Slides

² Handouts

Digital Media Lab - Sharif University of Technology5

Course Introduction

² Evaluation:

² Home works

² About 7 series of home works

² 30% of the final grade

² Quiz

² About 11 prearranged

² 10% of the final grade

² Midterm written exam

² 25% of the final grade

² Final written exam

² 25% of the final grade

² Critical Reading & Presentation

² 10% of the final grade

² Projects (+)

² 10% of the final grade

Digital Media Lab - Sharif University of Technology6

Course Outline

² Introduction

² Fundamentals of Multimedia

² Background Information similar to the ones covered in the Multimedia Systems

² Fundamentals of Next Generation Networks

² Quality of Service

² Principles (e.g. Admission Control and Shaping/Policing)

² QoS Architecture (Integrated services; Differentiated services)

² Traffic engineering (Fair Scheduling)

² Flow and congestion control (Buffer Management)

² Error Correction & concealment

Digital Media Lab - Sharif University of Technology7

Course Outline

² Multimedia over IP (IP multicast)

² Multimedia over Overlay networks

² Multimedia Applications

² Multimedia Protocols

² Signaling Protocols (SIP, H.323), Streaming (Real-time) Protocols (RTP, RTCP)

² IP Multimedia Subsystem (IMS)

² Multimedia over Wireless/ sensor network

² Multimedia Networking Applications

² Digital TV, Voice Over IP, IPTV, Audio/video Conferencing, Interactive Multiplier

Games, Application-Level Framing, Video Servers

Digital Media Lab - Sharif University of Technology8

Course Outline

² Multimedia Network Security

² Encryption, digital signatures, authentication, IP security

² Digital watermarking security features in multimedia compression standards,

secure media streaming

² Content Networks

² Convergence Networks

² Hot Research Topics

Digital Media Lab - Sharif University of Technology9

Why Multimedia Networking?

² The use of IP-based Internet is growing , both in business & home usage

² Growth of networked multimedia applications on the Internet

² A balance of digital broadcasting with multimedia streaming over IP networks

² IP network, especially Internet, is becoming a very attractive channel for multimedia

communications.

² Dedicated networks and ATM are not widely available to bulk of users

² There are many applications for Internet multimedia:

² Internet telephone, Internet TV, video conferencing, network games, remote

corroboration, media rich social networks, …

² IP uses packet switching² Suitable for unexpected burst of data without establishing an explicit connection

² Bandwidth is shared and so data can be sent at any time

Digital Media Lab - Sharif University of Technology10

Networked Multimedia Applications

Digital Media Lab - Sharif University of Technology11

Music Streaming

Information SearchMovies

StreamingFinance,

Brokerage

Digital Photos

The Internet cloud

E-mail

Video ClipAttachment

VideoConference

VoIP

Wireless Wireless BrowsingBrowsing

Networked Multimedia Applications

² Multimedia Extended Email

² World Wide Web

² Video Distribution Services

² Video Conferencing

² Interactive Distributed Games

² Virtual Reality

² E-Learning

² Instant Messaging

² Sometimes there may be only one media, but similar requirements:

² Image Distribution, Telephony, Radio, Jukebox Services, Document Archives

Digital Media Lab - Sharif University of Technology12

Classes of Internet Multimedia Apps

² Streaming stored media

² Stored on server

² Examples: pre-recorded songs, famous lectures, video-on-demand

² Streaming live media

² “Captured” from live camera, radio, T.V.

² 1-way communication, maybe multicast

² Examples: concerts, radio broadcasts, lectures

² Real-time interactive media

² 2-way communication

² Examples: Internet phone, video conference

Digital Media Lab - Sharif University of Technology13

A Sample Framework of Media Delivery

MediaEncoding

AudioVideoAnimation

WebServer

Send Request to Media Server

MediaServer

ProprietaryFormat

•Multicast capable•More Robust•Access to Storage•Relieves Web Server

Send StreamTo Clients

•Standalone player•Java based player•Browser plug-in player•Appliance

•Decode•Buffer•Sync.

To hear or view a media file without downloading it

Note: P2P applications and Services increasing

Clients

Send RequestTo Servers

Multimedia Expectations

²Multimedia Expectations from a Communication Network² traffic requirements

² limits on real-time parameters (delay, jitter)

²bandwidth and reliability

²sychronization

² functional requirements

²support for multimedia services such as multicasting, security,

mobility and session management

²More about media & multimedia on next session

Digital Media Lab - Sharif University of Technology15

Main Problems in Multimedia Applications

² Supporting multimedia applications over a computer network renders the

application distributed.

² Multimedia Transmission over Wireless/Wired networks

² Convergence on Wireless, Multimedia, and Internet

Digital Media Lab - Sharif University of Technology16

Multimedia CapabilityEnhanced MobilityFull Connectivity

Multimedia Internet

Wireless

Main Problems in Multimedia Applications

² Multimedia data is huge

² Audio, Images, graphics, and video

² Wireless/Internet lacks performance guarantee

² Best effort service, no QoS provision by itself

² Packet loss, congestion, latency, delay jitters

² Errors in wireless links

² Internet is heterogeneous

² Varying network conditions, user preferences, device capabilities

² Question : How to Enable EFFICIENT, ROBUST, UBIQUITOUS Delivery?

Digital Media Lab - Sharif University of Technology17

Multimedia Networking Issues

² Media Issues

² Huge amount of data

² Different formats of media (need for

Coders & Decoders, Different

Applications, transmission protocols, ...)

² Issues for real-time transport of

streaming multimedia

² Quality of media

² Network Issues

² Availability and Performance of NW

Bandwidth

² Reliability of Transport and

Performance

² Availability of “Media-aware”

Middleware

² Availability and Performance of

Applications

² Required standards for data exchange

in heterogeneous environments

² Security and copyright Issues

² Wireless networks issues

² Integration of wired and wireless

heterogeneous networking systems

Digital Media Lab - Sharif University of Technology18

Solutions

² Two basic Approaches

² Network-centric

² End system-based

Digital Media Lab - Sharif University of Technology19

End-System based solutions

² End-System Based

² Compression

² Layered and scalable coding

² Base layer, enhancement layers

² MPEG: SNR, spatial, temporal scalability

² MPEG-4 fine granularity scalability (FGS), and H.264

²MPEG Scalable Video Coding (SVC)

² Media distribution

² Media synchronization

² Multimedia network protocol

Digital Media Lab - Sharif University of Technology20

End-System based solutions

² End-system Based

² QoS Control

² Congestion Control

² Source-based rate control, Receiver-based rate control, Hybrid

rate control

² Rate-adaptive source encoding

² Rate shaping

² Error Control

² FEC, retransmission (ARQ), error-resilient encoding, error concealment

Digital Media Lab - Sharif University of Technology21

Network-centric based solutions

² Network-centric² Packet Classification

² Packet is marked based on the Type of Service

² Packet Scheduling

² choose next packet to send on link

² Integrated Services: flow based

² architecture for providing QOS guarantees in IP networks for individual application

sessions

² Differentiated Services: packet based

² Mark IP packet to specify treatment

² Multi Protocol Label Switching: flow+ packet based

² A forwarding scheme that tags packets with labels

Digital Media Lab - Sharif University of Technology22

Sharif University of Technology, Department of Computer Engineering, Multimedia Systems Course

Next Session

Multimedia Networking

23

References

² Shashank Khanvilkar, Faisal Bashir, Dan Schonfeld, and Ashfaq Khokhar,

“Multimedia Networks and Communication”, University of Illinois at

Chicago, 2004.

² Jenq-Neng Hwang, “Introduction to multimedia networking”, Cambridge

University Press,

Digital Media Lab - Sharif University of Technology24