Networked Audiovisual SystemsNetworked Audiovisual Systemsandand

Home PlatformsHome PlatformsAugusto.Dealbuquerque@cec.eu.intAugusto.Dealbuquerque@cec.eu.int

INFSO D2INFSO D2

Presentation to the NCPsJanuary.2002

Information Society Technologies 6th Framework Programme

INFSO D2 in a nutshell

Overview topics on audio-visual systems and home platforms

From FP5 to FP6 : technical challenges and objectives in FP6

The Unit D2 will support the innovation and development of technologies for end-to-end interoperable audio-visual networks, services and applications.

Key R&D aspects address innovation in the processing and delivery of audio-visual materials, cross media platforms and devices, including broadcast, home platforms and new visual systems and devices (3D displays).

INFSO D2 in a nutshellINFSO D2 in a nutshell

Head of Unit: Augusto de Albuquerque

9 Project Officers 6 Administration Team 5 Secretaries

Eric BadiqueRemy BayouEmiel de HertGeorgia EfthymiopoulouCarlos Morais-PiresKostas PapanikolaouJorge SantosLeon Van Noorden (HoS)

Sirpa AhomaaPaolo BoeriPierre EdelszteinAnne-Catherine GilsonAdelaide SaafiVirginie Sold

Fiona WhitemanFiona AllanNadia GuillaumeMarie RochatMaria Tjader

Thierry Devars

INFSO D2 in a nutshellINFSO D2 in a nutshell

Mid-term to longer-term research: they will prepare the next steps

Support standardisation

Awareness of ongoing work on regulation of digital AV networks and services

Key criteria

Vision from information to experience

Industrial strength in phase with Europe's strongest industrial assets

Need for intervention at EU level focus on synergy between innovation and Industrial exploitation (standardisation has a key role)

Expected impact next wave of innovation in Audio-Visual systems

INFSO D2 in a nutshellINFSO D2 in a nutshell

Policy driversPolicy drivers

Innovation in R&D to allow wise investors to make wise decisions and contribute to Audiovisual/Information Society markets to development

Support to European standards for interoperability and affordability to make a success of eEurope 2005 objectives, in particular for DTV platforms

‘Internet services must be accessible through mobile and TV’, Liikanen, le Figaro, 04/11/02

3G and DTV are key component to widen the broadband access to Information Society Services. (Commission communication on “Barriers to widespread access to new services and applications of the information society through open platforms in digital television and third generation mobile communications”)

3.1.8 Networked Audiovisual systems and home platforms

Objective: To develop end-to-end networked audio-visual systems and applications, andopen trusted and interoperable multimedia user platforms and devices, notably forbroadcasting and in-home platforms with full interactivity capacity.

Focus is on:

- Trusted free choice environments for more intuitive access and interactionwith hybrid 3D multimedia signals and objects. Rich media objectsrepresentation, identification, location and description.

- Seamlessly co-operating IP (Internet Protocol) audiovisual (AV) networks,storage, new middleware protocols and architectures for real time andconsistent multimedia routing, storing and distribution, load and balancingcontrol mechanisms, P2P, datacasting and streaming of audio-visual richmedia. Adaptive Quality of Services for scalable audio-visual flows onheterogeneous networks, AV internetworking, network traffic engineering,interactive AV service management, and simulation.

- Home server portals, interoperability between home networking technologiesand their integration with global networks, as a means for access to, andgeneration of combined applications and services. AV portals with storage,management and repackaging appliances, including extended homedistribution. Advanced retrieval methods and business models to supportaccess to streamed and stored audiovisual media from anywhere in the homeand car environment from any device.

Research will strongly concentrate on enabling technology for error-resilientrepresentation, slicing and handling of rich audio-visual signals. This concerns basicresearch, structuring and federating the best groups in Europe from the communicationareas. It also concerns research in high potential, industry-driven domains such as nextgeneration 3D-TV, electronic cinema, virtual & tele-presence and future mixed-reality-based mobile personal communication services. A strong requirement will be that theseactivities should be centred around a communication and storage infrastructure andshould aim at exploiting the outstanding European potential developed over severalProgrammes in this area. Active contribution to world-wide standard setting will be aprerequisite.

SO: Networked Audiovisual Systems and Home Platforms

Trusted free choice environments for more intuitive access and interaction with hybrid 3D multimedia signals and objects. Rich media objects representation, identification, location and description

Seamlessly co-operating IP (Internet Protocol) audiovisual (AV) networks, storage, new middleware protocols and architectures for real time and consistent multimedia routing, storing and distribution, load and balancing control mechanisms, P2P, datacasting and streaming of audio-visual rich media. Adaptive Quality of Services for scalable audio-visual flows on heterogeneous networks, AV internetworking, network traffic engineering, interactive AV service management, and simulation.

SO: Networked Audiovisual Systems and Home Platforms

Home server portals, interoperability between home networking technologies and their integration with global networks, as a means for access to, and generation of combined applications and services. AV portals with storage, management and repackaging appliances, including extended home distribution. Advanced retrieval methods and business models to support access to streamed and stored audiovisual media from anywhere in the home and car environment from any device.

Research will strongly concentrate on enabling technology for error-resilient representation, slicing and handling of rich audio-visual signals.

SO: Networked Audiovisual Systems and Home Platforms

It concerns basic research, structuring and federating the best groups in Europe from the communication areas. It also concerns research in high potential, industry-driven domains such as next generation 3D-TV, electronic cinema, virtual & tele-presence and future mixed-reality-based mobile personal communication services.

A strong requirement will be that these activities should be centred around a communication and storage infrastructure and should aim at exploiting the outstanding European potential developed over several Programmes in this area. Active contribution to world-wide standard setting will be a prerequisite.

INFSO D2 scope:INFSO D2 scope: essential elements of essential elements of convergenceconvergence……

Motion pictureMusic, Sound, VoiceStill image, Graphics, Text

TV, Telephone, InternetInteractive/PassiveE-mail, E-commerce (transactional) InformationStreamed in Real-Time/CachedPersonalized/General PublicAnalog & Digital Broadcasting Networks(Terrestrial/Satellite/Cable)Telecom Networks (Fixed-line/Mobile)Dedicated NetworksTV, PC, PDAFixed-line phoneMobile phoneGlasses, Watches

Service

Transport

Terminal

Elements in ConvergenceActivators

Digitalization

Advancesin Technology

Affordabilityof Technology

Rich Media

USERS

Rich AudioVisual

Services

Interactive TV Complex AV Scenes

network QOS, streaming

Advanced Renderingand Visualization

e-learning, games, VoD

Virtual presence

2D and 3D audio/video

IP Multicasting

CATV

Server, set top box, broadband access

MPEGx enabled Players

SERVICE /APPLICATIONS

RICH MEDIATECHNOLOGIES

AVNETWORKING

BROADBANDTERMINAL/SERVER

Coding, Graphics

… … structuring the area in IST in FP6structuring the area in IST in FP6

Digital Rights Management

DVB-Networks

Terminal APIs

Virtual and Mixed Reality

Home networks

Home Networked Appliaces

ConsumersNetworked Homes

ContentProducers Distributors Service

ProvidersBroadcasters

IP-Network Operators MPEG2-Network

Operators

BroadbandInternet trad.

Dig. TV

Audiovisual Flow in a Audiovisual Flow in a BroadbandBroadband World World

INFO and INFRA structuresINFO and INFRA structures

Logical,

Physical

Terminal:STB,TV,PC, handset, mobile

NetworksTransport

INFO-STRUCTURE

INFRA-STRUCTURE

Rich AVServices

End-user

Broadband Access and Home networks

AV Rich MediaObjects

IST/FP6: … challenges

The Home Network plays an important role

it is the “consumer domain” where she/he and family will use multiple interconnected devices (displays, storage digital warehouses, e-paper)

this network will have one or more broadband access gateways to the global networks

it is possible that the predominant home network infrastructure will be wireless

it is also an important domain of consumer privacy and citizen security

Home Network(s) and PlatformsHome Network(s) and Platforms

Digital Home Platform: Digital Home Platform: broadband to the homebroadband to the home (from of the VRT/Belgacom trial)(from of the VRT/Belgacom trial)

Cable/TVGateway

DVB-TDVB-T

New ways of programming

enriched content

BroadbandBroadbandAccessAccess

Interactive services and content

TelecomTelecomOperatorOperator

BroadcasterBroadcasterService ProviderService Provider

Home Network

IP Streaming: IP Streaming: Internet, Telco and Broadcasting...Internet, Telco and Broadcasting...

Audiovisual Content is the key driver: video needs QoS and broadband networking management

Open standards (content format, security, ...) Co-operative infrastructures...

Internet

xDSL, ... etc.

Multicastdelivery

Research aimed at overcoming current technological and usability constraints in 3D visualisation for 3DTV emerging markets.

Advanced Rendering & VisualisationAdvanced Rendering & Visualisation

Target Areas:

Autostereoscopic Displays:

Multi-viewer, unconstrained Volumetric or Holographic based Displays

Advanced Image Processing:

Image Acquisition, Processing, Synthesis, Rendering

Representation and manipulation of rich AV media

Signal processing, coding, computer graphics and vision

Applied research in high potential, industry-driven domains such as next generation 3D-TV, electronic cinema, virtual & tele-presence and future mixed-reality-based mobile personal communication services...

Activities should be centred around a communication infrastructure

Rich Media TechnologiesRich Media Technologies

Networked AV Systems and Services “low cost access network equipment,…optimized as function of the

operation environment, including …interactive broadcasting.

new concepts for network management,…to provide enhanced intelligence and functionality in the access network for delivery of new services, and end-to-end network connectivity.

multi-service capability: (i.e. e.g. for cable operators: VoIP, fast internet access, multi-site games, video-communication).

Increase bandwidth capacity,…commensurate with the expected evolution in user requirements … (depends on services, coding …)

a generalized introduction of BB services (..scalability..)

…the access portion of the next generation network..

…regulatory aspects...

Reserve Slides

SpectrumDecision(Art. 95)

Regulating Digital TV… challenges of convergenceour collaboration with Policy/Regulation

LiberalisationDirective(Art. 86)

Framework Directive(Art. 95)

Authorisation Directive

Access & Interconnection Directive

Users’ Rights Directive

Data Protection Directive

Unbundled local loop Regulation

DVB-S & DVB –C world adoptionDVB-S & DVB –C world adoptionDVB-T Near world StandardDVB-T Near world Standard

Satellite & Cable Standards predominantly DVB or slight variantsSatellite & Cable Standards all DVBJapan mostly DVB but recent introduction of ISDB S

DVB –T essential for receiver Interoperability, Portability, Mobility

•Common receivers for Satellite /Cable /Terrestrial•Benefits for Consumer & Broadcaster

iTV standards adoption with TV operatorsiTV standards adoption with TV operators

MHPMHP + ATSC DASE on terrestrialMHP + ISDB BMLUndecided

Market Trends for Advanced AV Services

Global Revenue Sort Term Projectionsfor Advanced Audiovisual Services

0200400600800

1000120014001600

1996 1997 1998 1999 2000 2001 2002

years

Bill

ions

of E

uros

Narrow-bandServices

(traditional ISP)

Integration of high-qualityComputer/TV integrationfor mass consumer marketsEnhanced Services

using high-speedaccess technologies

Set Top Box Market potential

0

2000

4000

6000

8000

10000

12000

14000

Mill

ion

US D

olla

rs

1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005

Worldwide Digital TV STB Market Value Forecasts (By Region)1995 - 2005

N. America

W. Europe

Asia-Pacific

Latin AmericaRest of the World

Source: Strategy Analytics

… + content & service revenues + cross-platform revenues...Large market potential - but need attractive content & servicesStrategic market for Europe... if the opportunity is taken

Digital TV Household forecast

0

50

100

150

200

250

Millions Households

1997

1998

1999

2000

2001

2002

2003

2004

2005

World Interactive Digital TV Household Forecast

Rest of WorldLatin AmericaAsia Pacif icNorth AmericaW. Europe

Source: Strategy Analytics

1997

1999

2001

2003

2005

05

101520253035

BEURO AMLCDLCDPDPothers

Flat Display Market