The Home as theThe Home as theThe Future of Wireless

I f t tThe Future of Wireless

I f t tInfrastructureInfrastructure

Jan M. RabaeyCo-Director, Berkeley Wireless Research CenterCo Director, Berkeley Wireless Research CenterDirector, Gigascale Systems Research CenterDepartment of EECS, University of California, Berkeleyhttp://bwrc eecs berkeley edu

WoWMoMO7– June 19, 2007

http://bwrc.eecs.berkeley.edu

Wireless Infrastructure –What Comes Into Mind

This is not what this talk is about

WoWMoM07, June 07

2

This is not what this talk is about …

The Real Future of Wireless Infrastructure

• All multimedia (consumer) components of the future WILL support some type(s) of wireless connectivity– Avoid the cost of wiring

– Easier deployment and expansion

E bl bili “ l h”– Enable mobility – no more “men on a leash”

– Enable “collaborative” paradigms

The number of components connected this way will by• The number of components connected this way will by ORDERS OF MAGNITUDE exceed the number of cell phones!

Wireless infrastructure developments should be drivenby the demands of such an environment

WoWMoM07, June 07

3

The “Ambient Intelligent” Home as the (a)Future of WirelessI f t tInfrastructure

A multimedia environment that• adapts to capabilities at hand• is aware of space and topology• is intuitive and self-configuring

WoWMoM07, June 07

4

is intuitive and self configuring

Courtesy Fred Boekhorst, Philips

The Opportunities Go Far BeyondThe Home of Today:yA range of wired and wireless networks•Wired voice (traditional telephone)•Wireless voice (cellular)•Wireless voice (cellular)•High speed data (cable, DSL)•Multimedia broadband (cable, satellite, air)•Multimedia (wired)•Security (wired, wireless)•Climate Control (wired)•Home automation (X10, others)•Others (e.g. baby monitoring)

All of which are fully disconnectedAll of which are fully disconnected and definitely not interacting!The Home of Tomorrow: Where Wireless

WoWMoM07, June 07

The Home of Tomorrow: Where Wireless Multimedia and Sensor Networks Meet

Energy Management – Demand ResponseMake energy prices Cal ISO Daily Peak Loads

January 1, 2000 - December 31, 2000

dependent upon time-of-use• Advanced thermostats operate on required level of comfort, energy cost, weather forecast and distributed

40

45

50

W

Peak Day August 16 -43.5 GW

Commercial AC

weather forecast and distributed measurements to offload peak times• Appliances energy and cost aware

25

30

35GW

Residential AC

20

Utility

Power sensor

Temperature sensors

PowerPrice Indicator

•Power actuators

Occupancy sensors

WoWMoM07, June 07

In collaboration with CEC

Home Layout for HealthCare Delivery (Domotics)

WoWMoM07, June 07

Remote Health Care Monitoring and Delivery

Glucosesensors

Step two: miniature monitoring and gwireless communications

Wireless ECG

Step one: simple wirelessmonitoring

Step three: diagnostics anddrug deliveryg y

Micro-Syringe

WoWMoM07, June 07Courtesy: Courtesy: D. Liepmann (UCB) and Card Guard AG

The New Internet: From Download Rich to "Upload Rich"

A Fundamental Change In PerspectiveThe New Internet: From Download-Rich to "Upload-Rich"

Data Flow SensorSensor DisplayDisplayControlControl

WoWMoM07, June 07

Conventional (Web) HereafterSource: K. Yano, Hitachi

The Home Just One Single Reference PointThe OfficeThe Office Public Service

WoWMoM07, June 07

Industrial Automation The Environment

Wireless Infrastructure for the Home

Th O ll Ch llThe Overall Challenge:Creating an environment where novel wireless devices can be brought in seamlessly and easily with no or little g y yconfiguration or management, while guaranteeing the quality of the experience

In Detail:

• Compatibility and Portability• Compatibility and Portability

• Reliability and QOS

C fi ti M t d C t l• Configuration, Management and Control

WoWMoM07, June 07

11

The Portability and Scalability ChallengeThe Home Network as the new Tower of BabelThe Home Network as the new Tower of Babel

• New devices are entering the home environment at an everhome environment at an ever increasing rate.• Standards are proliferating –interconnect, recording andinterconnect, recording and playback, display• Devices do not necessarily interconnect easilyy

WoWMoM07, June 07

12

The Current Options

Cover all the bases …• Clearly not scalable, extensible and upgradable• Not applicable to light-weight devices

HAVi Software Architecture - FAVHAVi Software Architecture - FAV

Stovepipe solutionsSto ep pe so ut o s• Fix the complete stack and hope that the rest of the world will adopt

WoWMoM07, June 07

13DLNA the Best Opportunity at this Time

Dealing with the Myriad of Protocols and Formats

Put the Intelligence in the Network:Put the Intelligence in the Network: “The Universal Content Router (UCR)”

RoutersRouters(set-top boxes, media stations)

Media Sources(camera, internet, DVD) Media Sinks

(displays, speakers,disks)

Content routers: Provide on-the-fly protocol conversion and trans-codingbased on properties of source and destination devices

WoWMoM07, June 07

14

p p“Seamlessly connect everything to anything – or do even better than that”

Some Examples

?Blueto

802.

PRISMto

MPEG4 LCD DisplayPRISM (light weight

ooth

11toMPEG4

UCR(s) MPEG4 LCD Display with 802.11 interface

PRISM (light weight video encoder) phone camera with Bluetooth interface

UCR(s)

Perfect surround at

UCRany time using ubiquitous speakers

WoWMoM07, June 07

15

The UCR Implementation Challenge

Must process multiple real time high data rate streams fromMust process multiple real-time high-data rate streams from physical interface through protocol stack and signal processing (TOPS) in fully programmable and upgradable f hi t t l t i d t d b d tfashion at a extremely constrained cost and power budget.

DigitalRouting / transcoding

Satellite VideoRF ProcessingDigital

High Data RateWireless

(HDTV, audio, data)Data - DSL

New Services

Medium Data Rate(LAN)

L D t R tLow Data Rate(PAN, Mesh)

WoWMoM07, June 07

16 Disk Storage

A Platform for Embedded SoC Architecture Exploration

Berkeley BEE-II: 2 TOPs system protytyping environment (Warwrzynek,

30-40 TOPS (2 TFlops) Rack

p y yp g ( yBrodersen, UCB)

Using arrays of FPGAs to emulate and explore virtual architectural models.

RAMP: A Multi-University Project Targeting the Concurrent Future

WoWMoM07, June 07

17(Compilers, OS, μArch).

Partially funded by GSRC and BWRC

Reliability and QoS In Wireless Networking

Redundancy the best means in providing a reliable and enjoyable user experienceand enjoyable user experience

• Dependable system operation best supported by the availability of ample and redundant sourcethe availability of ample and redundant source, processing and destination functions.

• Providing ample redundant bandwidth and g pconnectivity the simplest and most effective technique to ensure QOS in a “best-effort” way.

WoWMoM07, June 07

18

The Bandwidth Challenge

Current LAN/PAN Wireless StandardsTechnology Data Rate

(Mb/ )Range (M t )(Mb/sec) (Meters)

Blue Tooth 1-2 100

IrDA 4 1-2

Ultra Wide Band 100-500 10

802.11a 54 20

802.11b 11 100

802 11 54 50802.11g

802.11n

54

108

50

50

L l d fi i t f t f lti l i lt t

WoWMoM07, June 07

19

IEEE Spectrum 9/2003

Largely deficient for support of multiple simultaneous streams and QOS guarantees

Conjecture: Wireless Bandwidth will be Free!

Improved spectral efficiencyMIMO to the rescue (802.11n)

New frequency realms4 to 7 Ghz available at 60 GHzPossible in today's CMOS!Possible in today s CMOS!

S liSpectrum recyclingaka “Cognitive radio”Temporarily re-use idle spectrum

WoWMoM07, June 07

20

spectrum

Opportunity: Cognitive Radios

e ar

ray RF

RF

Sensor

Optimizer• Requirements

onfig

urab

le RF

RF

ReconfigurableBaseband

q– Co-exist with legacy wireless

systems– Use their spectrum resources

Co RF Baseband

– Do not interfere with them• Properties

– RF technology that "listens" toRF technology that listens to huge swaths of spectrum

– Knowledge of primary users’ spectrum usage as a function of location and time

Primary User Frequency BandActive Primary User Primary User Frequency BandActive Primary User

location and time– Rules of sharing the available

resources (time, frequency, space)UWB Control ChannelSecondary User Channel UWB Control ChannelSecondary User Channel

WoWMoM07, June 07

21 Current focus: The Television Bands

Cognitive Radio: The Basics

Interplay of spectrum sensing and opportunistic spectrum access for maximizing system capacity

Network Coordination Network

Link

La ers

Con

Sensing MAC Resource AllocationLayerstrol C

hannel

Sensing PHY

S i di

Wideband signaling

Wid b d di

Physical

Layer

s

Sensing radio Wideband radio

Sensing system

WoWMoM07, June 07

22Signaling channels (Ultra-wide?)

[Courtesy: Danijela Cabric]

BWRC Cognitive Radio TestbedLO CLK and power distribution4 antenna system (scalable to 16) LO, CLK and power distribution4 antenna system (scalable to 16)

C bi d i l i BEE2Combined signal processing on BEE2

Radio with external CLK and LO

WoWMoM07, June 07

The Universal Content Router Enables Cognitive Radios

Ananth Sahai, Wireless Foundations, UCB

Cyclostationary Detector

Threshold

Energy DetectorCyclostationary Detector

A/D N pt. FFT CorrelateX(f+a)X*(f-a)

Averageover T

x(t) Featuredetect

A/D N pt. FFTx(t)

Averageover T

Energydetect

Gateway ideally positioned to sense spectrum utilization and

f

WoWMoM07, June 07

24perform spectrum and code assignment

Cognitive Radio Needs Collaboration

Source: D. Tse, UCB

WoWMoM07, June 07

Cognitive Radio: The Challenges

• Managing the degrees of freedom!

• Managing collaboration

• Optimizing spectrum utilization

• Optimizing QOS and fairness

• Hiding complexityg p y

• Providing security and access control

• Dealing with legacy systems• Dealing with legacy systems

WoWMoM07, June 07

Connectivity Brokerage

T

T

T: TerminalCP: Connectivity PointT

T

CP

T

CP

T T

CP

T

CP

T

CP

T

T

Connectivity BrokerageSpectrum utilization

Service needsLink propertiesNetwork topology

WoWMoM07, June 07

Connectivity Brokers

T

T

T: TerminalCP: Connectivity PointT

T

CP

T

CP

T T

CP

T

CP

T

CP

T

T

Spectrum utilizationService needs

Link propertiesNetwork topologyC

B

CB C

WoWMoM07, June 07

BB

The Connectivity Broker

Definition: A Connectivity Broker is a functional entityDefinition: A Connectivity Broker is a functional entity that enables a collection of terminals to transparently connect to a backbone network or to each other, to

f t f i hil ti i i th tili tiperform a set of services, while optimizing the utilization of the spectrum under policy rules, rules of engagement and security constraints.

WoWMoM07, June 07

Connectivity Broker

• By collecting spatial and temporal spectrum utilization information and system resources a CB helps to assigninformation and system resources, a CB helps to assign communication channels to requested communication links based on requested data rate, QoS, priorities and access policies.

• A generic CB is part of the fixed infrastructure (UCR) d h h t ti l dand hence has more computational and power

resources. Hence it CB is better equipped than a terminal to judge on spectrum utilization and access prioritization.

• However, any properly equipped terminal can host a CB.

WoWMoM07, June 07

Connectivity Brokerage:A Distributed OS for Cognitive Wireless N t kNetworks

What is an Operating System?p g yNot a well defined term…From Silbershatz et al. (dinosaur book)( )– User perspective:

Efficient resource managementEase of use

– System perspective:Resource allocator (efficiency and fairness)Resource allocator (efficiency and fairness)Control execution of user programs (protection)Services (gettimeofday())

WoWMoM07, June 07

[Courtesy: Chris Baker]

The Configuration and Control Challenge

Current model:• Connection oriented

“Connect the DVD through the AV to the display in the living room”Requires intimate knowledge of network – excludes ad-hoc.

WoWMoM07, June 07

32• Device, not function dependent

The Only Option: Raise the Abstraction Level

C2

C3C1

Applications Application Interface based on FunctionC3C1

Application interface (AI)Media sources

“Play Yesterday from the Beatles at the highest possible

Output devices

fidelity levelavailable now at my current location”

Services dynamically identify capabilities and constraints of present environment, and provide dynamic mapping of function on

• Independent of network architecture and hardware platform• Enabling dynamic deployment mobility interoperability and

y gplatform

WoWMoM07, June 07

33

Enabling dynamic deployment, mobility, interoperability and innovation

The ZUMA Platform

An Operating System for Wireless Infrastructure ofAn Operating System for Wireless Infrastructure of the Future (Hmm…)

• Zero-configuration

• Uni ersalit• Universality

• Multi-user (task) optimality

• Adaptability

LAYERED ON TOP OF COGNITIVE BROKERAGE

WoWMoM07, June 07

34

The Zuma Approach

• Who manages the changing environment?

Applications

– User, Application, or System?

– Often a resource management issue.

• Application responsible for managing

Algorithms, UI, …

Management of Changepp p g g

change…

• Managing change as a System Service…

SystemServices A

m

– Factor out common functionality

– Simplify application

– Efficient Use of resources

mbient O

S

Hardware Abstraction Layer

Device Device Device Device

S

WoWMoM07, June 07

35

An Operating System for Wireless Infrastructureof the Future

Ambi Environment:A playground combiningavailable media and data contents capabilities of the ITcontents, capabilities of the IT platform, and preferences and privileges of people present

Applications

Contents

Capabilities People Application reacts to changes in environment (dynamic mapping)

WoWMoM07, June 07

36Environment

( y pp g)

Driven by UCR Infrastructure

Environment Aware

• Scoped environment is limited in time and space

• Dynamic entity with content, capabilities, & personae

• Info service can be queriedq

• Example: Multimedia environment in the home

Content

• mysong.mp3

Capabilities

• Transcoder avi->mpeg

Personae

• HomeOwner• myHomeVideo.mpeg• R-ratedMovie.avi• disneyMovie.mpeg

• Mpeg player (renderer)• Ipod (audio renderer)• Router (connection)

•Full access• Guest

•Denied access to home video & Ipod

WoWMoM07, June 07

37

Architecture

Application

• Applications

• High-level Services

P t t biliti ApplicationApplication– Personae, content, capabilities

• Low-level Services

– Resource manager, geometry, security,

Application

Resource Managermigration/replication, I/O, etc.

• Hardware Abstraction Layer

– Common device interface or execution

type matching, arbitration, allocation

PersonaeI/OSecurity

kernel

• Devices

– Sensors, actuators, rendering, sources, Geometry Capabilities

ContentProcess Mgt.

, , g, ,sinks, etc.

• Event mechanism for application and services.

Hardware Abstraction Layer

Device Device Device Device

WoWMoM07, June 07

38

Applications

• An application is a set of behavioral tasks

• Session (instantiated app)

– Queries environment services

Elaborates tasks to match current environment– Elaborates tasks to match current environment (includes trans-coding, finding suitable displays etc)

• Session state is stored to enable application migration (position in• Session state is stored to enable application migration (position in movie, etc.)

WoWMoM07, June 07

39

Simple Scenario

• Various Devices– Rendering

– Content sources

Control points– Control points

– Compute nodes

– HVAC

– SensingSensing

• Watching streaming video from laptop

• Guest at front porch

• PiP on living area screen

WoWMoM07, June 07

40

Example

• Initial flow-graphs for application– Home theater streaming video from laptop; monitoring ambient lightg p p g g

– Security outside motion sensor and camera

Control UserControlPoint Application

Home Theater

Application Live VideoUserDetected

SecurityMovie.mpg

UI Renderer

Home TheaterUI

Security

Light

WoWMoM07, June 07

41

Example

Application Live VideoUserDetected

Security

ControlPoint Application

Home Theater

Constraints:- local renderer

UIMovie.mpg

Light

UI Renderer

Cell PhoneHome Theater

SecurityApp.

OutsideCamera

Motion SensorConstraints:

- local renderer- local ambient light Cell Phone Theater

App.- local control point- share renderer- best video quality

UI

Could ALL be allocated onAllocated to infrastructure compute node

Laptop

UI LocalTVPiP

Could ALL be allocated on advanced video screenXCoder

compute node

WoWMoM07, June 07

42Light

Sensor

Status• Implemented set of abstractions and resource managerImplemented set of abstractions and resource manager

– IP network of distributed heterogeneous devices (FPGAs, mobile and compute nodes, COTS)– Applications use services to build simple flow-graph.– On-the-fly mapping of flow graph with simple constraints (user location and matching media

types)types)• What’s next?

– Extending resource manager and programming framework– Interoperability requires mapping for many layers of networking stack– Representation of content, capabilities, and constraints

WoWMoM07, June 07

43

Summary and Perspectives

• The future of wireless infrastructure is the seamless connection of the myriad of emerging mobile multimedia and sensor devices the home as themultimedia and sensor devices – the home as the ideal playground

• Putting intelligence in the network can lead to• Putting intelligence in the network can lead to seamless interoperability and enhanced user experience

• Harvesting the offered opportunities such as cognitive radio requires bold top-down vision with raised levels of abstractionof abstraction

• Exciting symbiotic relationship between wireless multimedia and sensor networks – creating the true

WoWMoM07, June 07

44

multimedia and sensor networks – creating the true “ambient experience”

Thank you!

WoWMoM07, June 07

45