http://notube.tv@notubeproject

This is future TV.

Lora AroyoVU University Amsterdam

Web & Media GroupThursday, May 24, 12

Thank youfor their slides to:

• Dan Brickley, Vicky Buser, Valentina Maccatrozzo, Libby Miller, Davide Palmisano, and the whole NoTube team

• Ericsson user study report

• RedBee Media

• Ugli building wall posters

Thursday, May 24, 12

Thursday, May 24, 12

ScenarioThursday, May 24, 12

TV & the PeopleThursday, May 24, 12

choices, choices ...Thursday, May 24, 12

lost in spaceThursday, May 24, 12

always missingThursday, May 24, 12

demand for experienceThursday, May 24, 12

Web vs. TV

TV & the WebThursday, May 24, 12

simultaneouslyThursday, May 24, 12

TV getting active

42% of UK adults who use Internet while watching TV also discuss or comment on programs they are watching

Thursday, May 24, 12

competition for attentionThursday, May 24, 12

TV & the DevicesThursday, May 24, 12

multitude of devicesThursday, May 24, 12

multitude of accessThursday, May 24, 12

Thursday, May 24, 12

Social & Personalized TVThursday, May 24, 12

not a single TV-viewer activity any more

Thursday, May 24, 12

Thursday, May 24, 12

Recommendations needThursday, May 24, 12

Social Recommendations

I usually find NEW programmes to watch by:

RESULTS OF NOTUBE SOCIAL WEB & TV SURVEY 2012

Thursday, May 24, 12

Social Recommendations

I usually find NEW programmes to watch by:

RESULTS OF NOTUBE SOCIAL WEB & TV SURVEY 2012

Social TV

RESULTS OF NOTUBE SOCIAL WEB & TV SURVEY 2012

Thursday, May 24, 12

Social RecommendationsThursday, May 24, 12

Thursday, May 24, 12

So, ...what does this

all mean?

Thursday, May 24, 12

passive vs. active

what’s on vs. what’s there

group vs. individual

single vs. multiple devices

rich source for entertainment vs. rich source of data

competition for attention demand for social recommendations

Thursday, May 24, 12

What is NoTube?

• the Web

• personalization

• social media

• second screens

a project about (future) TV and ...

Thursday, May 24, 12

NoTube User Perspective

how do people watch TV together?

how do devices influence watching?

... the role of social recommendations

privacy vs. personalization: perceived trade-offs ...

Thursday, May 24, 12

NoTube Technology Perspective

... role of metadata in TV & Apps?

... a good way to sync TV & other metadata?

... a good way to share information in real time?

... an easy way for devices to find & talk to each other?

Thursday, May 24, 12

What did we do?

APIs & prototypes to link the Social Web with broadcast and on-demand

television as open source services

Thursday, May 24, 12

How did we do it?• Open Web Standards

• XMPP to pair devices with TV & group interaction• OAuth for trusted connection• Web APIs

• Open Web Data

• Open Graph API; standardized Activity Streams• Linked Data Cloud• Program metadata enriched with Web URLs

Key Point: Linking Web Data to User ProfilesThursday, May 24, 12

ScenarioThursday, May 24, 12

TV Program Enrichment

SemanticPattern-based

Recommendation Strategy

RDF GraphTV

Programs

Semantic ContentPatterns for

TV Programs

HybridRecommendation

Strategy

StatisticalSimilarity-based

Recommendation StrategyUser Ratings &

Demographics(BBC EPG

Data)

EPG Metadata(BBC)

Recommendation Service

SimilarityClusters

of Programs

User Data Analysis

End-UsersEnd Users

Thursday, May 24, 12

NoTube’s Beancounteraggregate, analyze & profile

Thursday, May 24, 12

TV Preference Data Sparse

• Even for a single service (e.g. Netflix)

• NoTube’s open systems: challenges multiply

• often no global view, only per-user data

• many ways of identifying same content item

• many ways of identifying same user

• many ways of identifying entities e.g. actors, directors, ...

Thursday, May 24, 12

Fragmentation by Site

Thursday, May 24, 12

TV Preferences in NoTube• Inferred from the Social Web

• tweets, FB likes, last.fm listened, etc.• weighted interests

• Represented using Linked Data web identifiers

• record-linkage:

• NLP:

facebook.com/pages/ dbpedia.org/

http://dbpedia.org/resource/Matt_Lucashttp://dbpedia.org/resource/David_Walliams

#littlebritain

Thursday, May 24, 12

TV Preferences in NoTube• Inferred from the Social Web

• tweets, FB likes, last.fm listened, etc.• weighted interests

• Represented using Linked Data web identifiers

• record-linkage:

• NLP:

facebook.com/pages/ dbpedia.org/

Brilliant british humor by Matt Lucas & David Walliams - whole range of facinating characters portraying diversity of british society

http://dbpedia.org/resource/Matt_Lucashttp://dbpedia.org/resource/David_Walliams

#littlebritain

Thursday, May 24, 12

Beancounter

REST platform

crawler

analysis engine

key value

{activities

{analysis

{profilesprofiler

Thursday, May 24, 12

Thursday, May 24, 12

Thursday, May 24, 12

Thursday, May 24, 12

Thursday, May 24, 12

Thursday, May 24, 12

NoTube’s N-Screen

N-Screendrag & drop, sharing & TV control

drag & drop, sharing & TV control

Thursday, May 24, 12

Suggestions for You

N-Screendrag & drop, sharing & TV control

Thursday, May 24, 12

Recommendations

find the balance between serendipity & diversity of recommendations

combine in a complementary way

statistical & semantic approaches

COLDSTART

PRIVACY

INTRUSIVENESS

LOD

METADATA ENRICHMENT

CONTENT PATTERNS

DEMOGRAPHICS

surface interesting, new & relevant programs to individual and group users

Thursday, May 24, 12

Analysis of LOD SourcesDataset LinkedMDB DBpedia Freebase

#triples 6,147,978 385,000,000 337,203,427

#props 221 1643 n.a.

#types 53 3,640,000 12,000,000

Properties #triples

foaf:page 512,944

http://purl.org/dc/terms/date 74,111

foaf:made 53,180

linkedmdb:actor_actorid 50,603

dbprop:hasPhotoCollection 30,354

Dataset Enriched BBC

#triples 240,630

#props 41

#types 17,029

Type Pattern #

People person - co_participation - person 62162

People person - actor - person 24843

Format program - has_format - format 13108

Genre program - has_genre - genre 12767

People person - influencedBy - person 10053

People person - partner - person 10053

Award program - award_won - award 782

Thursday, May 24, 12

From Predictability to Serendipity

Thursday, May 24, 12

From Predictability to Serendipity

Paul Merton looks at

Alfred Hitchcock

SecretGardens

Make ‘em laugh

Thursday, May 24, 12

From Predictability to Serendipity

Paul Merton looks at

Alfred Hitchcock

SecretGardens

Make ‘em laugh

documentaryformat

format

format

Thursday, May 24, 12

From Predictability to Serendipity

homes and gardens

genre

Grammy Awards

genre

genre art culture and the media

award

award

Paul Merton looks at

Alfred Hitchcock

SecretGardens

Make ‘em laugh

Basic patternsdocumentaryformat

format

format

Thursday, May 24, 12

From Predictability to Serendipity

homes and gardens

genre

Grammy Awards

genre

genre art culture and the media

award

award

PaulMerton

anchor

partner

CarolineQuentin

Life ofRiley

actor

Paul Merton looks at

Alfred Hitchcock

SecretGardens

Make ‘em laugh

Basic patternsHomogeneous patterns

documentaryformat

format

format

comedy

genre

Thursday, May 24, 12

From Predictability to Serendipity

homes and gardens

genre

Grammy Awards

genre

genre art culture and the media

award

award

PaulMerton

anchor

partner

CarolineQuentin

Life ofRiley

actor

SpikeMilligan

influence

The adventuresof Barry

McKenzie

actor

film

genr

e form

at

Paul Merton looks at

Alfred Hitchcock

SecretGardens

Make ‘em laugh

Basic patternsHomogeneous patterns

documentaryformat

format

format

comedy

genre

Thursday, May 24, 12

From Predictability to Serendipity

homes and gardens

genre

Grammy Awards

genre

genre art culture and the media

award

award

PaulMerton

anchor

partner

CarolineQuentin

Life ofRiley

actor

SpikeMilligan

influence

The adventuresof Barry

McKenzie

actor

film

genr

e form

at

Paul Merton looks at

Alfred Hitchcock

SecretGardens

Make ‘em laugh

CharlieChaplin

synopsisenrichment

ShanghaiKnights

form

at

action andadventure

genre

JackieChan

actor

influence

Basic patternsHomogeneous patternsHeterogeneous patterns

documentaryformat

format

format

comedy

genre

Thursday, May 24, 12

From Predictability to Serendipity

homes and gardens

genre

Grammy Awards

genre

genre art culture and the media

award

award

PaulMerton

anchor

partner

CarolineQuentin

Life ofRiley

actor

format

synopsisenrichment

Alfred Hitchcock

director

Suspicion

AcademyAwards

awar

d

Thriller

genre

SpikeMilligan

influence

The adventuresof Barry

McKenzie

actor

film

genr

e form

at

Paul Merton looks at

Alfred Hitchcock

SecretGardens

Make ‘em laugh

CharlieChaplin

synopsisenrichment

ShanghaiKnights

form

at

action andadventure

genre

JackieChan

actor

influence

Basic patternsHomogeneous patternsHeterogeneous patterns

documentaryformat

format

format

comedy

genre

Thursday, May 24, 12

Weak Semantics & Statistical Support

Thursday, May 24, 12

Weak Semantics & Statistical Support

Paul Merton

looks at Alfred Hitchcock

PaulMerton

anchor partnerCarolineQuentin

Life ofRiley

act

ordocumentary

form

at

art culture and the media

genreThursday, May 24, 12

Weak Semantics & Statistical Support

Paul Merton

looks at Alfred Hitchcock

PaulMerton

anchor partnerCarolineQuentin

Life ofRiley

act

ordocumentary

form

at

art culture and the media

genre

woman25 years old1 child

Userprofile

Thursday, May 24, 12

Weak Semantics & Statistical Support

Paul Merton

looks at Alfred Hitchcock

PaulMerton

anchor partnerCarolineQuentin

Life ofRiley

act

ordocumentary

form

at

art culture and the media

genre

25 years old women with

1 child

woman25 years old1 child

Userprofile

Thursday, May 24, 12

Weak Semantics & Statistical Support

Paul Merton

looks at Alfred Hitchcock

PaulMerton

anchor partnerCarolineQuentin

Life ofRiley

act

ordocumentary

form

at

art culture and the media

genre

25 years old women with

1 child

Similar users

woman25 years old1 child

Userprofile

Thursday, May 24, 12

Shuffle

N-Screendrag & drop, sharing & TV control

Thursday, May 24, 12

Real-time Sharing

N-Screendrag & drop, sharing & TV control

Thursday, May 24, 12

Suggestions from Friends

N-Screendrag & drop, sharing & TV control

Thursday, May 24, 12

Explanations

Thursday, May 24, 12

Changing Program on TV

N-Screendrag & drop, sharing & TV control

Thursday, May 24, 12

Surveys

Thursday, May 24, 12

Focus Groups

Thursday, May 24, 12

Thursday, May 24, 12

♥

INTERESTING PROGRAMMES

watching with friends

suggestions based on programmes others have watched

linking programmes by guests, actors, presenters etc.

sharing suggestions with others in the same room

?

watching 'together apart' in different locations

changing programmes on someone else's TV

♥♥

♥

✔

✘

suggestions based on your past 'Social Web' activities

controlling the TV

drag & drop

swapping suggestions with specific friends

sharing them

✔

♥

✔

♥

sharing to watch immediately

http://notube.tv

? explaining recommendations

'shuffle' option for programme selection

?

finding

USER TESTING RESULTS December 2011, BBC R&D London10 participants : 5 male, 5 female, aged between 20 to 64

drag & drop to change what's playing on TV

♥ ✔ ✘ ? loved liked disliked unsure

For more details:

Thursday, May 24, 12

Challenges

Thursday, May 24, 12

More from NoTube ...

http://notube.tv

Thursday, May 24, 12

TEA & TEAPlayer video annotation & second screen

Shaker Randomizing program chooser

Second Screen

Thursday, May 24, 12

Second Screen

Thursday, May 24, 12

Second Screen

Thursday, May 24, 12

Second Screen

Thursday, May 24, 12

Main TV Screen

Thursday, May 24, 12

Personal Ads

Best%moment%

Low%interest%in%this%corner%

Thursday, May 24, 12

Thank youfor their slides to:

• Dan Brickley, Vicky Buser, Valentina Maccatrozzo, Libby Miller, Davide Palmisano, and the whole NoTube team

• Ericsson user study report

• RedBee Media

• Ugli building wall posters

Thursday, May 24, 12

Thursday, May 24, 12

http://notube.tv

mailing list: public-notube@few.vu.nl

twitter: @notube, #notube

videos: https://vimeo.com/user3487770videos: http://youtu.be/0QUPKQLvOHU

http://www.slideshare.net/NoTubeProject

Thursday, May 24, 12