NoTube: Using the Synergy of Broadcast, Internet and Social TV

57
SOCIAL & INTERACTIVE TV integrating Web & TV Lora Aroyo VU University Amsterdam http://notube.tv 1 Wednesday, June 8, 2011

description

NoTube presentation at SemTech2011

Transcript of NoTube: Using the Synergy of Broadcast, Internet and Social TV

Page 1: NoTube: Using the Synergy of Broadcast, Internet and Social TV

SOCIAL & INTERACTIVE TVintegrating Web & TV

Lora AroyoVU University Amsterdam

http://notube.tv

1Wednesday, June 8, 2011

Page 2: NoTube: Using the Synergy of Broadcast, Internet and Social TV

TAKE HOME MESSAGEIntegration of TV & (Social) Web

2Wednesday, June 8, 2011

Page 3: NoTube: Using the Synergy of Broadcast, Internet and Social TV

rethinking the role of metadata as advertisement for programsallowing API access to TV devices

using URLs for program identification

would lower costs and foster creativity, and thereby benefit consumers as well as providers and

manufacturers

3Wednesday, June 8, 2011

Page 4: NoTube: Using the Synergy of Broadcast, Internet and Social TV

• Making APIs (and prototypes) for linking the Social Web with broadcast and on-demand television

• Using Linked data for serendipitous content discovery

• Aggregating TV preference data from diverse Web activities

• Enriching TV metadata

• Finding graph patterns to link users to content

• Adaptive advertisement

• Building on open source services

• Supporting real-time multi-screen exploration of TV programs

4Wednesday, June 8, 2011

Page 5: NoTube: Using the Synergy of Broadcast, Internet and Social TV

EVOLUTIONwe see how web & TV co-evolve

5Wednesday, June 8, 2011

Page 6: NoTube: Using the Synergy of Broadcast, Internet and Social TV

SOCIAL NETWORKS SHOW WEB & TV TOGETHER

• high % of social media conversations are around what people are watching on TV

• during UK/US prime-time scheduling:

• Twitter trending topics - TV related

• Twitter activity influence what people decide to watch

• predominantly via second screens (not specifically designed)

6Wednesday, June 8, 2011

Page 7: NoTube: Using the Synergy of Broadcast, Internet and Social TV

SECOND SCREEN: IN ACTION42% UK adults discuss/comment on TV programs while

watching (YouGov Deloitte report, Aug 2010)

49% of UK Twitter users use Twitter regularly when watching TV (BBC Audience Research Twitter survey, Aug 2010)

7Wednesday, June 8, 2011

Page 8: NoTube: Using the Synergy of Broadcast, Internet and Social TV

8Wednesday, June 8, 2011

Page 9: NoTube: Using the Synergy of Broadcast, Internet and Social TV

WHAT IS THE DRIVE?

• it’s not technology-driven

• people want to share (TV) experiences

• people want to be recognized (by what they are watching)

• people want to be heard (through contributions)

• young audience - very active

9Wednesday, June 8, 2011

Page 10: NoTube: Using the Synergy of Broadcast, Internet and Social TV

FRAGMENTATION OF AUDIENCES

• in the current evolution of web & broadcast TV, we see a fragmentation over multiple applications, devices & websites

• not good for all • consumers• manufacturers• developers• creators & owners of content

10Wednesday, June 8, 2011

Page 11: NoTube: Using the Synergy of Broadcast, Internet and Social TV

DEVICES & CONTROLS

• many new TV and TV-like devices, e.g.• internet-connected TVs, e.g.

Samsung Yahoo Widgets TV• set-top boxes, e.g. Boxee Box,

Apple TV and GoogleTV

• apps to control interaction with second screen, e.g.

• MythTV, XBMC & Boxee iPhone/Android remote controls

11Wednesday, June 8, 2011

Page 12: NoTube: Using the Synergy of Broadcast, Internet and Social TV

APPS FOR INTERACTION

• media directory apps: • majority are incapable of

interacting with TV or Web players, e.g. ‘Radio Times TV guide’

• apps for specific programs or events, e.g. `The Million Pound Drop' show, PickLive: playing along during football matches

12Wednesday, June 8, 2011

Page 13: NoTube: Using the Synergy of Broadcast, Internet and Social TV

ALL THIS RESULTS IN SILOSwe see fragmented solutions

where people need specific hardware/software to participate in TV apps

13Wednesday, June 8, 2011

Page 14: NoTube: Using the Synergy of Broadcast, Internet and Social TV

SILOS POSE PROBLEMS FOR USERS & BROADCASTERS• difficult for people to participate

• difficult for broadcasters to monitor what’s going on

• potential value for participants is lost

• potential value for right holders (e.g. increased and engaged audience, and feedback) is lost

• too much focus on formats & protocols instead of creative solutions

14Wednesday, June 8, 2011

Page 15: NoTube: Using the Synergy of Broadcast, Internet and Social TV

KEY CHALLENGESwhat problems do social TV developers need to solve?

15Wednesday, June 8, 2011

Page 16: NoTube: Using the Synergy of Broadcast, Internet and Social TV

CHALLENGES FOR SOCIAL TV DEVELOPERS

1.How do we know what the person is watching?

•Both for broadcast and on-demand, we need to know in the form of some kind of unique identifiers.

2.How do we locate additional information about the program?

•Given a unique identifier for a program, we need to locate information, not broadcasted along with the program itself.

16Wednesday, June 8, 2011

Page 17: NoTube: Using the Synergy of Broadcast, Internet and Social TV

CHALLENGES FOR SOCIAL TV DEVELOPERS

3.How do we locate apps or Web pages related to it?

•In addition, we need program-specific applications to be launched, or Web pages to be navigated to (seamlessly delivering complex applications using Web technologies without locate-download-install-launch difficulties).

4.How can we manipulate it?

•We need a second screen environment for users to manipulate the content, provide playback control, interact with first screen.

17Wednesday, June 8, 2011

Page 18: NoTube: Using the Synergy of Broadcast, Internet and Social TV

GUIDELINES

18Wednesday, June 8, 2011

Page 19: NoTube: Using the Synergy of Broadcast, Internet and Social TV

I. RETHINK THE ROLE OF METADATA

• let metadata advert the content: let it flow freely in the public web and find its viewers

• make metadata public and open: open in formats & licenses drawing users via 3rd party apps

• rights issues: nothing compared to content rights

metadata is scaffolding for Future Web & TV

19Wednesday, June 8, 2011

Page 20: NoTube: Using the Synergy of Broadcast, Internet and Social TV

EXAMPLE:

• the BBC Backstage work with TV anytime shows the result in the form of very creative apps

20Wednesday, June 8, 2011

Page 21: NoTube: Using the Synergy of Broadcast, Internet and Social TV

21Wednesday, June 8, 2011

Page 22: NoTube: Using the Synergy of Broadcast, Internet and Social TV

II. CREATE URLS FOR CONTENT ITEMS

• easy sharing of info by giving programs a life through a URL:

• resolvable, machine processable URLs (JSON, RDF)

• for sharing information (about content), e.g. Wikipedia, IMDB

• for relating program instances cross broadcaster, e.g. aggregated matching & discovery in the international Global Web

program URLs makes it alive in the social web

22Wednesday, June 8, 2011

Page 23: NoTube: Using the Synergy of Broadcast, Internet and Social TV

EXAMPLE: BBC

/PROGRAMS

http://www.bbc.co.uk/programmes/b00ry8lb

http://www.bbc.co.uk/bbcfour/programmes/genres/drama

23Wednesday, June 8, 2011

Page 24: NoTube: Using the Synergy of Broadcast, Internet and Social TV

III. AGREE ON OPEN APIS

• to allow other apps to access & control TV playing device/app/web page

• what to see, e.g. change channel, play, pause

• to allow other apps to access metadata

• content identification

• user identification / authentication

• standards-based communication between controlling & controlled devices

open APIs for access & control

24Wednesday, June 8, 2011

Page 25: NoTube: Using the Synergy of Broadcast, Internet and Social TV

EXAMPLE: APIS FOR RECORDING, ANNOTATION & SEARCH

• smart phone-to-TV API, e.g. bookmarking, tag, annotate content

• Web-based OAuth API for sharing activities streams

25Wednesday, June 8, 2011

Page 26: NoTube: Using the Synergy of Broadcast, Internet and Social TV

BENEFITSbenefits for all stakeholders

26Wednesday, June 8, 2011

Page 27: NoTube: Using the Synergy of Broadcast, Internet and Social TV

I. BENEFITS TO AUDIENCES

• expect diverse, attractive, and accessible software & hardware remotes

• more creative apps for viewing what to watch on TV (phone, tablet etc.) and easier text entry

• simpler access to program info, for sharing in social web

• better second screen TV apps

• better recommendations

27Wednesday, June 8, 2011

Page 28: NoTube: Using the Synergy of Broadcast, Internet and Social TV

II. BENEFITS TO CONTENT PRODUCERS

• less fragmented audience

• more participation & interest

• ability to track aggregate usage and market that (from broadcast via on-demand to archive)

28Wednesday, June 8, 2011

Page 29: NoTube: Using the Synergy of Broadcast, Internet and Social TV

III. BENEFITS TO DEVELOPERS

• manufacturers and developers have open and well-documented APIs to support

29Wednesday, June 8, 2011

Page 30: NoTube: Using the Synergy of Broadcast, Internet and Social TV

BENCHMARKguidelines for NoTuble metadata and apps

30Wednesday, June 8, 2011

Page 31: NoTube: Using the Synergy of Broadcast, Internet and Social TV

HOW NOTUBLE IS YOUR METADATA?

• as a guideline and as a benchmark for TV metadata, we use a 5-star scheme to judge TV metadata

★ make metadata available publicly (open license)

★ ★ make metadata available in open format

★ ★ ★ create URLs for content items

★ ★ ★ ★ link to additional items

★ ★ ★ ★ ★ use the linking to personalize (& socialize)

31Wednesday, June 8, 2011

Page 32: NoTube: Using the Synergy of Broadcast, Internet and Social TV

NOTUBLE METADATA

• this schema helps to determine the added value of metadata, for example:

• content availability (restricted by country 0.1 point, payed content 0.1 point, free everywhere 1 point )

• metadata licensing (can others reuse the metadata)

• metadata schema quality (e.g. using standard schema's like tv-anytime)

• amount of metadata (only title, or much more)

• conceptualization or just keywords etc

• reuse of identifiers

32Wednesday, June 8, 2011

Page 33: NoTube: Using the Synergy of Broadcast, Internet and Social TV

USER MODELING

• personalization implies & assumes user (usage) modeling

• benefits both sides

• better experience, more engagement

• better analysis of usage, better marketing

personalization not a burden (for providers) but an opportunity

33Wednesday, June 8, 2011

Page 34: NoTube: Using the Synergy of Broadcast, Internet and Social TV

MAKING NEW CONNECTIONS

• specific & meaningful connections between:

• existing information about people from the Social Web

34Wednesday, June 8, 2011

Page 35: NoTube: Using the Synergy of Broadcast, Internet and Social TV

MAKING NEW CONNECTIONS

• specific & meaningful connections between:

• existing information about people from the Social Web

• data about video content provided by broadcasters

35Wednesday, June 8, 2011

Page 36: NoTube: Using the Synergy of Broadcast, Internet and Social TV

MAKING NEW CONNECTIONS

• specific & meaningful connections between:

• existing information about people from the Social Web

• data about video content provided by broadcasters

35Wednesday, June 8, 2011

Page 37: NoTube: Using the Synergy of Broadcast, Internet and Social TV

MAKING NEW CONNECTIONS

• specific & meaningful connections between:

• existing information about people from the Social Web

• data about video content provided by broadcasters

• supplement video data with background knowledge

36Wednesday, June 8, 2011

Page 38: NoTube: Using the Synergy of Broadcast, Internet and Social TV

MAKING NEW CONNECTIONS

• specific & meaningful connections between:

• existing information about people from the Social Web

• data about video content provided by broadcasters

• supplement video data with background knowledge

36Wednesday, June 8, 2011

Page 39: NoTube: Using the Synergy of Broadcast, Internet and Social TV

ACTIVITY-BASED USER PROFILES

• an example of advanced user modeling is the use of BBC Linked Data in the generation of activity-based user profiles

• NoTube Beancounter can use DBpedia but also BBC PIDs in Twitter-based profiling

• used for recommendation on the basis of social activity

• other examples following similar approach, e.g. music-related recommendation based on music-related social data

37Wednesday, June 8, 2011

Page 40: NoTube: Using the Synergy of Broadcast, Internet and Social TV

38Wednesday, June 8, 2011

Page 41: NoTube: Using the Synergy of Broadcast, Internet and Social TV

39Wednesday, June 8, 2011

Page 42: NoTube: Using the Synergy of Broadcast, Internet and Social TV

39Wednesday, June 8, 2011

Page 43: NoTube: Using the Synergy of Broadcast, Internet and Social TV

39Wednesday, June 8, 2011

Page 44: NoTube: Using the Synergy of Broadcast, Internet and Social TV

39Wednesday, June 8, 2011

Page 45: NoTube: Using the Synergy of Broadcast, Internet and Social TV

SEMANTICS-BASED RECOMMENDATION

• in NoTube recommendations are based on user TV viewing & Social Web activities

• through the semantic relations, recommendations are given for people, programs, channels and for genres (a rich, multi-faceted approach)

• exploring pattern-based recommendations on top of LOD semantics

• integrating classical statistical approaches for related programs

40Wednesday, June 8, 2011

Page 46: NoTube: Using the Synergy of Broadcast, Internet and Social TV

LOD PATTERNS & CONCEPT MATCH

• direct match in LOD concepts

• creative influence

• creative participation

41Wednesday, June 8, 2011

Page 47: NoTube: Using the Synergy of Broadcast, Internet and Social TV

RECOMMENDING & INTERACTING IN GROUPS

• people want to share (TV) experiences

• integration with (social) web allows for recommending for & interacting with groups

• typical trade-off watching TV - remaining in social group

• challenge to support social processes for trade-off

• examples: multi-user device (touch table), using social networking systems to vote & discuss

42Wednesday, June 8, 2011

Page 48: NoTube: Using the Synergy of Broadcast, Internet and Social TV

SOCIAL TV SHOULD ENABLE

• Conversation: back-channel, recommendation & community• content is the king; conversation is the content on web2• conversation is the king

• Gamification: playful, engaging & participative

• Personalization: users contribution, relevant & their stories

credit: Gary Hayes

43Wednesday, June 8, 2011

Page 49: NoTube: Using the Synergy of Broadcast, Internet and Social TV

COMMUNITY-BASED EXPERIENCE

not a single TV-viewer activity any more

44Wednesday, June 8, 2011

Page 50: NoTube: Using the Synergy of Broadcast, Internet and Social TV

SOCIAL VIEWING SCENARIOS

for more details check out our blog at http://notube.tv

45Wednesday, June 8, 2011

Page 51: NoTube: Using the Synergy of Broadcast, Internet and Social TV

ADAPT INDIVIDUAL SECOND SCREEN EXPERIENCE

for more details check out our blog at http://notube.tv

46Wednesday, June 8, 2011

Page 52: NoTube: Using the Synergy of Broadcast, Internet and Social TV

HOW NOTUBLE IS YOUR APP?

• we extend this benchmark from metadata towards applications and software:

★ use NoTuble metadata

★ ★ provide open APIs for accessing metadata

★ ★ ★ provide open APIs for controlling devices

47Wednesday, June 8, 2011

Page 53: NoTube: Using the Synergy of Broadcast, Internet and Social TV

STANDARDS

• in this open evolution, a lot is already happening.

• the industry shows many different parties offering partial solutions

• W3C can help with API, protocols, specifications

• NoTube aims for NoTuble benchmarks

towards a coherent Web & TV ecosystem

48Wednesday, June 8, 2011

Page 54: NoTube: Using the Synergy of Broadcast, Internet and Social TV

OPPORTUNITIES

• engage through gaming, make sharing and feedback more playful, e.g. rewards, sense of progress, curiosity

• linked content allows to find alternative versions better fitting conditions of multilinguality and accessibility

• Twitter for individual, collaborative, trending recommendations

• support process of endorsement, e.g. celebrities

49Wednesday, June 8, 2011

Page 55: NoTube: Using the Synergy of Broadcast, Internet and Social TV

TAKE HOME MESSAGEIntegration of TV & (Social) Web

50Wednesday, June 8, 2011

Page 56: NoTube: Using the Synergy of Broadcast, Internet and Social TV

rethinking the role of metadata as advertisement for programsallowing API access to TV devices

using URLs for program identification

URLs are the foundation for the webURLs can be the foundation for the Web & TV ecosystem

linking data is easier than linking devicesso, focus on metadata & URLs as well as APIs for

Web&TV

would lower costs and foster creativity, and thereby benefit consumers as well as providers and

manufacturers

51Wednesday, June 8, 2011

Page 57: NoTube: Using the Synergy of Broadcast, Internet and Social TV

• Stay tuned:• http://notube.tv

• http://notube.tv/#blog

• @notube, #notube

• http://delicious.com/notube

[email protected]

• Videos:• http://vimeo.com/user3487770

52Wednesday, June 8, 2011