Rethinking Search in the era of new devices and services

Rethinking Search in the era of new devices and services

SREE HARI NAGARALU |

DEC 19, 2012

FIRE – 2012

[email protected]

Agenda

Information Retrieval (Search)

Integrated Devices & Services

Emerging Trends with Digital Experiences

Intelligence Fabric and Challenges ahead for Search


User has Information needs

User enters a query in input box

Retrieval of results in a collection of objects For web, a collection could

be of documents, images, audio, video

Information about objects represented internally by using metadata

Top Ranking objects are displayed to the user

Search

Browser connects to the world and Search runs in a browser

Web of documents has grown humongously large

Search became the gateway to the world wide web

Browser

Computer

SER

VIC

ED

EV

ICE

Paradigm Shifts

Devices integrated with Services

iPod -- iTunes

iPhone, iPad – Full Browser, Passbook, Siri

Kindle -- Media Book Services

Android -- Google Play, Google Now

Xbox Kinect – Games and Media services

Windows 8 – Skydrive, Office, Bing, Skype

Device Hardwa

re

OS

Cloud Innovation across boundaries

between device hardware to OS to cloud services

Digitization of our entire society

Web growing at rapid pace

Beyond written documents

All Entities (People, Places, Organisations, Things) are getting digital representation

All relationships between entities getting digitized

Every interaction is getting digitized

Web of Documents

Web of Entities

Web of Entities &

Relationships

Governing Information Structures

Topical Structures Human thoughts, human language

Written and expressed content, Interactions with each other

Billions of documents created everyday

Social Architecture Human Relationships

Geo-spatial Dimension Connecting to Physical dimension

Digitizing entire planet – every physical location, every road, every building, etc

Example Scenario:My Friend, Prasanjit, has captured a few pictures of this event, tagged all the faces in the pictures and uploaded them to the FIRE homepage with the comment FIRE-2012 pictures.

My wife wants to look at some pictures of mine from the recent Kolkata visit.

1. How should the information get represented?

2. How should she formulate the query?

Digital experiences - Emerging Trends

Appification of the web Early stage of app evolution

Rich Interactions/Experiences to the users

Bing Travel App

Information List of Actions associated

Web Docume

ntApps

For opening a particular document type, you can

open in any of the associated programs

For exploring a particular entity, you can explore it

with any of the associated apps

File Name: A.htmFile Type: HTML FileAssociate Programs:

Entity Name: SkyfallEntity Type: MovieAssociate Apps:

Two Apps: BookMyShowPVR Cinemas


Appification of the web Early stage of app evolution

Rich Interactions/Experiences to the users

Focus shifting from FILE to ENTITY

Need a “service” that can tell which apps are suited for what entities. Even further, for which actions on the entities.

Win8 People App

Contact Info aggregated from

multiple identitiesList of Actions

associated

Flight Booking

Cab Booking

Hotel Selection

Explore Kolkata

Explore ISI

Download some books

Flight Booking

Cab Booking

Hotel Selection

Explore Kolkata

Explore ISI

Download some books

Flight Booking

Cab Booking

Hotel Selection

Explore Kolkata

Explore ISI

Download some books

Flight Booking

Cab Booking

Hotel Selection

Explore Kolkata

Explore ISI

Download some books

Flight Booking

Cab Booking

Hotel Selection

Explore Kolkata

Explore ISI

Download some books

Task Completion is the KEY


Interconnections between Apps thru Entities

Web of Apps and Services is evolving

“Task/Action” Links are evolving e.g. 1: Task: Share on Social Network

Choice of Apps are shown

e.g. 2: Task: “Transfer Money”

Apps: ICICI Bank App, HDFC Bank App, ...

Web Document 1

Web Document 2

App 1

App 2

App 3

Hyperlink

What do we call these

links?

Digital experiences – Emerging Trends

NUI / Natural human interactions Touch, gestures, voice, …

E.g. Microsoft Kinect, Apple’s Siri

Device Capabilities coupled with seamless Cloud connectivity

New generation of digital experiences – Devices & Services

Device-side Understand all forms of human language

written language, spoken language, body language

Understanding image, motion

Sensors to be fully aware of Context

Server-side/Cloud-side Cloud infrastructure

Big Data / Machine Learning

Still early stages of devices and services

Intelligence FabricAnything we do, anywhere we are, the devices, the cloud services, the model that understands the situation and is able to predict, anticipate.








Paradigm Shifts Integrated Devices & Services Digitisation of our Society Information Structures

evolving Appification of the web Natural User Interfaces Powerful Devices Cheap Cloud Services Intelligence Fabric

Does form-factor of the devices play any role in the ranking?







Does layout and ranking of results have any correlation?







How to estimate information gain result collection is not homogenous?







a

Ranking across different content types?







a

Does User need to input text based query always?

User has Information needs User enters a query in input

box





Scenario:

Lets say my device has information about my scanned boarding pass and I am sitting in a wrong gate in the airport.

Do even I know?

Should my device wait for me to ask about it?

Thank You & Happy New Year

SREE HARI NAGARALU | [email protected]

Rethinking Search in the era of new devices and services

Documents

Transcript of Rethinking Search in the era of new devices and services